-- Logs begin at Mon 2022-06-27 10:29:10 UTC, end at Mon 2022-06-27 11:33:46 UTC. -- Jun 27 10:55:26.653323 dv-cinder-797608-34-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 27 10:55:26.660536 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 27 10:55:26.664074 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 10:55:26 2022] *** Jun 27 10:55:26.664074 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 10:55:26.664074 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 10:55:26.664074 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: nodename: dv-cinder-797608-34-iscsi Jun 27 10:55:26.664074 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: machine: x86_64 Jun 27 10:55:26.664074 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: clock source: unix Jun 27 10:55:26.664074 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: pcre jit disabled Jun 27 10:55:26.664074 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: detected number of CPU cores: 4 Jun 27 10:55:26.664074 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: current working directory: / Jun 27 10:55:26.664074 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: detected binary path: /usr/bin/uwsgi-core Jun 27 10:55:26.664074 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: your processes number limit is 47680 Jun 27 10:55:26.664074 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: your memory page size is 4096 bytes Jun 27 10:55:26.664074 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: detected max file descriptor number: 2048 Jun 27 10:55:26.664074 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: lock engine: pthread robust mutexes Jun 27 10:55:26.664074 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: thunder lock: enabled Jun 27 10:55:26.664074 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 27 10:55:26.664074 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 10:55:26.708453 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: Python main interpreter initialized at 0x557c6cd199c0 Jun 27 10:55:26.708453 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: python threads support enabled Jun 27 10:55:26.708453 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: your server socket listen backlog is limited to 100 connections Jun 27 10:55:26.708453 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: your mercy for graceful operations on workers is 90 seconds Jun 27 10:55:26.708814 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 10:55:26.708887 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: *** Operational MODE: preforking *** Jun 27 10:55:26.709152 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: *** uWSGI is running in multiple interpreter mode *** Jun 27 10:55:26.709152 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: spawned uWSGI master process (pid: 80228) Jun 27 10:55:26.709355 dv-cinder-797608-34-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 27 10:55:26.710468 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: spawned uWSGI worker 1 (pid: 80240, cores: 1) Jun 27 10:55:26.710468 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: spawned uWSGI worker 2 (pid: 80241, cores: 1) Jun 27 10:55:26.710468 dv-cinder-797608-34-iscsi devstack@keystone.service[80228]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 10:55:32.098824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 10:55:32.098824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: from cryptography.utils import int_from_bytes Jun 27 10:55:32.099620 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 10:55:32.099620 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: from cryptography.utils import int_from_bytes Jun 27 10:55:32.099756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 10:55:32.099756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: from cryptography.utils import int_from_bytes Jun 27 10:55:32.099756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 10:55:32.099756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: from cryptography.utils import int_from_bytes Jun 27 10:55:32.147910 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 10:55:32.148103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 10:55:32.148192 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 10:55:32.148299 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] command line args: [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 10:55:32.148384 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 10:55:32.148551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] command line args: [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 10:55:32.148639 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 10:55:32.148742 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ================================================================================ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 10:55:32.148827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 10:55:32.148986 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ================================================================================ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 10:55:32.149069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] admin_token = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.149232 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config_dir = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.149317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] admin_token = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.149444 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.149522 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] config_dir = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.149630 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config_source = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.149707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.149811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] debug = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.149900 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] config_source = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.150002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] debug = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.150083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.150313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.150470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.150598 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.150712 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.150858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.151466 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.151593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.151713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.151833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.151946 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.152057 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.152174 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_config_append = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.152295 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_config_append = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.152415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.152533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.152653 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_dir = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.152771 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_dir = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.152891 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.153011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_file = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.153124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.153235 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.153353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.153508 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.153612 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.153719 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.153838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.153962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.154066 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.154161 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.154272 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.154395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.154483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.154600 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.154679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.154751 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.154827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.154898 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.155014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.155093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.155164 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.155227 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.155302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.155418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.155491 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.155622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.155703 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.155774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.155900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.155976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.156246 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.156323 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.156431 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] publish_errors = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.156553 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] publish_errors = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.156665 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.156741 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.156893 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.156978 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.157054 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.157123 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.157301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.157423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.157568 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.157655 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.157801 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] standard_threads = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.157882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] standard_threads = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.158028 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.158156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.158281 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.158382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.158460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.158535 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.158617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_journal = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.158688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_journal = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.158756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_json = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.158820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_json = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.158925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_stderr = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.159001 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_stderr = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.159099 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_syslog = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.159175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_syslog = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.159327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.159402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 10:55:32.159582 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.159655 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.159817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.159893 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.160074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.160157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.160314 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.160390 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.160560 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.160642 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.160797 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.160871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.161043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.161117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.161279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.161354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.161551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.161636 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.161799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.161873 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.162045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.162127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.162279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.162356 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.162534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.162608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.162758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.162844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.163004 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.163080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.163249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.163325 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.163471 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.163543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.163725 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.163801 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.163978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.164060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.164221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.164296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.164453 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.164527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.164708 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.164789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.164966 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.165048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.165218 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.165299 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.165493 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.165571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.165723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.165806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.165954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.166029 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.166181 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.166264 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.166435 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.166513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.166687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.166761 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.166932 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.167014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.167162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.167237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.167391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.167465 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.167633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.167717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.167879 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.167954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.168115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.168189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.168358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.168441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.168589 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.168664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.168819 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.168893 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.169053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.169203 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.169276 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.169349 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.169524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.169603 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.169751 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.169835 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.169979 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.170053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.170210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.170285 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.170455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.170537 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.170682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.170757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.170948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.171031 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.171137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.171214 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.171370 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.171440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.171601 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.171665 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.171879 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.171962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.172072 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.172138 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.172309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.172395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.172540 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.172632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.172773 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.172849 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.173003 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.173086 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.173237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.173320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.173485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.173563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.173735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.173812 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.173968 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.174054 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.174202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.174276 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.174430 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.174519 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.174684 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.174761 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.174919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.175005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.175144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.175222 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.175379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.175459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.175616 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.175714 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.175879 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.175965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.176115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.176186 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.176359 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.176443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.176601 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.176677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.176835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.176912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.177069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.177147 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.177301 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.177435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.177572 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.177644 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.177809 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.177887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.178045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.178120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.178284 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.178361 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.178517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.178594 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.178751 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.178843 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.178988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.179100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.179229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.179305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.179462 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.179552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.179725 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.179807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.179964 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.180051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.180204 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.180294 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.180442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.180522 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.180685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.180756 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.180923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.181004 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.181156 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.181244 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.181415 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.181513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.181653 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.181729 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.181883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.181966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.182141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.182230 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.182376 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.182459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.182610 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.182690 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.182847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.182928 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.183082 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.183162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.183327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.183407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.183563 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.183645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.183818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.183899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.184077 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.184173 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.184313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.184398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.184542 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.external = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.184668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.external = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.184753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.184824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.185049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.185162 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.185279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.185386 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.185537 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.password = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.185615 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.password = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.185765 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.token = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.185840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.token = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.186002 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.186088 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.186234 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.186318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.186481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.186559 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.186710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.186814 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.186960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.187037 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.187200 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.187275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.187431 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.187517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.187664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.187741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.187911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.187987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.188157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.188240 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.188402 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.188478 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.188636 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.188713 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.188876 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.188960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.189108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.189184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.189358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.189451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.189630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.189719 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.189866 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.189944 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.190117 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.190193 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.190395 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.190479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.190638 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.190721 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.190895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.190971 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.191138 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.191222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.191391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.191467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.191623 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.191698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.191859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.191946 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.192104 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.192179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.192347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.192423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.192573 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.192657 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.192818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.192894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.193052 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.193126 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.193302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.193426 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.193567 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.193644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.193821 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.193898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.194058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.194148 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.194302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.194377 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.194536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.194611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.194783 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.194955 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.195029 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.195098 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.195252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.195334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.195486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.195563 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.195731 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.195806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.195963 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.196039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.196198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.196274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.196445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.196529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.196692 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.196768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.196927 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.197104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.197250 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.197421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.197570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.198204 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.198349 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.198481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.198611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.198753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.198884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.199014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.199152 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.199291 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.199436 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.199566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.199695 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.199824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.199965 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.200097 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.200226 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.200355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.200484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.200613 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.200772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.200905 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.201034 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.201170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.201316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.201513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.204130 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.204786 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.204918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.204998 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.205069 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.205201 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.205281 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.205424 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.205531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.205647 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.205724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.205810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.205885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.205964 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.206037 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.206108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.206178 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.206257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.206331 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.206401 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.206471 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.206541 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.206612 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.206691 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.206764 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.206834 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.206904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.206974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.206974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.207109 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.207182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.207253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.207329 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.207401 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.207471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.207549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.207622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.207693 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.207763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.207833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.207903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.207982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.208055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.208125 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.208195 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.208265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.208335 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.208415 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.208488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.208559 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.208629 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.208699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.208769 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.208848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.208920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.208991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.209061 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.209132 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.209210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.209283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.209353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.209491 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.209567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.209638 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.209722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.209797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.209868 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.209938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.210008 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.210085 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.210165 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.210238 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.210308 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.210378 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.210448 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.210519 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.210597 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.210670 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.210741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.210811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.210881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.210951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.211029 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.211102 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.211172 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.211243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.211313 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.211383 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.211462 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.211536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.211606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.211676 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.211746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.211816 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.211894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.211968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.212038 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.212109 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.212179 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.212294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.212421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.212541 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.212671 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.212788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.212911 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.213027 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.213167 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.213303 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.214066 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.214222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.214303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.214484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.214643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.214750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.214890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.214992 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.215138 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.215245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.215387 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.215504 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.215700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.215880 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.216013 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.216140 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.216276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.216404 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.216530 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.216663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.216791 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.216918 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.217053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.217182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.217308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.217464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.217600 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.217729 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.217866 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.217994 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.218121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.218246 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.218371 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.218496 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.218698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.218827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.218954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.219079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.219206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] role.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.219342 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.219478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] role.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.219605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.219730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.219855 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.219981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.220108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.220242 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.220370 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.220496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.220621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.220746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.220872 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.221007 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.221145 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.221273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.221418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.221544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.221682 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.221810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.221936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.222065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.222192 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.222320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.222453 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.222580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.222705 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.222841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.222967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.223094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.223231 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.223359 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.223491 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.223619 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.223746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.223871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.224006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.224133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.224261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.224387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.224522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.224648 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.224786 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.224913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.225039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.225164 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.225293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.225474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.225609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.225736 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.225862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.225987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.225987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.226242 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.226378 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.226505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.226505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.226742 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.226867 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.227001 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.227127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.227252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.227378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.227504 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.227629 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.227763 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.227890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.228025 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.228151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.228285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.228411 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.228545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.228672 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.228797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.228922 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.229046 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.229174 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.229308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.229465 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.229590 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.229725 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.229851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.229977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.230118 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.230246 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.230380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.230509 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.230635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.230761 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.230895 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.231022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.231148 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.231273 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.231398 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.231536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.231672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.231799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.231924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.232049 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.232049 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.232285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.232418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.232545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.232670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.232796 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.232921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.233055 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.233194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.233340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.233512 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.233652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.233780 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.233906 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.234032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.234158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.234284 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.234418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.234544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.234675 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.234802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.234929 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.235053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.235200 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.235334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.235462 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.235587 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.235722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.235850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.235986 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.236113 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.236239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.236365 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.236490 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.236616 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.236750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.236890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.237018 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.237144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.237269 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.237408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.237542 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.237668 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.237793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 10:55:32.237917 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 10:55:32.238043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 10:55:32.267079 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.267297 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.267437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.267582 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.267715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.267848 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.276710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.276859 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.304423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.304655 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.304785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.304932 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.446543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.448615 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.496012 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.496249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.496403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.496535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.561340 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.561612 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.561805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.561942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.562088 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.562221 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.562364 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.562494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.562622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.562760 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.562760 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.563004 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.587537 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.587775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.587924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.588054 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.588195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.588319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.588442 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.588573 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.588698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.588821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.588943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.589066 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.589189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.589189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.599956 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.600277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.612549 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.612778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.613001 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.613126 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.613250 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.613398 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.613521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.613654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.613778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.613920 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.614043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.614165 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.614165 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.614404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 10:55:32.631420 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.631628 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 10:55:32.631786 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.631961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.632098 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 10:55:32.632230 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 10:55:32.632365 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.632495 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.632618 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 10:55:32.632740 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.632871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.632994 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.633117 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.633239 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.633381 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.633516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.644749 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.645026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.645293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.645470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.645596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.645731 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.645998 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.646278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.653923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.654626 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.657200 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.657501 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.657783 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.657919 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.658043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.658175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.658330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.658454 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.658577 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.658699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.658829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.658953 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.659074 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.659206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.659328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.659451 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.659582 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.659705 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.659826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.659948 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.660205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.660469 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.687278 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.688263 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.688890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.689167 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.689898 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.690176 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.694442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.694833 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.695116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.695491 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.695880 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.696162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.702494 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.702735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.703473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.703753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.707225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.707511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.707792 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.708073 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.708213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.708339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.708489 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.708614 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.708772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.708897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.709052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.709177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.709321 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.709614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.709878 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.710141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.727912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.728188 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.728838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.729643 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.733415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.734219 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.737023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.737435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.738123 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.738522 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.742461 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.743529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.746620 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.747743 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.750289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.750589 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.750872 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.751154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.751417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.751542 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.751701 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.751824 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.751985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.752264 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.752555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.752828 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.770927 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.771207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.771475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.771750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.772201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.772490 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.772756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.773022 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.779671 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.780919 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.781385 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.781671 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.782661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.782950 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.784830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.785124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.785450 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.785758 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.786089 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.786313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.786592 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.786868 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.787142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.787419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.799782 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.800062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.800343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.800622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.801111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.801402 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.801695 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.801974 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.802142 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.802436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.802732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.803448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.803738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.804033 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.821031 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.822455 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.824361 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.825796 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.827669 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.829082 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.829417 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.830860 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.831065 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.831344 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.831631 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.832497 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.832776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.833057 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.839029 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.840671 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.840802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.842477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.843936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.844225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.844628 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.844906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.845752 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.846040 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.846434 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.846710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.854502 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.854790 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.855067 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.856310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.856590 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.856875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.862917 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.863198 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.863478 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.863751 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.864022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.864393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.864679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 10:55:32.864761 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.864948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.865028 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.865215 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.865294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.865513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.865607 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.865781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.865860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.866040 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.866177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.866312 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.866434 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.866582 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.866706 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.866977 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.867253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.867524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.867794 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.868077 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.868336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 10:55:32.904827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557c6cd199c0 pid: 80240 (default app) Jun 27 10:55:32.906783 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557c6cd199c0 pid: 80241 (default app) Jun 27 10:55:32.908256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba3bb3-037e-4d30-b9af-7112417fb76c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:32.908552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba3bb3-037e-4d30-b9af-7112417fb76c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:32.908834 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba3bb3-037e-4d30-b9af-7112417fb76c None None] PATH_INFO: `/v3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:32.913010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Mon Jun 27 10:55:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:55:40.427009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff3398-695b-446e-be4c-4444379fc5ed None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:40.427593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff3398-695b-446e-be4c-4444379fc5ed None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:40.427593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff3398-695b-446e-be4c-4444379fc5ed None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:40.431925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:55:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:55:40.437270 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaef81-5af8-45b7-a24a-74cd08ad3cb4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:40.437680 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaef81-5af8-45b7-a24a-74cd08ad3cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:40.437856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaef81-5af8-45b7-a24a-74cd08ad3cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:40.506630 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: INFO dbcounter [None req-bdfaef81-5af8-45b7-a24a-74cd08ad3cb4 None None] Registered counter for database keystone Jun 27 10:55:40.528584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG oslo_db.sqlalchemy.engines [None req-bdfaef81-5af8-45b7-a24a-74cd08ad3cb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 10:55:40.534938 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writer thread running {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 10:55:40.708508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG passlib.handlers.bcrypt [None req-bdfaef81-5af8-45b7-a24a-74cd08ad3cb4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80240) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 27 10:55:40.708919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG passlib.handlers.bcrypt [None req-bdfaef81-5af8-45b7-a24a-74cd08ad3cb4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80240) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 27 10:55:40.763700 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bdfaef81-5af8-45b7-a24a-74cd08ad3cb4 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:55:40.765239 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bdfaef81-5af8-45b7-a24a-74cd08ad3cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:55:40.883579 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:55:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 27 10:55:41.043687 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff3398-695b-446e-be4c-4444379fc5ed None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:41.113858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: INFO dbcounter [None req-aaff3398-695b-446e-be4c-4444379fc5ed None None] Registered counter for database keystone Jun 27 10:55:41.133420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG oslo_db.sqlalchemy.engines [None req-aaff3398-695b-446e-be4c-4444379fc5ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 10:55:41.139864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writer thread running {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 10:55:41.258069 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff3398-695b-446e-be4c-4444379fc5ed None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:41.262637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b91031-1dd1-4ce7-8c50-df6b7982f4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:41.263300 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b91031-1dd1-4ce7-8c50-df6b7982f4cd admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:41.263583 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b91031-1dd1-4ce7-8c50-df6b7982f4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:41.263861 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b91031-1dd1-4ce7-8c50-df6b7982f4cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:41.271922 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b91031-1dd1-4ce7-8c50-df6b7982f4cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:41.323817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: WARNING keystone.common.rbac_enforcer.enforcer [None req-42b91031-1dd1-4ce7-8c50-df6b7982f4cd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 27 10:55:41.324105 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b91031-1dd1-4ce7-8c50-df6b7982f4cd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:41.333482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Jun 27 10:55:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 10:55:41.339739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaef81-5af8-45b7-a24a-74cd08ad3cb4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:41.354715 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaef81-5af8-45b7-a24a-74cd08ad3cb4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:41.359118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7351c1a-21eb-4ebe-8ea4-fad4d0ef272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:41.360257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7351c1a-21eb-4ebe-8ea4-fad4d0ef272d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:41.360546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7351c1a-21eb-4ebe-8ea4-fad4d0ef272d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:41.360825 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7351c1a-21eb-4ebe-8ea4-fad4d0ef272d admin admin] PATH_INFO: `/v3/projects/4ccd8cb3bebf4369b70aa2f145132951` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:41.364912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7351c1a-21eb-4ebe-8ea4-fad4d0ef272d admin admin] RBAC: Authorizing `identity:get_project(project_id=4ccd8cb3bebf4369b70aa2f145132951)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:41.415419 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d7351c1a-21eb-4ebe-8ea4-fad4d0ef272d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 27 10:55:41.415769 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7351c1a-21eb-4ebe-8ea4-fad4d0ef272d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:41.420906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Jun 27 10:55:41 2022] GET /identity/v3/projects/4ccd8cb3bebf4369b70aa2f145132951 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:55:43.391300 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18eeb5f-2fdf-4b76-ba8b-1e9454ba313f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:43.391818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18eeb5f-2fdf-4b76-ba8b-1e9454ba313f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:43.391905 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18eeb5f-2fdf-4b76-ba8b-1e9454ba313f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:43.395953 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:55:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:55:43.401835 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18c00f-bbb2-4fc3-8f88-bfc2abc90569 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:43.402243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18c00f-bbb2-4fc3-8f88-bfc2abc90569 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:43.402394 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18c00f-bbb2-4fc3-8f88-bfc2abc90569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:43.421314 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-aa18c00f-bbb2-4fc3-8f88-bfc2abc90569 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:55:43.422861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-aa18c00f-bbb2-4fc3-8f88-bfc2abc90569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:55:43.430885 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:55:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 27 10:55:43.452893 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18eeb5f-2fdf-4b76-ba8b-1e9454ba313f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:43.464645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18eeb5f-2fdf-4b76-ba8b-1e9454ba313f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:43.468801 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8c520-398e-42d4-997f-3f2f88cb2874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:43.469448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8c520-398e-42d4-997f-3f2f88cb2874 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:43.469733 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8c520-398e-42d4-997f-3f2f88cb2874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:43.470014 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8c520-398e-42d4-997f-3f2f88cb2874 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:43.477542 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8c520-398e-42d4-997f-3f2f88cb2874 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:43.479811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8c520-398e-42d4-997f-3f2f88cb2874 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:43.488382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Jun 27 10:55:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 10:55:43.493466 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18c00f-bbb2-4fc3-8f88-bfc2abc90569 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:43.502954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18c00f-bbb2-4fc3-8f88-bfc2abc90569 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:43.507269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5854fc-3962-4508-af3a-90206cfeb240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:43.508120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5854fc-3962-4508-af3a-90206cfeb240 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:43.508405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5854fc-3962-4508-af3a-90206cfeb240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:43.508680 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5854fc-3962-4508-af3a-90206cfeb240 admin admin] PATH_INFO: `/v3/users/97dbc9dd817544e5a3eb7457f8275b7b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:43.510083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5854fc-3962-4508-af3a-90206cfeb240 admin admin] RBAC: Authorizing `identity:get_user(user_id=97dbc9dd817544e5a3eb7457f8275b7b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:43.512796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5854fc-3962-4508-af3a-90206cfeb240 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:43.515457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Jun 27 10:55:43 2022] GET /identity/v3/users/97dbc9dd817544e5a3eb7457f8275b7b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:55:45.548688 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f981d-0074-4b9c-95db-0d5e60b5513b None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:45.549197 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f981d-0074-4b9c-95db-0d5e60b5513b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:45.549288 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f981d-0074-4b9c-95db-0d5e60b5513b None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:45.550614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:55:45.555620 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4ac41-1497-4d2a-bfa4-1ba0b638f5c6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:45.555990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4ac41-1497-4d2a-bfa4-1ba0b638f5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:45.556295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4ac41-1497-4d2a-bfa4-1ba0b638f5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:45.573299 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f3d4ac41-1497-4d2a-bfa4-1ba0b638f5c6 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:55:45.574506 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f3d4ac41-1497-4d2a-bfa4-1ba0b638f5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:55:45.578130 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e9d4a-3d99-4f71-ba18-fd55bc8dbb3c None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:45.578417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e9d4a-3d99-4f71-ba18-fd55bc8dbb3c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:45.578692 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e9d4a-3d99-4f71-ba18-fd55bc8dbb3c None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:45.580019 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:55:45.584971 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baa112-8b7a-4199-88bc-8a44066060aa None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:45.585259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baa112-8b7a-4199-88bc-8a44066060aa None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:45.585563 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baa112-8b7a-4199-88bc-8a44066060aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:45.623809 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG passlib.handlers.bcrypt [None req-f8baa112-8b7a-4199-88bc-8a44066060aa None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80241) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 27 10:55:45.624232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG passlib.handlers.bcrypt [None req-f8baa112-8b7a-4199-88bc-8a44066060aa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80241) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 27 10:55:45.654837 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:55:45.670186 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f8baa112-8b7a-4199-88bc-8a44066060aa None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:55:45.671745 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f8baa112-8b7a-4199-88bc-8a44066060aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:55:45.677459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4ac41-1497-4d2a-bfa4-1ba0b638f5c6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:45.700315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:45.769326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:55:45.779208 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4ac41-1497-4d2a-bfa4-1ba0b638f5c6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:45.791237 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baa112-8b7a-4199-88bc-8a44066060aa None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:45.812495 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a165b13-0792-4827-be2f-7bffdfdf7157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:45.813227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a165b13-0792-4827-be2f-7bffdfdf7157 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:45.813543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a165b13-0792-4827-be2f-7bffdfdf7157 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:45.813829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a165b13-0792-4827-be2f-7bffdfdf7157 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:45.825534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a165b13-0792-4827-be2f-7bffdfdf7157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:55:45.836604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-3a165b13-0792-4827-be2f-7bffdfdf7157 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:55:45.836604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:55:45.836604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:55:45.836604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:55:45.836604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:55:45.836604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:55:45.836604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:55:45.836604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:55:45.836604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:55:45.836604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:55:45.836604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:55:45.836604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:55:45.836604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:55:45.836604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:55:45.836604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:55:45.836604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:55:45.837656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:55:45.837656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:55:45.837656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:55:45.837656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:55:45.837656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:55:45.837656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:55:45.837656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:55:45.837656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:55:45.837656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:55:45.837656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:55:45.837656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:55:45.837656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:55:45.837656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:55:45.837656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:55:45.837656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:55:45.837656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:55:45.838472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:55:45.838472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:55:45.838472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:55:45.838472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:55:45.838472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:55:45.838472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:55:45.838472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:55:45.838472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:55:45.838472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:55:45.838472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:55:45.838472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:55:45.838472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:55:45.838472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:55:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:55:45.843532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a165b13-0792-4827-be2f-7bffdfdf7157 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:45.889750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baa112-8b7a-4199-88bc-8a44066060aa None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:45.891977 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:45.923053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:45.928562 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d306b-dfba-42e4-8949-e919cbf2b3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:45.929486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d306b-dfba-42e4-8949-e919cbf2b3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:45.929776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d306b-dfba-42e4-8949-e919cbf2b3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:45.930053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d306b-dfba-42e4-8949-e919cbf2b3c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:45.941875 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a165b13-0792-4827-be2f-7bffdfdf7157 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:45.976514 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d893bd-bd37-4909-8dc5-871453293578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:45.977164 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d893bd-bd37-4909-8dc5-871453293578 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:45.977472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d893bd-bd37-4909-8dc5-871453293578 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:45.977748 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d893bd-bd37-4909-8dc5-871453293578 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:45.978495 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d893bd-bd37-4909-8dc5-871453293578 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:55:45.978799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d893bd-bd37-4909-8dc5-871453293578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:45.980187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d893bd-bd37-4909-8dc5-871453293578 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:45.991716 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:55:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:55:45.996497 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d306b-dfba-42e4-8949-e919cbf2b3c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:45.997514 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d893bd-bd37-4909-8dc5-871453293578 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:45.998053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d306b-dfba-42e4-8949-e919cbf2b3c9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:46.093441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d893bd-bd37-4909-8dc5-871453293578 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:46.093996 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:55:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 10:55:46.099487 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d306b-dfba-42e4-8949-e919cbf2b3c9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:46.102167 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:46.127418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bee7d-08b6-4fd4-8eec-6530d6ec658f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:46.128286 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bee7d-08b6-4fd4-8eec-6530d6ec658f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:46.128576 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bee7d-08b6-4fd4-8eec-6530d6ec658f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:46.128853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bee7d-08b6-4fd4-8eec-6530d6ec658f None admin] PATH_INFO: `/v3/users/97dbc9dd817544e5a3eb7457f8275b7b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:46.130125 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bee7d-08b6-4fd4-8eec-6530d6ec658f None admin] RBAC: Authorizing `identity:get_user(user_id=97dbc9dd817544e5a3eb7457f8275b7b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:46.131589 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bee7d-08b6-4fd4-8eec-6530d6ec658f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:46.133212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:55:45 2022] GET /identity/v3/users/97dbc9dd817544e5a3eb7457f8275b7b => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:55:46.139299 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bee7d-08b6-4fd4-8eec-6530d6ec658f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:46.152924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:46.196336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d306b-dfba-42e4-8949-e919cbf2b3c9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:46.231770 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e37d5-abe5-424b-8867-03b172b4b321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:46.232551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e37d5-abe5-424b-8867-03b172b4b321 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:46.232826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e37d5-abe5-424b-8867-03b172b4b321 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:46.233097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e37d5-abe5-424b-8867-03b172b4b321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:46.239707 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bee7d-08b6-4fd4-8eec-6530d6ec658f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:46.252679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e37d5-abe5-424b-8867-03b172b4b321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:46.254166 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e37d5-abe5-424b-8867-03b172b4b321 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:46.274481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-d43e37d5-abe5-424b-8867-03b172b4b321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:55:46.274481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:55:46.274481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:55:46.274481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:55:46.274481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:55:46.274481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:55:46.274481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:55:46.274481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:55:46.274481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:55:46.274481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:55:46.274481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:55:46.274481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:55:46.274481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:55:46.274481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:55:46.274481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:55:46.275280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:55:46.275280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:55:46.275280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:55:46.275280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:55:46.275280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:55:46.275280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:55:46.275280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:55:46.275280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:55:46.275280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:55:46.275280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:55:46.275280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:55:46.275280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:55:46.275280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:55:46.275280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:55:46.275280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:55:46.275280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:55:46.275280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:55:46.276117 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:55:46.276117 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:55:46.276117 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:55:46.276117 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:55:46.276331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8a62a-ada4-4746-bada-62d63f525211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:46.276331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8a62a-ada4-4746-bada-62d63f525211 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:46.276331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8a62a-ada4-4746-bada-62d63f525211 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:46.276529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:55:46.276594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8a62a-ada4-4746-bada-62d63f525211 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:46.276967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8a62a-ada4-4746-bada-62d63f525211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:46.278442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8a62a-ada4-4746-bada-62d63f525211 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:46.280024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:55:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:55:46.282498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e37d5-abe5-424b-8867-03b172b4b321 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:46.285561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8a62a-ada4-4746-bada-62d63f525211 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:46.337386 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:46.364652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:46.381515 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e37d5-abe5-424b-8867-03b172b4b321 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:46.383907 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8a62a-ada4-4746-bada-62d63f525211 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:46.413769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62b2df-f3ac-49cc-85c7-e2200893f2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:46.414415 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62b2df-f3ac-49cc-85c7-e2200893f2bd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:46.414701 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62b2df-f3ac-49cc-85c7-e2200893f2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:46.414978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62b2df-f3ac-49cc-85c7-e2200893f2bd None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:46.415694 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62b2df-f3ac-49cc-85c7-e2200893f2bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:55:46.415996 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62b2df-f3ac-49cc-85c7-e2200893f2bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:46.417227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf7b44-7aec-42aa-828e-697acbba7217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:46.417891 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf7b44-7aec-42aa-828e-697acbba7217 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:46.418002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62b2df-f3ac-49cc-85c7-e2200893f2bd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:46.418171 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf7b44-7aec-42aa-828e-697acbba7217 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:46.418442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf7b44-7aec-42aa-828e-697acbba7217 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:46.419267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf7b44-7aec-42aa-828e-697acbba7217 None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.domain.id=default, user.id=97dbc9dd817544e5a3eb7457f8275b7b) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:55:46.419575 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf7b44-7aec-42aa-828e-697acbba7217 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:46.420987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf7b44-7aec-42aa-828e-697acbba7217 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:46.427793 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Mon Jun 27 10:55:46 2022] GET /identity/v3/role_assignments?user.id=97dbc9dd817544e5a3eb7457f8275b7b&scope.domain.id=default&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:55:46.435838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:55:48.734428 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dfd62-d11e-4a8c-9e27-547035e143be None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:48.734934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dfd62-d11e-4a8c-9e27-547035e143be None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:48.735031 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dfd62-d11e-4a8c-9e27-547035e143be None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:48.736331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:55:48.741814 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a8673-1600-4092-95da-fa0d029f986f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:48.742198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a8673-1600-4092-95da-fa0d029f986f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:48.742358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a8673-1600-4092-95da-fa0d029f986f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:48.769476 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0f9a8673-1600-4092-95da-fa0d029f986f None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:55:48.770673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0f9a8673-1600-4092-95da-fa0d029f986f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:55:48.872063 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:55:48.918842 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666dfd62-d11e-4a8c-9e27-547035e143be None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:49.046075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666dfd62-d11e-4a8c-9e27-547035e143be None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:49.088461 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7463d-060f-4ac8-9d85-8198d95657f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:49.089091 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004144f-c3b7-4b83-b22b-452f164da4a2 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:49.089269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7463d-060f-4ac8-9d85-8198d95657f2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:49.089404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004144f-c3b7-4b83-b22b-452f164da4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:49.089564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7463d-060f-4ac8-9d85-8198d95657f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:49.089653 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004144f-c3b7-4b83-b22b-452f164da4a2 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:49.089835 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7463d-060f-4ac8-9d85-8198d95657f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:49.091154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:55:49.098646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8d847-4fe9-491a-9da5-137ba940ccdc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:49.098927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8d847-4fe9-491a-9da5-137ba940ccdc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:49.099209 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8d847-4fe9-491a-9da5-137ba940ccdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:49.110117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7463d-060f-4ac8-9d85-8198d95657f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:55:49.119926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c8f7463d-060f-4ac8-9d85-8198d95657f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:55:49.119926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:55:49.119926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:55:49.119926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:55:49.119926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:55:49.119926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:55:49.119926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:55:49.119926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:55:49.119926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:55:49.119926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:55:49.119926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:55:49.119926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:55:49.119926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:55:49.119926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:55:49.119926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:55:49.119926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:55:49.120771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:55:49.120771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:55:49.120771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:55:49.120771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:55:49.120771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:55:49.120771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:55:49.120771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:55:49.120771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:55:49.120771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:55:49.120771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:55:49.120771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:55:49.120771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:55:49.120771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:55:49.120771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:55:49.120771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:55:49.120771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:55:49.121566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:55:49.121566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:55:49.121566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:55:49.121566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:55:49.121566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:55:49.121566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:55:49.121566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:55:49.121566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:55:49.121566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:55:49.121566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:55:49.121566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:55:49.121566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:55:49.121566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 13/25] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:55:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:55:49.131956 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7463d-060f-4ac8-9d85-8198d95657f2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:49.132118 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-02b8d847-4fe9-491a-9da5-137ba940ccdc None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:55:49.133209 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-02b8d847-4fe9-491a-9da5-137ba940ccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:55:49.145708 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:49.249732 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:49.308695 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 13/26] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:55:49.310759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53da00b-560c-450f-a6ce-97d70d224c18 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:49.311259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53da00b-560c-450f-a6ce-97d70d224c18 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:49.311734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53da00b-560c-450f-a6ce-97d70d224c18 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:49.317607 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 14/27] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:55:49.319264 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8099ba-f75a-4e19-8214-292db0fa02b2 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:49.319761 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8099ba-f75a-4e19-8214-292db0fa02b2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:49.320348 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8099ba-f75a-4e19-8214-292db0fa02b2 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:49.322528 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 15/28] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:55:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:55:49.323766 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d0052-9cff-433d-96d6-5993eeb7ed02 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:49.324262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d0052-9cff-433d-96d6-5993eeb7ed02 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:49.325041 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d0052-9cff-433d-96d6-5993eeb7ed02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:49.338785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7463d-060f-4ac8-9d85-8198d95657f2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:49.344516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-192d0052-9cff-433d-96d6-5993eeb7ed02 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:55:49.345996 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-192d0052-9cff-433d-96d6-5993eeb7ed02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:55:49.386533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e63b1f-5fdc-427f-8866-2af7666ba484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:49.387303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e63b1f-5fdc-427f-8866-2af7666ba484 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:49.387599 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e63b1f-5fdc-427f-8866-2af7666ba484 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:49.387879 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e63b1f-5fdc-427f-8866-2af7666ba484 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:49.388733 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e63b1f-5fdc-427f-8866-2af7666ba484 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:55:49.389141 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e63b1f-5fdc-427f-8866-2af7666ba484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:49.390733 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e63b1f-5fdc-427f-8866-2af7666ba484 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:49.406488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 14/29] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:55:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:55:49.406488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818729c-c3ea-4b67-bfc0-6b85259e36ef None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:49.406488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818729c-c3ea-4b67-bfc0-6b85259e36ef None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:49.406488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818729c-c3ea-4b67-bfc0-6b85259e36ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:49.422402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4818729c-c3ea-4b67-bfc0-6b85259e36ef None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:55:49.423507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4818729c-c3ea-4b67-bfc0-6b85259e36ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:55:49.444754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 16/30] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:55:49.444754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d0052-9cff-433d-96d6-5993eeb7ed02 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:49.504845 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:49.514796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 15/31] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:55:49.515814 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818729c-c3ea-4b67-bfc0-6b85259e36ef None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:49.560018 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d0052-9cff-433d-96d6-5993eeb7ed02 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:49.568105 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:49.597343 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6c3d6-fc3a-4c80-9bfe-464e12fec078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:49.598357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6c3d6-fc3a-4c80-9bfe-464e12fec078 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:49.598856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6c3d6-fc3a-4c80-9bfe-464e12fec078 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:49.599339 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6c3d6-fc3a-4c80-9bfe-464e12fec078 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:49.600264 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6c3d6-fc3a-4c80-9bfe-464e12fec078 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:49.601874 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6c3d6-fc3a-4c80-9bfe-464e12fec078 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:49.653266 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818729c-c3ea-4b67-bfc0-6b85259e36ef None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:49.690006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b3d60-f98d-4406-8f3d-6a1aa969cc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:49.690877 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b3d60-f98d-4406-8f3d-6a1aa969cc4e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:49.691159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b3d60-f98d-4406-8f3d-6a1aa969cc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:49.691435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b3d60-f98d-4406-8f3d-6a1aa969cc4e None admin] PATH_INFO: `/v3/users/97dbc9dd817544e5a3eb7457f8275b7b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:49.692683 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b3d60-f98d-4406-8f3d-6a1aa969cc4e None admin] RBAC: Authorizing `identity:get_user(user_id=97dbc9dd817544e5a3eb7457f8275b7b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:49.694204 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b3d60-f98d-4406-8f3d-6a1aa969cc4e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:49.700159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 16/32] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:55:49 2022] GET /identity/v3/users/97dbc9dd817544e5a3eb7457f8275b7b => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:55:49.700159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b3d60-f98d-4406-8f3d-6a1aa969cc4e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:49.737033 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 17/33] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Jun 27 10:55:49 2022] POST /identity/v3/roles => generated 225 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:55:49.738495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6c3d6-fc3a-4c80-9bfe-464e12fec078 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:49.768041 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:49.814742 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b3d60-f98d-4406-8f3d-6a1aa969cc4e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:49.850098 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6c3d6-fc3a-4c80-9bfe-464e12fec078 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:49.855021 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae557939-9232-4cc9-9df0-89c22d88ae09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:49.855830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae557939-9232-4cc9-9df0-89c22d88ae09 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:49.856115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae557939-9232-4cc9-9df0-89c22d88ae09 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:49.856391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae557939-9232-4cc9-9df0-89c22d88ae09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:49.868626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae557939-9232-4cc9-9df0-89c22d88ae09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:49.870311 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae557939-9232-4cc9-9df0-89c22d88ae09 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:49.888853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0f495-41c1-4779-a775-04d5389b2199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:49.889947 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0f495-41c1-4779-a775-04d5389b2199 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:49.890439 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0f495-41c1-4779-a775-04d5389b2199 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:49.890907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0f495-41c1-4779-a775-04d5389b2199 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:49.891862 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0f495-41c1-4779-a775-04d5389b2199 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:49.891967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ae557939-9232-4cc9-9df0-89c22d88ae09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:55:49.891967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:55:49.891967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:55:49.891967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:55:49.891967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:55:49.891967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:55:49.891967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:55:49.891967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:55:49.891967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:55:49.891967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:55:49.891967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:55:49.891967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:55:49.891967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:55:49.891967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:55:49.891967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:55:49.892704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:55:49.892704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:55:49.892704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:55:49.892704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:55:49.892704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:55:49.892704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:55:49.892704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:55:49.892704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:55:49.892704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:55:49.892704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:55:49.892704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:55:49.892704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:55:49.892704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:55:49.892704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:55:49.892704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:55:49.892704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:55:49.892704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:55:49.898772 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:55:49.898772 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:55:49.898772 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:55:49.898772 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:55:49.898772 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 17/34] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:55:49.898772 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae557939-9232-4cc9-9df0-89c22d88ae09 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:49.901589 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0f495-41c1-4779-a775-04d5389b2199 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:49.929544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 18/35] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Jun 27 10:55:49 2022] POST /identity/v3/roles => generated 219 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:55:49.930928 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0f495-41c1-4779-a775-04d5389b2199 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:49.976581 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:50.024238 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae557939-9232-4cc9-9df0-89c22d88ae09 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:50.044760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:50.068375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70faaeb5-5b6f-43f8-8214-978f28abd1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:50.069115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faaeb5-5b6f-43f8-8214-978f28abd1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:50.069431 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faaeb5-5b6f-43f8-8214-978f28abd1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:50.069715 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faaeb5-5b6f-43f8-8214-978f28abd1f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:50.071388 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70faaeb5-5b6f-43f8-8214-978f28abd1f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:50.073564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70faaeb5-5b6f-43f8-8214-978f28abd1f5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:50.074416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0f495-41c1-4779-a775-04d5389b2199 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:50.075537 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 18/36] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:55:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:55:50.081297 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70faaeb5-5b6f-43f8-8214-978f28abd1f5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:50.112072 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a6a2a-58df-4e2e-bd6b-02fe5e14e48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:50.112727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a6a2a-58df-4e2e-bd6b-02fe5e14e48b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:50.113009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a6a2a-58df-4e2e-bd6b-02fe5e14e48b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:50.113284 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a6a2a-58df-4e2e-bd6b-02fe5e14e48b None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:50.114049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a6a2a-58df-4e2e-bd6b-02fe5e14e48b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:55:50.114356 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a6a2a-58df-4e2e-bd6b-02fe5e14e48b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:50.115757 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a6a2a-58df-4e2e-bd6b-02fe5e14e48b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:50.129669 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 19/37] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:55:50.136228 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a6a2a-58df-4e2e-bd6b-02fe5e14e48b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:50.206457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70faaeb5-5b6f-43f8-8214-978f28abd1f5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:50.231400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:50.253060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a6f05-c250-4809-af5f-107979a4d83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:50.253254 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a6a2a-58df-4e2e-bd6b-02fe5e14e48b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:50.253972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a6f05-c250-4809-af5f-107979a4d83d None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:50.254253 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a6f05-c250-4809-af5f-107979a4d83d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:50.254529 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a6f05-c250-4809-af5f-107979a4d83d None admin] PATH_INFO: `/v3/domains/default/users/97dbc9dd817544e5a3eb7457f8275b7b/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:50.256585 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a6f05-c250-4809-af5f-107979a4d83d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=97dbc9dd817544e5a3eb7457f8275b7b, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:50.258109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a6f05-c250-4809-af5f-107979a4d83d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:50.302121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9716a12-3722-4290-b9e4-53109bfbc072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:50.303186 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9716a12-3722-4290-b9e4-53109bfbc072 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:50.303685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9716a12-3722-4290-b9e4-53109bfbc072 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:50.304146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9716a12-3722-4290-b9e4-53109bfbc072 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:50.305517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9716a12-3722-4290-b9e4-53109bfbc072 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:50.307863 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9716a12-3722-4290-b9e4-53109bfbc072 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:50.338267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 20/38] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jun 27 10:55:50 2022] POST /identity/v3/projects => generated 301 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 10:55:50.340020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55d25-799a-40a9-b77e-9ce03f4f1d6d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:50.340500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55d25-799a-40a9-b77e-9ce03f4f1d6d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:50.341018 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55d25-799a-40a9-b77e-9ce03f4f1d6d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:50.342700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 21/39] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:55:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:55:50.350850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4bdb4-4990-4c43-9ca4-5880eb2aa7cd None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:50.350850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4bdb4-4990-4c43-9ca4-5880eb2aa7cd None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:50.350850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4bdb4-4990-4c43-9ca4-5880eb2aa7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:50.368720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e6d4bdb4-4990-4c43-9ca4-5880eb2aa7cd None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:55:50.370845 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e6d4bdb4-4990-4c43-9ca4-5880eb2aa7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:55:50.388399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 19/40] 10.222.0.18 () {58 vars in 1361 bytes} [Mon Jun 27 10:55:50 2022] PUT /identity/v3/domains/default/users/97dbc9dd817544e5a3eb7457f8275b7b/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 10:55:50.464409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 22/41] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:55:50.489313 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a6f05-c250-4809-af5f-107979a4d83d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:50.546362 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:50.579020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09710999-d63c-4fff-8bfc-95bc140769f3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:50.579341 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09710999-d63c-4fff-8bfc-95bc140769f3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:50.579576 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09710999-d63c-4fff-8bfc-95bc140769f3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:50.580951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 23/42] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:55:50.586303 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2e0b1-88e7-40ba-9ad6-ba68d1a8fd73 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:50.586591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2e0b1-88e7-40ba-9ad6-ba68d1a8fd73 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:50.586873 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2e0b1-88e7-40ba-9ad6-ba68d1a8fd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:50.607375 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c6b2e0b1-88e7-40ba-9ad6-ba68d1a8fd73 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:55:50.608501 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c6b2e0b1-88e7-40ba-9ad6-ba68d1a8fd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:55:50.619828 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a6f05-c250-4809-af5f-107979a4d83d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:50.656775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd479bb1-55eb-479d-9411-090bb95707f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:50.657479 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd479bb1-55eb-479d-9411-090bb95707f6 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:50.657799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd479bb1-55eb-479d-9411-090bb95707f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:50.658048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd479bb1-55eb-479d-9411-090bb95707f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:50.658805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd479bb1-55eb-479d-9411-090bb95707f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:50.660405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd479bb1-55eb-479d-9411-090bb95707f6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:50.680450 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:50.685789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 20/43] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Jun 27 10:55:50 2022] POST /identity/v3/roles => generated 223 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:55:50.690867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 24/44] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:55:50.717194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd479bb1-55eb-479d-9411-090bb95707f6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:50.931197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd479bb1-55eb-479d-9411-090bb95707f6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:50.934222 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:50.965690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3ad65-194c-4a6b-9578-a2eb5d4d7865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:50.966481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3ad65-194c-4a6b-9578-a2eb5d4d7865 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:50.966765 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3ad65-194c-4a6b-9578-a2eb5d4d7865 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:50.967040 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3ad65-194c-4a6b-9578-a2eb5d4d7865 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:50.968283 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3ad65-194c-4a6b-9578-a2eb5d4d7865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:50.969751 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3ad65-194c-4a6b-9578-a2eb5d4d7865 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:50.971366 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 21/45] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:55:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:55:50.976919 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2e0b1-88e7-40ba-9ad6-ba68d1a8fd73 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:51.072081 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2e0b1-88e7-40ba-9ad6-ba68d1a8fd73 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:51.105557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fab422-3403-4d7a-a95b-e91ad859e08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:51.106213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fab422-3403-4d7a-a95b-e91ad859e08f None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:51.106498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fab422-3403-4d7a-a95b-e91ad859e08f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:51.106775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fab422-3403-4d7a-a95b-e91ad859e08f None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:51.107481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fab422-3403-4d7a-a95b-e91ad859e08f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:51.108933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fab422-3403-4d7a-a95b-e91ad859e08f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:51.132938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 25/46] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jun 27 10:55:50 2022] POST /identity/v3/projects => generated 312 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 10:55:52.437176 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9205e8a-0929-4266-92bb-0a7df573edc3 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:52.437721 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9205e8a-0929-4266-92bb-0a7df573edc3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:52.437802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9205e8a-0929-4266-92bb-0a7df573edc3 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:52.439139 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 22/47] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:55:52.444376 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59572264-33a8-4896-a9c6-2647dae8eed6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:52.444762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59572264-33a8-4896-a9c6-2647dae8eed6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:52.445011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59572264-33a8-4896-a9c6-2647dae8eed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:52.461941 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-59572264-33a8-4896-a9c6-2647dae8eed6 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:55:52.463065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-59572264-33a8-4896-a9c6-2647dae8eed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:55:52.507388 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:52.527870 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 26/48] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:55:52.551918 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9205e8a-0929-4266-92bb-0a7df573edc3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:52.651647 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9205e8a-0929-4266-92bb-0a7df573edc3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:52.684767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e39623-f187-4f5b-8ec5-8602189a0733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:52.685579 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e39623-f187-4f5b-8ec5-8602189a0733 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:52.685865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e39623-f187-4f5b-8ec5-8602189a0733 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:52.686144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e39623-f187-4f5b-8ec5-8602189a0733 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:52.696015 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e39623-f187-4f5b-8ec5-8602189a0733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:55:52.703558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b1e39623-f187-4f5b-8ec5-8602189a0733 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:55:52.703558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:55:52.703558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:55:52.703558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:55:52.703558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:55:52.703558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:55:52.703558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:55:52.703558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:55:52.703558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:55:52.703558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:55:52.703558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:55:52.703558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:55:52.703558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:55:52.703558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:55:52.703558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:55:52.703558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:55:52.704534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:55:52.704534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:55:52.704534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:55:52.704534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:55:52.704534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:55:52.704534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:55:52.704534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:55:52.704534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:55:52.704534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:55:52.704534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:55:52.704534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:55:52.704534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:55:52.704534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:55:52.704534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:55:52.704534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:55:52.704534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:55:52.705348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:55:52.705348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:55:52.705348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:55:52.705348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:55:52.705348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:55:52.705348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:55:52.705348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:55:52.705348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:55:52.705348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:55:52.705348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:55:52.705348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:55:52.705348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:55:52.705348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 23/49] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:55:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:55:52.710441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59572264-33a8-4896-a9c6-2647dae8eed6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:52.805807 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59572264-33a8-4896-a9c6-2647dae8eed6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:52.837836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07002697-ed39-4ca0-a890-dfdfd3c375e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:52.839009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07002697-ed39-4ca0-a890-dfdfd3c375e0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:52.839292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07002697-ed39-4ca0-a890-dfdfd3c375e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:52.839566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07002697-ed39-4ca0-a890-dfdfd3c375e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:52.840315 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07002697-ed39-4ca0-a890-dfdfd3c375e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:55:52.840617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07002697-ed39-4ca0-a890-dfdfd3c375e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:52.842016 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07002697-ed39-4ca0-a890-dfdfd3c375e0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:52.853457 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 27/50] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:55:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:55:52.859291 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e39623-f187-4f5b-8ec5-8602189a0733 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:52.889814 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:52.957711 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e39623-f187-4f5b-8ec5-8602189a0733 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:52.990491 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442daa34-36b4-452f-a2c0-672a6be4090c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:52.991363 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442daa34-36b4-452f-a2c0-672a6be4090c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:52.991653 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442daa34-36b4-452f-a2c0-672a6be4090c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:52.991936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442daa34-36b4-452f-a2c0-672a6be4090c None admin] PATH_INFO: `/v3/users/97dbc9dd817544e5a3eb7457f8275b7b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:52.993118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442daa34-36b4-452f-a2c0-672a6be4090c None admin] RBAC: Authorizing `identity:get_user(user_id=97dbc9dd817544e5a3eb7457f8275b7b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:52.994621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442daa34-36b4-452f-a2c0-672a6be4090c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:52.996273 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 24/51] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:55:52 2022] GET /identity/v3/users/97dbc9dd817544e5a3eb7457f8275b7b => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:55:53.001596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07002697-ed39-4ca0-a890-dfdfd3c375e0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:53.044950 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:53.098697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07002697-ed39-4ca0-a890-dfdfd3c375e0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:53.145939 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e481ea8-033e-4cf8-ad0a-95c3c7d84097 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:53.146273 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e481ea8-033e-4cf8-ad0a-95c3c7d84097 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:53.146515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e481ea8-033e-4cf8-ad0a-95c3c7d84097 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:53.147931 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 25/52] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:55:53.154413 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7c234-ce94-43a0-a9f6-f28b2ef5b442 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:53.154709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7c234-ce94-43a0-a9f6-f28b2ef5b442 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:53.154997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7c234-ce94-43a0-a9f6-f28b2ef5b442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:53.172803 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2fd7c234-ce94-43a0-a9f6-f28b2ef5b442 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:55:53.174486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2fd7c234-ce94-43a0-a9f6-f28b2ef5b442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:55:53.236420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5aa8b1-a936-4f5f-b092-323c142bc3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:53.237192 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5aa8b1-a936-4f5f-b092-323c142bc3ca None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:53.237499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5aa8b1-a936-4f5f-b092-323c142bc3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:53.237770 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5aa8b1-a936-4f5f-b092-323c142bc3ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:53.238922 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5aa8b1-a936-4f5f-b092-323c142bc3ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:53.240354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5aa8b1-a936-4f5f-b092-323c142bc3ca None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:53.241974 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 28/53] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:55:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:55:53.245450 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 26/54] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:55:53.247527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5aa8b1-a936-4f5f-b092-323c142bc3ca None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:53.266257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7c234-ce94-43a0-a9f6-f28b2ef5b442 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:53.294939 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:53.349228 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5aa8b1-a936-4f5f-b092-323c142bc3ca None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:53.359831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:53.363201 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7c234-ce94-43a0-a9f6-f28b2ef5b442 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:53.384646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fb387-e1e5-4d1c-b1ad-82da2fec5709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:53.386113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fb387-e1e5-4d1c-b1ad-82da2fec5709 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:53.386406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fb387-e1e5-4d1c-b1ad-82da2fec5709 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:53.386683 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fb387-e1e5-4d1c-b1ad-82da2fec5709 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:53.387519 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fb387-e1e5-4d1c-b1ad-82da2fec5709 None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.domain.id=default, user.id=97dbc9dd817544e5a3eb7457f8275b7b) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:55:53.387838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fb387-e1e5-4d1c-b1ad-82da2fec5709 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:53.389278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fb387-e1e5-4d1c-b1ad-82da2fec5709 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:53.398142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 29/55] 10.222.0.18 () {56 vars in 1322 bytes} [Mon Jun 27 10:55:53 2022] GET /identity/v3/role_assignments?user.id=97dbc9dd817544e5a3eb7457f8275b7b&scope.domain.id=default&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:55:53.398398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a068f-4f1a-4456-97f5-60c90da97a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:53.399188 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a068f-4f1a-4456-97f5-60c90da97a0e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:53.399476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a068f-4f1a-4456-97f5-60c90da97a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:53.399764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a068f-4f1a-4456-97f5-60c90da97a0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:53.400979 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a068f-4f1a-4456-97f5-60c90da97a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:53.402516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a068f-4f1a-4456-97f5-60c90da97a0e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:53.404196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 27/56] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:55:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:55:53.409945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fb387-e1e5-4d1c-b1ad-82da2fec5709 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:53.514968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fb387-e1e5-4d1c-b1ad-82da2fec5709 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:53.550464 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74caa3bb-5cfb-4de5-afd8-2f87a731e86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:53.551135 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caa3bb-5cfb-4de5-afd8-2f87a731e86c None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:53.551420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caa3bb-5cfb-4de5-afd8-2f87a731e86c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:53.551699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caa3bb-5cfb-4de5-afd8-2f87a731e86c None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:53.552415 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74caa3bb-5cfb-4de5-afd8-2f87a731e86c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:53.553920 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74caa3bb-5cfb-4de5-afd8-2f87a731e86c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:53.579456 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 30/57] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Jun 27 10:55:53 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:55:55.577505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f2198-a56a-4b2e-aac1-de3ac0d008bb None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:55.578011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f2198-a56a-4b2e-aac1-de3ac0d008bb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:55.578100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f2198-a56a-4b2e-aac1-de3ac0d008bb None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:55.579451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 28/58] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:55:55.584524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e6777-f1fd-496d-a9fa-95c3b7ff7f02 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:55.584919 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e6777-f1fd-496d-a9fa-95c3b7ff7f02 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:55.585088 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e6777-f1fd-496d-a9fa-95c3b7ff7f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:55.601828 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2e1e6777-f1fd-496d-a9fa-95c3b7ff7f02 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:55:55.603003 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2e1e6777-f1fd-496d-a9fa-95c3b7ff7f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:55:55.622523 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:55.667914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 31/59] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:55:55.691675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f2198-a56a-4b2e-aac1-de3ac0d008bb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:55.784708 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:55.789644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f2198-a56a-4b2e-aac1-de3ac0d008bb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:55.822458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccde1c-664e-4704-a131-284c87819e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:55.823228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccde1c-664e-4704-a131-284c87819e4e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:55.823510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccde1c-664e-4704-a131-284c87819e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:55.823785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccde1c-664e-4704-a131-284c87819e4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:55.824940 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccde1c-664e-4704-a131-284c87819e4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:55.826412 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccde1c-664e-4704-a131-284c87819e4e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:55.828047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 29/60] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:55:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:55:55.833207 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e6777-f1fd-496d-a9fa-95c3b7ff7f02 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:55.927248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e6777-f1fd-496d-a9fa-95c3b7ff7f02 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:55.959918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2817523-6299-471e-8988-c147471b4e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:55.960563 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2817523-6299-471e-8988-c147471b4e46 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:55.960845 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2817523-6299-471e-8988-c147471b4e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:55.961122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2817523-6299-471e-8988-c147471b4e46 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:55.961853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2817523-6299-471e-8988-c147471b4e46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:55.963905 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2817523-6299-471e-8988-c147471b4e46 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:55.987460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 32/61] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:55:55 2022] POST /identity/v3/users => generated 275 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:55:58.899228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975380e-c6e5-4ce6-90d8-9d6413588446 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:58.900757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975380e-c6e5-4ce6-90d8-9d6413588446 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:58.901274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975380e-c6e5-4ce6-90d8-9d6413588446 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:58.903150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 30/62] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:55:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:55:58.908708 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4bec4-a05d-41c2-b5c9-da61106516ae None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:58.909572 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4bec4-a05d-41c2-b5c9-da61106516ae None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:58.910065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4bec4-a05d-41c2-b5c9-da61106516ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:58.934208 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5ca4bec4-a05d-41c2-b5c9-da61106516ae None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:55:58.935849 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5ca4bec4-a05d-41c2-b5c9-da61106516ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:55:58.948041 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:59.023566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 33/63] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:55:59.071266 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975380e-c6e5-4ce6-90d8-9d6413588446 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:59.198955 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ca978-eb2f-4c3b-8c9a-44cdca08a040 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:59.199446 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ca978-eb2f-4c3b-8c9a-44cdca08a040 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:59.199881 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ca978-eb2f-4c3b-8c9a-44cdca08a040 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:59.201494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 34/64] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:55:59.218776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1561c-9a17-41e7-9bc7-3172dc680491 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:59.219333 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1561c-9a17-41e7-9bc7-3172dc680491 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:59.219803 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1561c-9a17-41e7-9bc7-3172dc680491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:59.224408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975380e-c6e5-4ce6-90d8-9d6413588446 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:59.261587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4ca1561c-9a17-41e7-9bc7-3172dc680491 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:55:59.263088 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4ca1561c-9a17-41e7-9bc7-3172dc680491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:55:59.274257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9a96a-cbbb-43eb-b3be-b9da21e3022a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:59.275068 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9a96a-cbbb-43eb-b3be-b9da21e3022a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:59.275391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9a96a-cbbb-43eb-b3be-b9da21e3022a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:59.275669 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9a96a-cbbb-43eb-b3be-b9da21e3022a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:59.296630 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9a96a-cbbb-43eb-b3be-b9da21e3022a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:55:59.305055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-3ec9a96a-cbbb-43eb-b3be-b9da21e3022a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:55:59.305055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:55:59.305055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:55:59.305055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:55:59.305055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:55:59.305055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:55:59.305055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:55:59.305055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:55:59.305055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:55:59.305055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:55:59.305055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:55:59.305055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:55:59.305055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:55:59.305055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:55:59.305055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:55:59.305055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:55:59.305921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:55:59.305921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:55:59.305921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:55:59.305921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:55:59.305921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:55:59.305921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:55:59.305921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:55:59.305921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:55:59.305921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:55:59.305921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:55:59.305921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:55:59.305921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:55:59.305921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:55:59.305921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:55:59.305921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:55:59.305921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:55:59.307315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:55:59.307315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:55:59.307315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:55:59.307315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:55:59.307315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:55:59.307315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:55:59.307315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:55:59.307315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:55:59.307315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:55:59.307315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:55:59.307315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:55:59.307315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:55:59.309833 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 31/65] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:55:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:55:59.311419 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8e4d7-67b8-4502-8ab6-8db612b5ca00 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:59.311919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8e4d7-67b8-4502-8ab6-8db612b5ca00 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:59.312444 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8e4d7-67b8-4502-8ab6-8db612b5ca00 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:59.313968 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 32/66] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:55:59.318281 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8e4d7-67b8-4502-8ab6-8db612b5ca00 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:59.339750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 35/67] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:55:59.341029 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a0adb-f8cd-42d8-b7be-ac08ac3c6091 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:59.341319 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a0adb-f8cd-42d8-b7be-ac08ac3c6091 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:59.341622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a0adb-f8cd-42d8-b7be-ac08ac3c6091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:59.358538 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d71a0adb-f8cd-42d8-b7be-ac08ac3c6091 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:55:59.359898 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d71a0adb-f8cd-42d8-b7be-ac08ac3c6091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:55:59.369836 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:59.439483 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 36/68] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:55:59.440544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a0adb-f8cd-42d8-b7be-ac08ac3c6091 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:59.445824 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:59.466510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8e4d7-67b8-4502-8ab6-8db612b5ca00 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:59.514746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ed96e-bbcf-4a40-8b6b-64c48680734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:59.515784 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ed96e-bbcf-4a40-8b6b-64c48680734b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:59.516301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ed96e-bbcf-4a40-8b6b-64c48680734b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:59.516838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ed96e-bbcf-4a40-8b6b-64c48680734b None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:59.517817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ed96e-bbcf-4a40-8b6b-64c48680734b None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:55:59.518313 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ed96e-bbcf-4a40-8b6b-64c48680734b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:59.520015 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ed96e-bbcf-4a40-8b6b-64c48680734b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:59.530592 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 33/69] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:55:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:55:59.531868 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ed96e-bbcf-4a40-8b6b-64c48680734b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:59.542602 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a0adb-f8cd-42d8-b7be-ac08ac3c6091 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:59.577188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ae42d-ab70-43f6-a195-687b50ff8cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:59.578241 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae42d-ab70-43f6-a195-687b50ff8cad None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:59.578661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae42d-ab70-43f6-a195-687b50ff8cad None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:59.579131 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae42d-ab70-43f6-a195-687b50ff8cad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:59.591417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ae42d-ab70-43f6-a195-687b50ff8cad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:55:59.600606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a83ae42d-ab70-43f6-a195-687b50ff8cad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:55:59.600606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:55:59.600606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:55:59.600606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:55:59.600606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:55:59.600606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:55:59.600606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:55:59.600606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:55:59.600606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:55:59.600606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:55:59.600606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:55:59.600606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:55:59.600606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:55:59.600606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:55:59.600606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:55:59.600606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:55:59.601496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:55:59.601496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:55:59.601496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:55:59.601496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:55:59.601496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:55:59.601496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:55:59.601496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:55:59.601496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:55:59.601496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:55:59.601496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:55:59.601496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:55:59.601496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:55:59.601496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:55:59.601496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:55:59.601496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:55:59.601496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:55:59.602239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:55:59.602239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:55:59.602239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:55:59.602239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:55:59.602239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:55:59.602239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:55:59.602239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:55:59.602239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:55:59.602239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:55:59.602239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:55:59.602239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:55:59.602239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:55:59.605185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 37/70] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:55:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:55:59.606503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ae42d-ab70-43f6-a195-687b50ff8cad None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:59.635967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:59.651448 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ed96e-bbcf-4a40-8b6b-64c48680734b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:59.671097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:59.692673 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63967b1-a672-486b-98d9-3d8f4933f044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:59.693511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63967b1-a672-486b-98d9-3d8f4933f044 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:59.693793 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63967b1-a672-486b-98d9-3d8f4933f044 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:59.694074 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63967b1-a672-486b-98d9-3d8f4933f044 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:59.705410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63967b1-a672-486b-98d9-3d8f4933f044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:55:59.712477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ae42d-ab70-43f6-a195-687b50ff8cad None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:59.714328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-f63967b1-a672-486b-98d9-3d8f4933f044 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:55:59.714328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:55:59.714328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:55:59.714328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:55:59.714328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:55:59.714328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:55:59.714328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:55:59.714328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:55:59.714328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:55:59.714328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:55:59.714328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:55:59.714328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:55:59.714328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:55:59.714328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:55:59.714328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:55:59.714328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:55:59.715178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:55:59.715178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:55:59.715178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:55:59.715178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:55:59.715178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:55:59.715178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:55:59.715178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:55:59.715178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:55:59.715178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:55:59.715178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:55:59.715178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:55:59.715178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:55:59.715178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:55:59.715178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:55:59.715178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:55:59.715178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:55:59.715934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:55:59.715934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:55:59.715934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:55:59.715934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:55:59.715934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:55:59.715934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:55:59.715934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:55:59.715934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:55:59.715934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:55:59.715934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:55:59.715934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:55:59.715934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:55:59.715934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 34/71] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:55:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:55:59.716593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63967b1-a672-486b-98d9-3d8f4933f044 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:59.752781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d9873-6684-474d-b02d-f86eba246b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:59.753687 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d9873-6684-474d-b02d-f86eba246b25 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:59.753970 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d9873-6684-474d-b02d-f86eba246b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:59.754246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d9873-6684-474d-b02d-f86eba246b25 None admin] PATH_INFO: `/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:59.769990 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d9873-6684-474d-b02d-f86eba246b25 None admin] RBAC: Authorizing `identity:get_user(user_id=8082f54163cd4ae882a5ec7f9c30f8cf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:59.771445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d9873-6684-474d-b02d-f86eba246b25 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:59.773114 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 38/72] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:55:59 2022] GET /identity/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:55:59.774483 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fc5a0-4113-44b3-9f16-98fd8074eeaa None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:59.774770 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fc5a0-4113-44b3-9f16-98fd8074eeaa None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:59.775043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fc5a0-4113-44b3-9f16-98fd8074eeaa None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:59.780736 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 39/73] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:55:59.780736 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fc5a0-4113-44b3-9f16-98fd8074eeaa None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:59.828742 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63967b1-a672-486b-98d9-3d8f4933f044 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:59.868874 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af10df-5c8c-4eb7-b6dd-4084526833eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:59.870196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af10df-5c8c-4eb7-b6dd-4084526833eb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:59.870626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af10df-5c8c-4eb7-b6dd-4084526833eb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:59.871067 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af10df-5c8c-4eb7-b6dd-4084526833eb None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:59.871969 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af10df-5c8c-4eb7-b6dd-4084526833eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:55:59.872274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af10df-5c8c-4eb7-b6dd-4084526833eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:59.873689 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af10df-5c8c-4eb7-b6dd-4084526833eb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:59.887433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 35/74] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:55:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:55:59.888284 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af10df-5c8c-4eb7-b6dd-4084526833eb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:55:59.890224 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fc5a0-4113-44b3-9f16-98fd8074eeaa None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:55:59.901863 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:59.913141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:55:59.930476 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132d2c2-97ab-463f-84e3-b675d3187128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:55:59.931156 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132d2c2-97ab-463f-84e3-b675d3187128 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:59.931449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132d2c2-97ab-463f-84e3-b675d3187128 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:59.931764 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132d2c2-97ab-463f-84e3-b675d3187128 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:59.932522 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132d2c2-97ab-463f-84e3-b675d3187128 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:55:59.932832 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132d2c2-97ab-463f-84e3-b675d3187128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:55:59.934269 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132d2c2-97ab-463f-84e3-b675d3187128 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:55:59.947769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 40/75] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:55:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:55:59.947769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c59cd-3ead-4488-8ac5-c82e19a3f7e5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:55:59.947769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c59cd-3ead-4488-8ac5-c82e19a3f7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:55:59.947769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c59cd-3ead-4488-8ac5-c82e19a3f7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:55:59.964729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1f5c59cd-3ead-4488-8ac5-c82e19a3f7e5 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:55:59.965978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1f5c59cd-3ead-4488-8ac5-c82e19a3f7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:00.000454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af10df-5c8c-4eb7-b6dd-4084526833eb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:00.036274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799b098-7e13-4005-b4ec-5acef710e090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:00.036925 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b098-7e13-4005-b4ec-5acef710e090 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:00.037214 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b098-7e13-4005-b4ec-5acef710e090 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:00.037526 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b098-7e13-4005-b4ec-5acef710e090 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:00.041463 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 41/76] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:00.042106 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c59cd-3ead-4488-8ac5-c82e19a3f7e5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:00.107020 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799b098-7e13-4005-b4ec-5acef710e090 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:00.108509 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799b098-7e13-4005-b4ec-5acef710e090 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:00.120168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:00.143994 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c59cd-3ead-4488-8ac5-c82e19a3f7e5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:00.156601 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:00.177129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2446a2a-fa70-435b-8f6c-18cb1898aa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:00.178026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2446a2a-fa70-435b-8f6c-18cb1898aa27 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:00.178311 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2446a2a-fa70-435b-8f6c-18cb1898aa27 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:00.178589 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2446a2a-fa70-435b-8f6c-18cb1898aa27 None admin] PATH_INFO: `/v3/users/97dbc9dd817544e5a3eb7457f8275b7b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:00.182367 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2446a2a-fa70-435b-8f6c-18cb1898aa27 None admin] RBAC: Authorizing `identity:get_user(user_id=97dbc9dd817544e5a3eb7457f8275b7b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:00.182367 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2446a2a-fa70-435b-8f6c-18cb1898aa27 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:00.183428 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 42/77] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:00 2022] GET /identity/v3/users/97dbc9dd817544e5a3eb7457f8275b7b => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:00.184188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2446a2a-fa70-435b-8f6c-18cb1898aa27 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:00.210991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 36/78] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:55:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:00.212221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875fc6f-a912-4d8e-b06b-1d32d4940c24 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:00.212585 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875fc6f-a912-4d8e-b06b-1d32d4940c24 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:00.212909 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875fc6f-a912-4d8e-b06b-1d32d4940c24 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:00.214456 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 37/79] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:00.218187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875fc6f-a912-4d8e-b06b-1d32d4940c24 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:00.284623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2446a2a-fa70-435b-8f6c-18cb1898aa27 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:00.317692 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875fc6f-a912-4d8e-b06b-1d32d4940c24 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:00.317864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23af160-40b6-4f4c-a6df-f818d7c9686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:00.318694 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23af160-40b6-4f4c-a6df-f818d7c9686b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:00.318985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23af160-40b6-4f4c-a6df-f818d7c9686b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:00.319266 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23af160-40b6-4f4c-a6df-f818d7c9686b None admin] PATH_INFO: `/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:00.320464 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23af160-40b6-4f4c-a6df-f818d7c9686b None admin] RBAC: Authorizing `identity:get_user(user_id=8082f54163cd4ae882a5ec7f9c30f8cf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:00.321951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23af160-40b6-4f4c-a6df-f818d7c9686b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:00.324116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 43/80] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:00 2022] GET /identity/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:00.324880 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23af160-40b6-4f4c-a6df-f818d7c9686b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:00.328908 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:00.353332 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d113d-9700-43fb-95e5-c69d1bef02b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:00.354147 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d113d-9700-43fb-95e5-c69d1bef02b6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:00.354431 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d113d-9700-43fb-95e5-c69d1bef02b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:00.354713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d113d-9700-43fb-95e5-c69d1bef02b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:00.365037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d113d-9700-43fb-95e5-c69d1bef02b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:00.372441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:00.373307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d74d113d-9700-43fb-95e5-c69d1bef02b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:00.373307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:00.373307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:00.373307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:00.373307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:00.373307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:00.373307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:00.373307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:00.373307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:00.373307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:00.373307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:00.373307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:00.373307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:00.373307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:00.373307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:00.373307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:00.374177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:00.374177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:00.374177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:00.374177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:00.374177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:00.374177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:00.374177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:00.374177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:00.374177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:00.374177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:00.374177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:00.374177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:00.374177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:00.374177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:00.374177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:00.374177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:00.374950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:00.374950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:00.374950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:00.374950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:00.374950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:00.374950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:00.374950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:00.374950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:00.374950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:00.374950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:00.374950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:00.374950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:00.374950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 38/81] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:00.375746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d113d-9700-43fb-95e5-c69d1bef02b6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:00.424668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23af160-40b6-4f4c-a6df-f818d7c9686b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:00.459656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6adf3-7834-4e1f-866a-611845e2b458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:00.460296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6adf3-7834-4e1f-866a-611845e2b458 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:00.460592 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6adf3-7834-4e1f-866a-611845e2b458 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:00.460869 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6adf3-7834-4e1f-866a-611845e2b458 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:00.475861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d113d-9700-43fb-95e5-c69d1bef02b6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:00.509413 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5273db6-d950-430f-99d4-4234d9bf8b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:00.510267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273db6-d950-430f-99d4-4234d9bf8b4b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:00.510804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273db6-d950-430f-99d4-4234d9bf8b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:00.511081 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273db6-d950-430f-99d4-4234d9bf8b4b None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:00.512280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5273db6-d950-430f-99d4-4234d9bf8b4b None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:00.513778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5273db6-d950-430f-99d4-4234d9bf8b4b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:00.515474 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 39/82] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:00 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:00.520403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40732c5-aa17-4a36-b5d8-d805e41ce708 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:00.520403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40732c5-aa17-4a36-b5d8-d805e41ce708 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:00.520403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40732c5-aa17-4a36-b5d8-d805e41ce708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:00.527999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6adf3-7834-4e1f-866a-611845e2b458 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:00.529509 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6adf3-7834-4e1f-866a-611845e2b458 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:00.534351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d40732c5-aa17-4a36-b5d8-d805e41ce708 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:00.535550 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d40732c5-aa17-4a36-b5d8-d805e41ce708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:00.564999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:00.575826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:00.602521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 40/83] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:00.603843 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40732c5-aa17-4a36-b5d8-d805e41ce708 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:00.633186 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 44/84] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:00.633186 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6adf3-7834-4e1f-866a-611845e2b458 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:00.703702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40732c5-aa17-4a36-b5d8-d805e41ce708 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:00.725213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6adf3-7834-4e1f-866a-611845e2b458 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:00.737020 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff5266-4357-46e0-9ec0-8a00ae12b32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:00.737714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff5266-4357-46e0-9ec0-8a00ae12b32d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:00.738004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff5266-4357-46e0-9ec0-8a00ae12b32d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:00.738287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff5266-4357-46e0-9ec0-8a00ae12b32d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:00.758338 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1dda2-491f-48c3-bbea-41591af0729b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:00.758994 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1dda2-491f-48c3-bbea-41591af0729b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:00.759279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1dda2-491f-48c3-bbea-41591af0729b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:00.759556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1dda2-491f-48c3-bbea-41591af0729b None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:00.760345 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1dda2-491f-48c3-bbea-41591af0729b None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:00.760911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1dda2-491f-48c3-bbea-41591af0729b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:00.762323 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1dda2-491f-48c3-bbea-41591af0729b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:00.770128 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 45/85] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:00.770998 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1dda2-491f-48c3-bbea-41591af0729b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:00.777067 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:00.782964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:00.806350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff5266-4357-46e0-9ec0-8a00ae12b32d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:00.808336 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff5266-4357-46e0-9ec0-8a00ae12b32d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:00.868076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1dda2-491f-48c3-bbea-41591af0729b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:00.900085 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab002c-370d-414f-9248-dce6c93df887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:00.901242 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab002c-370d-414f-9248-dce6c93df887 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:00.901550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab002c-370d-414f-9248-dce6c93df887 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:00.901838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab002c-370d-414f-9248-dce6c93df887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:00.902669 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab002c-370d-414f-9248-dce6c93df887 None admin] RBAC: Adding query filter params (role.id=2c7768e02a39438fbe2c3551ff3b19a4, scope.project.id=c63add240dc64d06949b96266e734033, user.id=8082f54163cd4ae882a5ec7f9c30f8cf) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:00.902986 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab002c-370d-414f-9248-dce6c93df887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:00.904450 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab002c-370d-414f-9248-dce6c93df887 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:00.906281 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 41/86] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:00.907109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff5266-4357-46e0-9ec0-8a00ae12b32d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:00.909961 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 46/87] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:00 2022] GET /identity/v3/role_assignments?user.id=8082f54163cd4ae882a5ec7f9c30f8cf&scope.project.id=c63add240dc64d06949b96266e734033&role.id=2c7768e02a39438fbe2c3551ff3b19a4 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:00.911169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab002c-370d-414f-9248-dce6c93df887 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:00.996311 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:00.997498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:01.028653 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab002c-370d-414f-9248-dce6c93df887 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:01.035475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff5266-4357-46e0-9ec0-8a00ae12b32d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:01.068355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56622e-6f35-46df-8b3c-0a387025c9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:01.069176 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56622e-6f35-46df-8b3c-0a387025c9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:01.069462 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56622e-6f35-46df-8b3c-0a387025c9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:01.069745 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56622e-6f35-46df-8b3c-0a387025c9a5 None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:01.070952 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56622e-6f35-46df-8b3c-0a387025c9a5 None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:01.072435 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56622e-6f35-46df-8b3c-0a387025c9a5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:01.074143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b0203-dca1-4aa8-8d44-ec9ff2501e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:01.074283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 47/88] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:00 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:01.075045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56622e-6f35-46df-8b3c-0a387025c9a5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:01.075496 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b0203-dca1-4aa8-8d44-ec9ff2501e06 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:01.075844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b0203-dca1-4aa8-8d44-ec9ff2501e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:01.076191 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b0203-dca1-4aa8-8d44-ec9ff2501e06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:01.078239 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b0203-dca1-4aa8-8d44-ec9ff2501e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:01.079753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b0203-dca1-4aa8-8d44-ec9ff2501e06 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:01.082627 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 42/89] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:01.086886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b0203-dca1-4aa8-8d44-ec9ff2501e06 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:01.189487 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56622e-6f35-46df-8b3c-0a387025c9a5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:01.195433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b0203-dca1-4aa8-8d44-ec9ff2501e06 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:01.229488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e586e5-e6cd-4e21-b660-83ec3f236a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:01.230524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e586e5-e6cd-4e21-b660-83ec3f236a20 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:01.231119 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e586e5-e6cd-4e21-b660-83ec3f236a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:01.231529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e586e5-e6cd-4e21-b660-83ec3f236a20 None admin] PATH_INFO: `/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:01.232831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e586e5-e6cd-4e21-b660-83ec3f236a20 None admin] RBAC: Authorizing `identity:get_user(user_id=8082f54163cd4ae882a5ec7f9c30f8cf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:01.234298 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e586e5-e6cd-4e21-b660-83ec3f236a20 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:01.235418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6aa41-8545-424c-800a-702ae956a5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:01.236118 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 48/90] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:01 2022] GET /identity/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:01.236692 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e586e5-e6cd-4e21-b660-83ec3f236a20 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:01.240700 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6aa41-8545-424c-800a-702ae956a5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:01.241060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6aa41-8545-424c-800a-702ae956a5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:01.241446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6aa41-8545-424c-800a-702ae956a5b7 None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:01.242924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6aa41-8545-424c-800a-702ae956a5b7 None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:01.245311 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6aa41-8545-424c-800a-702ae956a5b7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:01.251898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 43/91] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:01 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:01.251898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6aa41-8545-424c-800a-702ae956a5b7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:01.252526 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:01.253590 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:01.345847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e586e5-e6cd-4e21-b660-83ec3f236a20 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:01.362844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6aa41-8545-424c-800a-702ae956a5b7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:01.383176 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f22b02-9ceb-4b0e-906f-6f0667757796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:01.383840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f22b02-9ceb-4b0e-906f-6f0667757796 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:01.384128 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f22b02-9ceb-4b0e-906f-6f0667757796 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:01.384409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f22b02-9ceb-4b0e-906f-6f0667757796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:01.386077 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f22b02-9ceb-4b0e-906f-6f0667757796 None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=c63add240dc64d06949b96266e734033, user.id=97dbc9dd817544e5a3eb7457f8275b7b) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:01.386385 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f22b02-9ceb-4b0e-906f-6f0667757796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:01.387834 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f22b02-9ceb-4b0e-906f-6f0667757796 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:01.393724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 49/92] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:01 2022] GET /identity/v3/role_assignments?user.id=97dbc9dd817544e5a3eb7457f8275b7b&scope.project.id=c63add240dc64d06949b96266e734033&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:01.394408 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f22b02-9ceb-4b0e-906f-6f0667757796 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:01.419946 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462bc1e-a58a-47a2-a168-6e5accf612d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:01.420734 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462bc1e-a58a-47a2-a168-6e5accf612d3 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:01.421119 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462bc1e-a58a-47a2-a168-6e5accf612d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:01.421422 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462bc1e-a58a-47a2-a168-6e5accf612d3 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:01.422276 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462bc1e-a58a-47a2-a168-6e5accf612d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:01.423841 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462bc1e-a58a-47a2-a168-6e5accf612d3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:01.457422 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 44/93] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:56:01 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:56:01.457422 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462bc1e-a58a-47a2-a168-6e5accf612d3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:01.534409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:01.576996 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f22b02-9ceb-4b0e-906f-6f0667757796 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:01.606806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:01.634007 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1c568-8b08-43bf-bc5b-de12700c0d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:01.635193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1c568-8b08-43bf-bc5b-de12700c0d9d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:01.635895 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1c568-8b08-43bf-bc5b-de12700c0d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:01.636181 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1c568-8b08-43bf-bc5b-de12700c0d9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:01.656514 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462bc1e-a58a-47a2-a168-6e5accf612d3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:01.705778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e28644-8fa7-4bbb-b42c-c5eae44d233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:01.706458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e28644-8fa7-4bbb-b42c-c5eae44d233c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:01.706744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e28644-8fa7-4bbb-b42c-c5eae44d233c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:01.707025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e28644-8fa7-4bbb-b42c-c5eae44d233c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:01.708164 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e28644-8fa7-4bbb-b42c-c5eae44d233c None admin] RBAC: Adding query filter params (role.id=d6dae1fcff6641fcb71c0203d9c4e161, scope.project.id=c63add240dc64d06949b96266e734033, user.id=8082f54163cd4ae882a5ec7f9c30f8cf) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:01.708482 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e28644-8fa7-4bbb-b42c-c5eae44d233c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:01.710489 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e28644-8fa7-4bbb-b42c-c5eae44d233c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:01.719357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 45/94] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:01 2022] GET /identity/v3/role_assignments?user.id=8082f54163cd4ae882a5ec7f9c30f8cf&scope.project.id=c63add240dc64d06949b96266e734033&role.id=d6dae1fcff6641fcb71c0203d9c4e161 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:01.733216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1c568-8b08-43bf-bc5b-de12700c0d9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:01.735083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1c568-8b08-43bf-bc5b-de12700c0d9d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:01.816695 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:01.847619 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 50/95] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:01.854373 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e28644-8fa7-4bbb-b42c-c5eae44d233c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:01.970196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e28644-8fa7-4bbb-b42c-c5eae44d233c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:01.999858 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:02.014790 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52e4f9-b63f-471d-825a-399768078cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:02.015664 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52e4f9-b63f-471d-825a-399768078cdb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:02.015954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52e4f9-b63f-471d-825a-399768078cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:02.016237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52e4f9-b63f-471d-825a-399768078cdb None admin] PATH_INFO: `/v3/projects/15c2680adde3494b9855cab46b02eb89` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:02.017508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52e4f9-b63f-471d-825a-399768078cdb None admin] RBAC: Authorizing `identity:get_project(project_id=15c2680adde3494b9855cab46b02eb89)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:02.018972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52e4f9-b63f-471d-825a-399768078cdb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:02.021013 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 46/96] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:01 2022] GET /identity/v3/projects/15c2680adde3494b9855cab46b02eb89 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:02.027387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1c568-8b08-43bf-bc5b-de12700c0d9d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:02.148078 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1c568-8b08-43bf-bc5b-de12700c0d9d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:02.184963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e632e-137d-4852-b928-0ba2407268df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:02.185650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e632e-137d-4852-b928-0ba2407268df None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:02.185932 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e632e-137d-4852-b928-0ba2407268df None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:02.186207 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e632e-137d-4852-b928-0ba2407268df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:02.187100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e632e-137d-4852-b928-0ba2407268df None admin] RBAC: Adding query filter params (role.id=2c7768e02a39438fbe2c3551ff3b19a4, scope.project.id=15c2680adde3494b9855cab46b02eb89, user.id=8082f54163cd4ae882a5ec7f9c30f8cf) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:02.187409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e632e-137d-4852-b928-0ba2407268df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:02.188892 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e632e-137d-4852-b928-0ba2407268df None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:02.196965 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 51/97] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:02 2022] GET /identity/v3/role_assignments?user.id=8082f54163cd4ae882a5ec7f9c30f8cf&scope.project.id=15c2680adde3494b9855cab46b02eb89&role.id=2c7768e02a39438fbe2c3551ff3b19a4 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:03.021593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90233cd4-9251-404d-b1f7-56621628607f None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:03.022129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90233cd4-9251-404d-b1f7-56621628607f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:03.022129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90233cd4-9251-404d-b1f7-56621628607f None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:03.023564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 47/98] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:03.029099 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42b76-a84a-4d64-86f1-a545d0cea13e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:03.029963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42b76-a84a-4d64-86f1-a545d0cea13e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:03.030440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42b76-a84a-4d64-86f1-a545d0cea13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:03.054390 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-86b42b76-a84a-4d64-86f1-a545d0cea13e None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:03.055904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-86b42b76-a84a-4d64-86f1-a545d0cea13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:03.091128 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:03.139038 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 52/99] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:03.177446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90233cd4-9251-404d-b1f7-56621628607f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:03.304803 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90233cd4-9251-404d-b1f7-56621628607f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:03.348084 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf64b6-f5ef-4e59-b13c-7b4e3ddbeb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:03.350104 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf64b6-f5ef-4e59-b13c-7b4e3ddbeb0f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:03.350400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf64b6-f5ef-4e59-b13c-7b4e3ddbeb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:03.350676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf64b6-f5ef-4e59-b13c-7b4e3ddbeb0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:03.365655 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf64b6-f5ef-4e59-b13c-7b4e3ddbeb0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:03.373262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-aaaf64b6-f5ef-4e59-b13c-7b4e3ddbeb0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:03.373262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:03.373262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:03.373262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:03.373262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:03.373262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:03.373262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:03.373262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:03.373262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:03.373262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:03.373262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:03.373262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:03.373262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:03.373262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:03.373262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:03.373262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:03.374143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:03.374143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:03.374143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:03.374143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:03.374143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:03.374143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:03.374143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:03.374143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:03.374143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:03.374143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:03.374143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:03.374143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:03.374143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:03.374143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:03.374143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:03.374143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:03.374892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:03.374892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:03.374892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:03.374892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:03.374892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:03.374892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:03.374892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:03.374892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:03.374892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:03.374892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:03.374892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:03.374892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:03.374892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 48/100] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:03.381836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b42b76-a84a-4d64-86f1-a545d0cea13e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:03.510365 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b42b76-a84a-4d64-86f1-a545d0cea13e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:03.563048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20937bfc-2826-4689-8e45-e36dbee6a19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:03.563638 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20937bfc-2826-4689-8e45-e36dbee6a19d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:03.563918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20937bfc-2826-4689-8e45-e36dbee6a19d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:03.564190 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20937bfc-2826-4689-8e45-e36dbee6a19d None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:03.564930 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20937bfc-2826-4689-8e45-e36dbee6a19d None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:03.565229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20937bfc-2826-4689-8e45-e36dbee6a19d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:03.566625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20937bfc-2826-4689-8e45-e36dbee6a19d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:03.577405 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 53/101] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:03.583257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf64b6-f5ef-4e59-b13c-7b4e3ddbeb0f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:03.686578 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:03.753050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf64b6-f5ef-4e59-b13c-7b4e3ddbeb0f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:03.799037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadcda1-3d6a-4b95-8311-d4da20f7dca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:03.799924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadcda1-3d6a-4b95-8311-d4da20f7dca4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:03.800194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadcda1-3d6a-4b95-8311-d4da20f7dca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:03.800474 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadcda1-3d6a-4b95-8311-d4da20f7dca4 None admin] PATH_INFO: `/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:03.801785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadcda1-3d6a-4b95-8311-d4da20f7dca4 None admin] RBAC: Authorizing `identity:get_user(user_id=8082f54163cd4ae882a5ec7f9c30f8cf)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:03.803243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadcda1-3d6a-4b95-8311-d4da20f7dca4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:03.805604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 49/102] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:03 2022] GET /identity/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:03.811813 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20937bfc-2826-4689-8e45-e36dbee6a19d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:03.857516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:03.952301 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20937bfc-2826-4689-8e45-e36dbee6a19d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:04.012924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16750d-deaa-413c-830b-ab36ee6a31cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:04.013835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16750d-deaa-413c-830b-ab36ee6a31cb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:04.014124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16750d-deaa-413c-830b-ab36ee6a31cb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:04.014404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16750d-deaa-413c-830b-ab36ee6a31cb None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:04.015634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16750d-deaa-413c-830b-ab36ee6a31cb None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:04.017090 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16750d-deaa-413c-830b-ab36ee6a31cb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:04.019140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 54/103] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:03 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:04.024734 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadcda1-3d6a-4b95-8311-d4da20f7dca4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:04.164948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadcda1-3d6a-4b95-8311-d4da20f7dca4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:04.193865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:04.212015 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ccc0b-f3ef-4976-a4e7-1ec09d560a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:04.213011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ccc0b-f3ef-4976-a4e7-1ec09d560a29 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:04.213293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ccc0b-f3ef-4976-a4e7-1ec09d560a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:04.213597 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ccc0b-f3ef-4976-a4e7-1ec09d560a29 None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033/users/8082f54163cd4ae882a5ec7f9c30f8cf/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:04.215660 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ccc0b-f3ef-4976-a4e7-1ec09d560a29 None admin] RBAC: Authorizing `identity:create_grant(project_id=c63add240dc64d06949b96266e734033, user_id=8082f54163cd4ae882a5ec7f9c30f8cf, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:04.217110 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ccc0b-f3ef-4976-a4e7-1ec09d560a29 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:04.245809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 50/104] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:56:04 2022] PUT /identity/v3/projects/c63add240dc64d06949b96266e734033/users/8082f54163cd4ae882a5ec7f9c30f8cf/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:56:04.622264 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fc0e1-8dbb-4d7e-8720-2e470387bb26 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:04.622760 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fc0e1-8dbb-4d7e-8720-2e470387bb26 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:04.622830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fc0e1-8dbb-4d7e-8720-2e470387bb26 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:04.624212 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 55/105] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:04.629533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03192a8d-a801-4e80-b905-525c48a8f3bc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:04.629828 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03192a8d-a801-4e80-b905-525c48a8f3bc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:04.630107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03192a8d-a801-4e80-b905-525c48a8f3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:04.655344 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-03192a8d-a801-4e80-b905-525c48a8f3bc None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:04.656591 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-03192a8d-a801-4e80-b905-525c48a8f3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:04.678959 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c044553-ab67-40c9-b790-8715fd25cdaa None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:04.679268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c044553-ab67-40c9-b790-8715fd25cdaa None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:04.679518 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c044553-ab67-40c9-b790-8715fd25cdaa None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:04.681023 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 56/106] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:56:04.686414 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a036-6e0b-47a8-814c-2591f4576d13 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:04.686700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a036-6e0b-47a8-814c-2591f4576d13 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:04.686978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a036-6e0b-47a8-814c-2591f4576d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:04.712054 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2a03a036-6e0b-47a8-814c-2591f4576d13 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:04.713812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2a03a036-6e0b-47a8-814c-2591f4576d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:04.778915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 51/107] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:04.814065 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03192a8d-a801-4e80-b905-525c48a8f3bc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:04.819482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 57/108] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:04.854702 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a036-6e0b-47a8-814c-2591f4576d13 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:04.901851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:04.967472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03192a8d-a801-4e80-b905-525c48a8f3bc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:04.983788 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:05.028349 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c22e0-d695-4855-81a3-215c7a607ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:05.029157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c22e0-d695-4855-81a3-215c7a607ddf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:05.029465 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c22e0-d695-4855-81a3-215c7a607ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:05.029746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c22e0-d695-4855-81a3-215c7a607ddf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:05.038095 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a036-6e0b-47a8-814c-2591f4576d13 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:05.061978 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c22e0-d695-4855-81a3-215c7a607ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:05.074213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94773a45-0fd9-4128-b2ec-b6edaa074fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:05.075146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94773a45-0fd9-4128-b2ec-b6edaa074fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:05.075535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94773a45-0fd9-4128-b2ec-b6edaa074fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:05.075908 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94773a45-0fd9-4128-b2ec-b6edaa074fd8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:05.076357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-778c22e0-d695-4855-81a3-215c7a607ddf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:56:05.076357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:05.076357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:05.076357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:05.076357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:05.076357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:05.076357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:05.076357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:05.076357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:05.076357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:05.076357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:05.076357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:05.076357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:05.076357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:05.076357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:05.076357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:05.077247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:05.077247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:05.077247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:05.077247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:05.077247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:05.077247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:05.077247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:05.077247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:05.077247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:05.077247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:05.077247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:05.077247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:05.077247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:05.077247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:05.077247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:05.077247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:05.078072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:05.078072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:05.078072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:05.078072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:05.078072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:05.078072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:05.078072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:05.078072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:05.078072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:05.078072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:05.078072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:56:05.078072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:05.078072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 52/109] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:56:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:05.078938 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998f33c-61d7-4358-ba3e-31fa8a91a615 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:05.079992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998f33c-61d7-4358-ba3e-31fa8a91a615 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:05.079992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998f33c-61d7-4358-ba3e-31fa8a91a615 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:05.080951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 53/110] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:05.090304 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998f33c-61d7-4358-ba3e-31fa8a91a615 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:05.093020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94773a45-0fd9-4128-b2ec-b6edaa074fd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:05.101840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-94773a45-0fd9-4128-b2ec-b6edaa074fd8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:05.101840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:05.101840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:05.101840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:05.101840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:05.101840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:05.101840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:05.101840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:05.101840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:05.101840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:05.101840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:05.101840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:05.101840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:05.101840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:05.101840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:05.101840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:05.103856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:05.103856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:05.103856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:05.103856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:05.103856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:05.103856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:05.103856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:05.103856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:05.103856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:05.103856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:05.103856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:05.103856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:05.103856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:05.103856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:05.103856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:05.103856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:05.105811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:05.105811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:05.105811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:05.105811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:05.105811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:05.105811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:05.105811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:05.105811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:05.105811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:05.105811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:05.105811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:05.105811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:05.105811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 58/111] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:56:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:05.105811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cc7ad-5abc-4020-8b7a-77be017b77ce None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:05.107626 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cc7ad-5abc-4020-8b7a-77be017b77ce None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:05.107626 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cc7ad-5abc-4020-8b7a-77be017b77ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:05.124906 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-925cc7ad-5abc-4020-8b7a-77be017b77ce None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:05.126134 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-925cc7ad-5abc-4020-8b7a-77be017b77ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:05.252934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 59/112] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:05.254063 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cc7ad-5abc-4020-8b7a-77be017b77ce None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:05.289079 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:05.292110 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998f33c-61d7-4358-ba3e-31fa8a91a615 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:05.328874 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a208ff-47a4-49d2-b5e0-c84cd92aa10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:05.329820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a208ff-47a4-49d2-b5e0-c84cd92aa10a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:05.330265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a208ff-47a4-49d2-b5e0-c84cd92aa10a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:05.330721 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a208ff-47a4-49d2-b5e0-c84cd92aa10a None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:05.331633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a208ff-47a4-49d2-b5e0-c84cd92aa10a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:05.332093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a208ff-47a4-49d2-b5e0-c84cd92aa10a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:05.333667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a208ff-47a4-49d2-b5e0-c84cd92aa10a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:05.342705 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 54/113] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:05.344254 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43972e2e-6b42-4117-87b5-cb266a2ef1d9 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:05.344740 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43972e2e-6b42-4117-87b5-cb266a2ef1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:05.345226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43972e2e-6b42-4117-87b5-cb266a2ef1d9 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:05.346856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 55/114] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:05.347802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43972e2e-6b42-4117-87b5-cb266a2ef1d9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:05.376802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cc7ad-5abc-4020-8b7a-77be017b77ce None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:05.381451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:05.414281 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5521c1e-d469-44da-9063-0574bd307399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:05.415356 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5521c1e-d469-44da-9063-0574bd307399 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:05.415849 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5521c1e-d469-44da-9063-0574bd307399 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:05.416278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5521c1e-d469-44da-9063-0574bd307399 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:05.417315 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5521c1e-d469-44da-9063-0574bd307399 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:05.417823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5521c1e-d469-44da-9063-0574bd307399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:05.419513 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5521c1e-d469-44da-9063-0574bd307399 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:05.433525 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 60/115] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:56:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:05.434734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5521c1e-d469-44da-9063-0574bd307399 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:05.459914 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43972e2e-6b42-4117-87b5-cb266a2ef1d9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:05.496318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd4938-adad-436a-b015-c1ca6c131b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:05.497149 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd4938-adad-436a-b015-c1ca6c131b68 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:05.497541 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd4938-adad-436a-b015-c1ca6c131b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:05.497946 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd4938-adad-436a-b015-c1ca6c131b68 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:05.508674 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd4938-adad-436a-b015-c1ca6c131b68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:05.517393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-00fd4938-adad-436a-b015-c1ca6c131b68 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:05.517393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:05.517393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:05.517393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:05.517393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:05.517393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:05.517393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:05.517393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:05.517393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:05.517393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:05.517393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:05.517393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:05.517393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:05.517393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:05.517393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:05.517393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:05.518455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:05.518455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:05.518455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:05.518455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:05.518455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:05.518455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:05.518455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:05.518455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:05.518455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:05.518455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:05.518455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:05.518455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:05.518455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:05.518455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:05.518455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:05.518455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:05.519409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:05.519409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:05.519409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:05.519409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:05.519409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:05.519409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:05.519409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:05.519409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:05.519409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:05.519409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:05.519409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:05.519409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:05.520737 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 56/116] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:05.526822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a86496-18e2-401f-965a-cfd421339729 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:05.527243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a86496-18e2-401f-965a-cfd421339729 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:05.527550 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a86496-18e2-401f-965a-cfd421339729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:05.530455 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:05.544980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f7a86496-18e2-401f-965a-cfd421339729 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:05.546355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f7a86496-18e2-401f-965a-cfd421339729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:05.553056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5521c1e-d469-44da-9063-0574bd307399 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:05.588845 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627228c-fb01-4ba6-8dcb-dc257ba93344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:05.589758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627228c-fb01-4ba6-8dcb-dc257ba93344 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:05.590046 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627228c-fb01-4ba6-8dcb-dc257ba93344 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:05.590314 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627228c-fb01-4ba6-8dcb-dc257ba93344 None admin] PATH_INFO: `/v3/users/97dbc9dd817544e5a3eb7457f8275b7b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:05.592160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627228c-fb01-4ba6-8dcb-dc257ba93344 None admin] RBAC: Authorizing `identity:get_user(user_id=97dbc9dd817544e5a3eb7457f8275b7b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:05.593643 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627228c-fb01-4ba6-8dcb-dc257ba93344 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:05.597472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 61/117] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:05 2022] GET /identity/v3/users/97dbc9dd817544e5a3eb7457f8275b7b => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:05.597472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627228c-fb01-4ba6-8dcb-dc257ba93344 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:05.622639 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 57/118] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:05.623641 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a86496-18e2-401f-965a-cfd421339729 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:05.657707 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:05.711622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627228c-fb01-4ba6-8dcb-dc257ba93344 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:05.738759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a86496-18e2-401f-965a-cfd421339729 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:05.746836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff3e54-5406-4df2-b35d-d9317b0b0d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:05.747641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff3e54-5406-4df2-b35d-d9317b0b0d26 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:05.747927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff3e54-5406-4df2-b35d-d9317b0b0d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:05.748234 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff3e54-5406-4df2-b35d-d9317b0b0d26 None admin] PATH_INFO: `/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:05.749444 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff3e54-5406-4df2-b35d-d9317b0b0d26 None admin] RBAC: Authorizing `identity:get_user(user_id=8082f54163cd4ae882a5ec7f9c30f8cf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:05.750913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff3e54-5406-4df2-b35d-d9317b0b0d26 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:05.752553 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 62/119] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:05 2022] GET /identity/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:05.753740 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a1347-3c7a-4ca5-b64c-8809c8c1dac2 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:05.754028 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a1347-3c7a-4ca5-b64c-8809c8c1dac2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:05.754308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a1347-3c7a-4ca5-b64c-8809c8c1dac2 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:05.755707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 63/120] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:05.756213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a1347-3c7a-4ca5-b64c-8809c8c1dac2 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:05.775345 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:05.783777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bbd89-f12f-472c-a1f6-77b8a6b543f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:05.784533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bbd89-f12f-472c-a1f6-77b8a6b543f2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:05.785227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bbd89-f12f-472c-a1f6-77b8a6b543f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:05.785227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bbd89-f12f-472c-a1f6-77b8a6b543f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:05.785971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bbd89-f12f-472c-a1f6-77b8a6b543f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:05.786296 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bbd89-f12f-472c-a1f6-77b8a6b543f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:05.787787 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bbd89-f12f-472c-a1f6-77b8a6b543f2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:05.797064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 58/121] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:05.797934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bbd89-f12f-472c-a1f6-77b8a6b543f2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:05.872222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a1347-3c7a-4ca5-b64c-8809c8c1dac2 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:05.887197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:05.904227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bbd89-f12f-472c-a1f6-77b8a6b543f2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:05.906487 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5963818-67db-406e-87c4-ff7eb38c64bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:05.907416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5963818-67db-406e-87c4-ff7eb38c64bb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:05.907703 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5963818-67db-406e-87c4-ff7eb38c64bb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:05.907976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5963818-67db-406e-87c4-ff7eb38c64bb None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:05.909153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5963818-67db-406e-87c4-ff7eb38c64bb None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:05.910645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5963818-67db-406e-87c4-ff7eb38c64bb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:05.912564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 64/122] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:05 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:05.918123 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5963818-67db-406e-87c4-ff7eb38c64bb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:05.940944 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217ee06-5b85-4cc6-bb8a-352368d59f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:05.941843 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217ee06-5b85-4cc6-bb8a-352368d59f54 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:05.942132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217ee06-5b85-4cc6-bb8a-352368d59f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:05.942408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217ee06-5b85-4cc6-bb8a-352368d59f54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:05.943590 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217ee06-5b85-4cc6-bb8a-352368d59f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:05.945047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217ee06-5b85-4cc6-bb8a-352368d59f54 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:05.946864 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 59/123] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:05.947893 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562c7f-d4e0-447f-95fa-5ef2d103bfa3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:05.948184 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562c7f-d4e0-447f-95fa-5ef2d103bfa3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:05.948466 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562c7f-d4e0-447f-95fa-5ef2d103bfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:05.965556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-16562c7f-d4e0-447f-95fa-5ef2d103bfa3 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:05.966734 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-16562c7f-d4e0-447f-95fa-5ef2d103bfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:06.012847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:06.030181 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5963818-67db-406e-87c4-ff7eb38c64bb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:06.044645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 60/124] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:06.046229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16562c7f-d4e0-447f-95fa-5ef2d103bfa3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:06.077788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f168b-b4a1-4223-95f9-221175015a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:06.078653 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f168b-b4a1-4223-95f9-221175015a12 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:06.078938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f168b-b4a1-4223-95f9-221175015a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:06.079219 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f168b-b4a1-4223-95f9-221175015a12 None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:06.080386 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f168b-b4a1-4223-95f9-221175015a12 None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:06.081861 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f168b-b4a1-4223-95f9-221175015a12 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:06.084556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 65/125] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:05 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:06.084556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f168b-b4a1-4223-95f9-221175015a12 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:06.137740 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:06.161569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16562c7f-d4e0-447f-95fa-5ef2d103bfa3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:06.188045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f168b-b4a1-4223-95f9-221175015a12 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:06.207182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb24be5-dd4f-48a8-9a7d-e3e110301712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:06.208059 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb24be5-dd4f-48a8-9a7d-e3e110301712 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:06.208346 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb24be5-dd4f-48a8-9a7d-e3e110301712 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:06.208624 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb24be5-dd4f-48a8-9a7d-e3e110301712 None admin] PATH_INFO: `/v3/users/28d3165a82554787837fc0be46224ee6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:06.223530 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb24be5-dd4f-48a8-9a7d-e3e110301712 None admin] RBAC: Authorizing `identity:get_user(user_id=28d3165a82554787837fc0be46224ee6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:06.225002 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb24be5-dd4f-48a8-9a7d-e3e110301712 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:06.225897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba4f9f-f9a8-426e-a18a-b2a46b2272fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:06.231683 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 61/126] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:06 2022] GET /identity/v3/users/28d3165a82554787837fc0be46224ee6 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:06.231828 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba4f9f-f9a8-426e-a18a-b2a46b2272fe None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:06.231828 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba4f9f-f9a8-426e-a18a-b2a46b2272fe None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:06.231828 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba4f9f-f9a8-426e-a18a-b2a46b2272fe None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033/users/97dbc9dd817544e5a3eb7457f8275b7b/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:06.232057 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb24be5-dd4f-48a8-9a7d-e3e110301712 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:06.233590 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba4f9f-f9a8-426e-a18a-b2a46b2272fe None admin] RBAC: Authorizing `identity:create_grant(project_id=c63add240dc64d06949b96266e734033, user_id=97dbc9dd817544e5a3eb7457f8275b7b, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:06.235036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba4f9f-f9a8-426e-a18a-b2a46b2272fe None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:06.251141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 66/127] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:56:06 2022] PUT /identity/v3/projects/c63add240dc64d06949b96266e734033/users/97dbc9dd817544e5a3eb7457f8275b7b/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:56:06.251722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba4f9f-f9a8-426e-a18a-b2a46b2272fe None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:06.279784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:06.361048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb24be5-dd4f-48a8-9a7d-e3e110301712 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:06.396450 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba4f9f-f9a8-426e-a18a-b2a46b2272fe None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:06.398148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4d1de-ebcb-4d4c-9844-d42bcf71d79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:06.398912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4d1de-ebcb-4d4c-9844-d42bcf71d79b None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:06.399280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4d1de-ebcb-4d4c-9844-d42bcf71d79b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:06.399633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4d1de-ebcb-4d4c-9844-d42bcf71d79b None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:06.400957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4d1de-ebcb-4d4c-9844-d42bcf71d79b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:06.402479 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4d1de-ebcb-4d4c-9844-d42bcf71d79b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:06.415075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:06.442833 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 62/128] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jun 27 10:56:06 2022] POST /identity/v3/projects => generated 302 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:56:06.443697 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4d1de-ebcb-4d4c-9844-d42bcf71d79b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:06.454544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0edace-e5de-47b4-a32f-17901a83d3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:06.455848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0edace-e5de-47b4-a32f-17901a83d3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:06.456395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0edace-e5de-47b4-a32f-17901a83d3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:06.456941 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0edace-e5de-47b4-a32f-17901a83d3b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:06.473901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0edace-e5de-47b4-a32f-17901a83d3b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:06.485962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-be0edace-e5de-47b4-a32f-17901a83d3b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:06.485962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:06.485962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:06.485962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:06.485962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:06.485962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:06.485962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:06.485962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:06.485962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:06.485962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:06.485962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:06.485962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:06.485962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:06.485962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:06.485962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:06.485962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:06.486901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:06.486901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:06.486901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:06.486901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:06.486901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:06.486901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:06.486901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:06.486901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:06.486901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:06.486901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:06.486901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:06.486901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:06.486901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:06.486901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:06.486901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:06.486901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:06.487663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:06.487663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:06.487663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:06.487663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:06.487663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:06.487663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:06.487663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:06.487663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:06.487663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:06.487663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:06.487663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:06.487663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:06.491180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 67/129] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:06.492387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0edace-e5de-47b4-a32f-17901a83d3b2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:06.612093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4d1de-ebcb-4d4c-9844-d42bcf71d79b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:06.633834 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:06.671913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0edace-e5de-47b4-a32f-17901a83d3b2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:06.673105 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b92cf8-47a7-45f4-9d33-4953125d065c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:06.674402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b92cf8-47a7-45f4-9d33-4953125d065c None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:06.675736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b92cf8-47a7-45f4-9d33-4953125d065c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:06.676181 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b92cf8-47a7-45f4-9d33-4953125d065c None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033/users/8082f54163cd4ae882a5ec7f9c30f8cf/roles/d6dae1fcff6641fcb71c0203d9c4e161` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:06.679229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b92cf8-47a7-45f4-9d33-4953125d065c None admin] RBAC: Authorizing `identity:create_grant(project_id=c63add240dc64d06949b96266e734033, user_id=8082f54163cd4ae882a5ec7f9c30f8cf, role_id=d6dae1fcff6641fcb71c0203d9c4e161)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:06.681507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b92cf8-47a7-45f4-9d33-4953125d065c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:06.702996 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 63/130] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:56:06 2022] PUT /identity/v3/projects/c63add240dc64d06949b96266e734033/users/8082f54163cd4ae882a5ec7f9c30f8cf/roles/d6dae1fcff6641fcb71c0203d9c4e161 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:56:06.706992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b92cf8-47a7-45f4-9d33-4953125d065c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:06.726151 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf166ac-144d-4e9d-9f02-addde77fb65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:06.726817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf166ac-144d-4e9d-9f02-addde77fb65f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:06.727104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf166ac-144d-4e9d-9f02-addde77fb65f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:06.727385 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf166ac-144d-4e9d-9f02-addde77fb65f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:06.812720 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:06.853395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf166ac-144d-4e9d-9f02-addde77fb65f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:06.856412 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf166ac-144d-4e9d-9f02-addde77fb65f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:06.882432 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b92cf8-47a7-45f4-9d33-4953125d065c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:06.923690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494bb99-4437-44ee-9ae7-6eac037ab52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:06.924424 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494bb99-4437-44ee-9ae7-6eac037ab52f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:06.924713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494bb99-4437-44ee-9ae7-6eac037ab52f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:06.924990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494bb99-4437-44ee-9ae7-6eac037ab52f None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:06.925782 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494bb99-4437-44ee-9ae7-6eac037ab52f None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:06.926097 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494bb99-4437-44ee-9ae7-6eac037ab52f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:06.927555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494bb99-4437-44ee-9ae7-6eac037ab52f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:06.938606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 64/131] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:06.940119 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5e383-9087-4db1-b6b7-6ea0c9f52943 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:06.940414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5e383-9087-4db1-b6b7-6ea0c9f52943 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:06.940728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5e383-9087-4db1-b6b7-6ea0c9f52943 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:06.942365 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 65/132] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:06.948420 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951d456-ddc9-41c0-8f26-8831df03e801 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:06.948914 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951d456-ddc9-41c0-8f26-8831df03e801 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:06.949218 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951d456-ddc9-41c0-8f26-8831df03e801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:06.966379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d951d456-ddc9-41c0-8f26-8831df03e801 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:06.967562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d951d456-ddc9-41c0-8f26-8831df03e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:06.967676 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:07.007434 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 68/133] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:07.008680 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf166ac-144d-4e9d-9f02-addde77fb65f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:07.042956 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 66/134] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:07.043817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951d456-ddc9-41c0-8f26-8831df03e801 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:07.113764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:07.174231 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951d456-ddc9-41c0-8f26-8831df03e801 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:07.193455 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf166ac-144d-4e9d-9f02-addde77fb65f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:07.210834 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd6803-0cd5-4dc2-80be-3ae83b976e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:07.211818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd6803-0cd5-4dc2-80be-3ae83b976e79 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:07.212103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd6803-0cd5-4dc2-80be-3ae83b976e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:07.212378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd6803-0cd5-4dc2-80be-3ae83b976e79 None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:07.213639 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd6803-0cd5-4dc2-80be-3ae83b976e79 None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:07.215097 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd6803-0cd5-4dc2-80be-3ae83b976e79 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:07.217100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 67/135] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:07 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:07.217991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd6803-0cd5-4dc2-80be-3ae83b976e79 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:07.302620 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1f32f-7427-450a-9896-23e6853bd23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:07.303513 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1f32f-7427-450a-9896-23e6853bd23f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:07.303798 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1f32f-7427-450a-9896-23e6853bd23f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:07.304076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1f32f-7427-450a-9896-23e6853bd23f None admin] PATH_INFO: `/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:07.310106 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1f32f-7427-450a-9896-23e6853bd23f None admin] RBAC: Authorizing `identity:get_user(user_id=8082f54163cd4ae882a5ec7f9c30f8cf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:07.311573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1f32f-7427-450a-9896-23e6853bd23f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:07.313238 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 69/136] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:07 2022] GET /identity/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:07.314035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1f32f-7427-450a-9896-23e6853bd23f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:07.321163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd6803-0cd5-4dc2-80be-3ae83b976e79 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:07.335793 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:07.359151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa29314-eea9-45fb-8a6e-613dfde8044f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:07.359954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa29314-eea9-45fb-8a6e-613dfde8044f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:07.360239 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa29314-eea9-45fb-8a6e-613dfde8044f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:07.360516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa29314-eea9-45fb-8a6e-613dfde8044f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:07.371970 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa29314-eea9-45fb-8a6e-613dfde8044f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:07.382796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-3aa29314-eea9-45fb-8a6e-613dfde8044f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:07.382796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:07.382796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:07.382796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:07.382796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:07.382796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:07.382796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:07.382796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:07.382796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:07.382796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:07.382796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:07.382796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:07.382796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:07.382796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:07.382796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:07.382796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:07.383678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:07.383678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:07.383678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:07.383678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:07.383678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:07.383678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:07.383678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:07.383678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:07.383678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:07.383678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:07.383678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:07.383678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:07.383678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:07.383678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:07.383678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:07.383678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:07.384887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:07.384887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:07.384887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:07.384887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:07.384887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:07.384887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:07.384887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:07.384887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:07.384887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:07.384887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:07.384887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:07.384887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:07.384887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 68/137] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:07.384887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa29314-eea9-45fb-8a6e-613dfde8044f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:07.419772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:07.535653 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa29314-eea9-45fb-8a6e-613dfde8044f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:07.546535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1f32f-7427-450a-9896-23e6853bd23f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:07.583679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee7f24-7451-492e-a67f-f4c503abf519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:07.584541 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee7f24-7451-492e-a67f-f4c503abf519 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:07.584875 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee7f24-7451-492e-a67f-f4c503abf519 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:07.585160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee7f24-7451-492e-a67f-f4c503abf519 None admin] PATH_INFO: `/v3/projects/15c2680adde3494b9855cab46b02eb89` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:07.586381 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee7f24-7451-492e-a67f-f4c503abf519 None admin] RBAC: Authorizing `identity:get_project(project_id=15c2680adde3494b9855cab46b02eb89)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:07.587876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee7f24-7451-492e-a67f-f4c503abf519 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:07.589814 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 69/138] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:07 2022] GET /identity/v3/projects/15c2680adde3494b9855cab46b02eb89 => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:07.590357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee7f24-7451-492e-a67f-f4c503abf519 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:07.618090 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9245d2-307a-4189-a805-fb07a48fbd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:07.618759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9245d2-307a-4189-a805-fb07a48fbd29 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:07.619564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9245d2-307a-4189-a805-fb07a48fbd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:07.621648 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9245d2-307a-4189-a805-fb07a48fbd29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:07.621648 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9245d2-307a-4189-a805-fb07a48fbd29 None admin] RBAC: Adding query filter params (role.id=6f15d5ee845e4facaee3e8b8d247dd28, scope.project.id=c63add240dc64d06949b96266e734033, user.id=28d3165a82554787837fc0be46224ee6) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:07.621648 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9245d2-307a-4189-a805-fb07a48fbd29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:07.630549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9245d2-307a-4189-a805-fb07a48fbd29 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:07.633750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:07.641068 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 70/139] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:07 2022] GET /identity/v3/role_assignments?user.id=28d3165a82554787837fc0be46224ee6&scope.project.id=c63add240dc64d06949b96266e734033&role.id=6f15d5ee845e4facaee3e8b8d247dd28 => generated 259 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:07.641763 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9245d2-307a-4189-a805-fb07a48fbd29 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:07.701858 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee7f24-7451-492e-a67f-f4c503abf519 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:07.746584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409c25b-cb86-4476-a6b6-6fdbfcebfae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:07.749157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409c25b-cb86-4476-a6b6-6fdbfcebfae2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:07.749552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409c25b-cb86-4476-a6b6-6fdbfcebfae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:07.749902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409c25b-cb86-4476-a6b6-6fdbfcebfae2 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:07.750758 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409c25b-cb86-4476-a6b6-6fdbfcebfae2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:07.752239 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409c25b-cb86-4476-a6b6-6fdbfcebfae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:07.753767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409c25b-cb86-4476-a6b6-6fdbfcebfae2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:07.775524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 70/140] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:07.786074 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409c25b-cb86-4476-a6b6-6fdbfcebfae2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:07.884165 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9245d2-307a-4189-a805-fb07a48fbd29 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:07.889715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:07.955142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c4a1d-479f-4193-9e7d-16d07571bd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:07.956086 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c4a1d-479f-4193-9e7d-16d07571bd91 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:07.956370 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c4a1d-479f-4193-9e7d-16d07571bd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:07.956642 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c4a1d-479f-4193-9e7d-16d07571bd91 None admin] PATH_INFO: `/v3/projects/15c2680adde3494b9855cab46b02eb89/users/8082f54163cd4ae882a5ec7f9c30f8cf/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:07.959653 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c4a1d-479f-4193-9e7d-16d07571bd91 None admin] RBAC: Authorizing `identity:create_grant(project_id=15c2680adde3494b9855cab46b02eb89, user_id=8082f54163cd4ae882a5ec7f9c30f8cf, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:07.961090 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c4a1d-479f-4193-9e7d-16d07571bd91 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:07.975673 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409c25b-cb86-4476-a6b6-6fdbfcebfae2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:07.982822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:07.986840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 71/141] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:56:07 2022] PUT /identity/v3/projects/15c2680adde3494b9855cab46b02eb89/users/8082f54163cd4ae882a5ec7f9c30f8cf/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:56:08.023576 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fca9b9-7ab1-4e07-a411-784352f39535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:08.024529 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fca9b9-7ab1-4e07-a411-784352f39535 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:08.024810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fca9b9-7ab1-4e07-a411-784352f39535 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:08.025134 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fca9b9-7ab1-4e07-a411-784352f39535 None admin] PATH_INFO: `/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:08.026511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fca9b9-7ab1-4e07-a411-784352f39535 None admin] RBAC: Authorizing `identity:get_user(user_id=8082f54163cd4ae882a5ec7f9c30f8cf)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:08.028086 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fca9b9-7ab1-4e07-a411-784352f39535 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:08.030151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 71/142] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:07 2022] GET /identity/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:08.035608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c4a1d-479f-4193-9e7d-16d07571bd91 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:08.147751 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c4a1d-479f-4193-9e7d-16d07571bd91 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:08.198414 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afe782-78c5-43cd-a6bb-c9328d3e125c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:08.199483 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afe782-78c5-43cd-a6bb-c9328d3e125c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:08.199964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afe782-78c5-43cd-a6bb-c9328d3e125c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:08.200462 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afe782-78c5-43cd-a6bb-c9328d3e125c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:08.236250 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:08.281455 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afe782-78c5-43cd-a6bb-c9328d3e125c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:08.283014 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afe782-78c5-43cd-a6bb-c9328d3e125c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:08.388740 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 72/143] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:08.394220 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fca9b9-7ab1-4e07-a411-784352f39535 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:08.530126 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fca9b9-7ab1-4e07-a411-784352f39535 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:08.572770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c280fd-158a-407c-bc2b-ed555c2e8454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:08.573668 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c280fd-158a-407c-bc2b-ed555c2e8454 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:08.577715 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c280fd-158a-407c-bc2b-ed555c2e8454 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:08.577995 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c280fd-158a-407c-bc2b-ed555c2e8454 None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:08.579229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c280fd-158a-407c-bc2b-ed555c2e8454 None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:08.580694 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c280fd-158a-407c-bc2b-ed555c2e8454 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:08.582424 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 72/144] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:08 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:08.590472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afe782-78c5-43cd-a6bb-c9328d3e125c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:08.681522 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:08.728430 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afe782-78c5-43cd-a6bb-c9328d3e125c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:08.772757 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afee361-9a55-46a9-9fbe-8e5a15931e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:08.773452 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afee361-9a55-46a9-9fbe-8e5a15931e4e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:08.773739 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afee361-9a55-46a9-9fbe-8e5a15931e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:08.774019 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afee361-9a55-46a9-9fbe-8e5a15931e4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:08.774870 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afee361-9a55-46a9-9fbe-8e5a15931e4e None admin] RBAC: Adding query filter params (role.id=2c7768e02a39438fbe2c3551ff3b19a4, scope.project.id=c63add240dc64d06949b96266e734033, user.id=8082f54163cd4ae882a5ec7f9c30f8cf) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:08.775741 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afee361-9a55-46a9-9fbe-8e5a15931e4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:08.777289 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afee361-9a55-46a9-9fbe-8e5a15931e4e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:08.783606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 73/145] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:08 2022] GET /identity/v3/role_assignments?user.id=8082f54163cd4ae882a5ec7f9c30f8cf&scope.project.id=c63add240dc64d06949b96266e734033&role.id=2c7768e02a39438fbe2c3551ff3b19a4 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:08.985935 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b479fea-5b1c-4c2b-8a05-afb01b0e1440 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:08.986303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b479fea-5b1c-4c2b-8a05-afb01b0e1440 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:08.986501 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b479fea-5b1c-4c2b-8a05-afb01b0e1440 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:08.988116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 73/146] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:09.003134 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0a67b-425e-411c-be34-595223995736 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:09.003668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0a67b-425e-411c-be34-595223995736 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:09.003668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0a67b-425e-411c-be34-595223995736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:09.026138 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-15b0a67b-425e-411c-be34-595223995736 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:09.027424 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-15b0a67b-425e-411c-be34-595223995736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:09.111322 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 74/147] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:09.150877 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b479fea-5b1c-4c2b-8a05-afb01b0e1440 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:09.205893 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:09.271767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b479fea-5b1c-4c2b-8a05-afb01b0e1440 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:09.307390 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc11a0d-a4f4-4f32-bd0e-2c329deadea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:09.308187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc11a0d-a4f4-4f32-bd0e-2c329deadea8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:09.308472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc11a0d-a4f4-4f32-bd0e-2c329deadea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:09.308750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc11a0d-a4f4-4f32-bd0e-2c329deadea8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:09.321705 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc11a0d-a4f4-4f32-bd0e-2c329deadea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:09.330148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-acc11a0d-a4f4-4f32-bd0e-2c329deadea8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:56:09.330148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:09.330148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:09.330148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:09.330148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:09.330148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:09.330148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:09.330148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:09.330148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:09.330148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:09.330148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:09.330148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:09.330148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:09.330148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:09.330148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:09.330148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:09.331022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:09.331022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:09.331022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:09.331022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:09.331022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:09.331022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:09.331022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:09.331022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:09.331022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:09.331022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:09.331022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:09.331022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:09.331022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:09.331022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:09.331022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:09.331022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:09.332207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:09.332207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:09.332207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:09.332207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:09.332207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:09.332207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:09.332207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:09.332207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:09.332207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:09.332207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:09.332207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:56:09.332207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:09.332207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 74/148] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:56:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:09.338875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0a67b-425e-411c-be34-595223995736 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:09.403704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:09.449243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0a67b-425e-411c-be34-595223995736 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:09.484648 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3eea5-6d6b-462f-a2ce-2889d687ca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:09.485322 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3eea5-6d6b-462f-a2ce-2889d687ca38 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:09.485632 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3eea5-6d6b-462f-a2ce-2889d687ca38 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:09.485965 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3eea5-6d6b-462f-a2ce-2889d687ca38 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:09.486722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3eea5-6d6b-462f-a2ce-2889d687ca38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:09.487145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3eea5-6d6b-462f-a2ce-2889d687ca38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:09.488459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3eea5-6d6b-462f-a2ce-2889d687ca38 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:09.497801 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 75/149] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:09.500199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60902da-c8a2-45dd-8033-de9c4f533ee8 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:09.500705 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60902da-c8a2-45dd-8033-de9c4f533ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:09.500877 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60902da-c8a2-45dd-8033-de9c4f533ee8 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:09.502138 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 75/150] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:09.504613 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3eea5-6d6b-462f-a2ce-2889d687ca38 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:09.509090 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c54d0e-7673-4c0c-a4f2-0b70a5f7fe34 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:09.509431 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c54d0e-7673-4c0c-a4f2-0b70a5f7fe34 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:09.509724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c54d0e-7673-4c0c-a4f2-0b70a5f7fe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:09.531463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-73c54d0e-7673-4c0c-a4f2-0b70a5f7fe34 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:09.532667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-73c54d0e-7673-4c0c-a4f2-0b70a5f7fe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:09.611907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3eea5-6d6b-462f-a2ce-2889d687ca38 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:09.616311 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 76/151] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:09.617850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059678-9b1d-47c1-a259-8a44ee2815dc None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:09.618445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059678-9b1d-47c1-a259-8a44ee2815dc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:09.619459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059678-9b1d-47c1-a259-8a44ee2815dc None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:09.620951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 77/152] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:09.626720 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b515b2e-0004-474e-8f5e-2f1efee0a48e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:09.627229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b515b2e-0004-474e-8f5e-2f1efee0a48e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:09.627699 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b515b2e-0004-474e-8f5e-2f1efee0a48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:09.645328 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:09.646978 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4b515b2e-0004-474e-8f5e-2f1efee0a48e None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:09.648348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4b515b2e-0004-474e-8f5e-2f1efee0a48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:09.666897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7028f23-fa19-4020-85d6-67eb35041ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:09.667825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7028f23-fa19-4020-85d6-67eb35041ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:09.668106 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7028f23-fa19-4020-85d6-67eb35041ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:09.668378 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7028f23-fa19-4020-85d6-67eb35041ed8 None admin] PATH_INFO: `/v3/users/97dbc9dd817544e5a3eb7457f8275b7b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:09.669615 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7028f23-fa19-4020-85d6-67eb35041ed8 None admin] RBAC: Authorizing `identity:get_user(user_id=97dbc9dd817544e5a3eb7457f8275b7b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:09.671420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7028f23-fa19-4020-85d6-67eb35041ed8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:09.674184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 76/153] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:09 2022] GET /identity/v3/users/97dbc9dd817544e5a3eb7457f8275b7b => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:09.674796 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7028f23-fa19-4020-85d6-67eb35041ed8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:09.678679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:09.737158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 78/154] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:09.737849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b515b2e-0004-474e-8f5e-2f1efee0a48e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:09.793951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7028f23-fa19-4020-85d6-67eb35041ed8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:09.835678 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f421d56-578d-45f4-bdb6-2db80ca6bc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:09.836813 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f421d56-578d-45f4-bdb6-2db80ca6bc15 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:09.837340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f421d56-578d-45f4-bdb6-2db80ca6bc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:09.838352 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f421d56-578d-45f4-bdb6-2db80ca6bc15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:09.839755 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f421d56-578d-45f4-bdb6-2db80ca6bc15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:09.841714 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f421d56-578d-45f4-bdb6-2db80ca6bc15 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:09.843736 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 77/155] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:09.849133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f421d56-578d-45f4-bdb6-2db80ca6bc15 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:09.850183 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b515b2e-0004-474e-8f5e-2f1efee0a48e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:09.894483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83323925-bebb-4c40-9c0d-cd1dd8f0599c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:09.895174 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83323925-bebb-4c40-9c0d-cd1dd8f0599c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:09.895985 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83323925-bebb-4c40-9c0d-cd1dd8f0599c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:09.896278 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83323925-bebb-4c40-9c0d-cd1dd8f0599c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:09.914376 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:09.929944 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:09.965197 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f421d56-578d-45f4-bdb6-2db80ca6bc15 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:09.974079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83323925-bebb-4c40-9c0d-cd1dd8f0599c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:09.975765 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83323925-bebb-4c40-9c0d-cd1dd8f0599c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:10.004727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a4d28-4f30-49ce-9115-eb892e67c0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:10.006236 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a4d28-4f30-49ce-9115-eb892e67c0ec None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:10.006789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a4d28-4f30-49ce-9115-eb892e67c0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:10.007256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a4d28-4f30-49ce-9115-eb892e67c0ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:10.018730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a4d28-4f30-49ce-9115-eb892e67c0ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:10.027685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-430a4d28-4f30-49ce-9115-eb892e67c0ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:10.027685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:10.027685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:10.027685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:10.027685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:10.027685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:10.027685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:10.027685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:10.027685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:10.027685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:10.027685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:10.027685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:10.027685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:10.027685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:10.027685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:10.027685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:10.028774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:10.028774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:10.028774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:10.028774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:10.028774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:10.028774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:10.028774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:10.028774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:10.028774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:10.028774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:10.028774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:10.028774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:10.028774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:10.028774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:10.028774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:10.028774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:10.029650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:10.029650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:10.029650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:10.029650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:10.029650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:10.029650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:10.029650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:10.029650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:10.029650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:10.029650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:10.029650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:10.029650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:10.032312 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 78/156] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:56:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:10.033458 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a4d28-4f30-49ce-9115-eb892e67c0ec None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:10.083607 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 79/157] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:10.084302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83323925-bebb-4c40-9c0d-cd1dd8f0599c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:10.141306 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a4d28-4f30-49ce-9115-eb892e67c0ec None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:10.159688 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:10.168885 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:10.179766 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150d592-e1d4-421a-80d1-4455f4b3f663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:10.180817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d592-e1d4-421a-80d1-4455f4b3f663 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:10.181351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d592-e1d4-421a-80d1-4455f4b3f663 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:10.181955 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d592-e1d4-421a-80d1-4455f4b3f663 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:10.182887 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150d592-e1d4-421a-80d1-4455f4b3f663 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:10.184570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150d592-e1d4-421a-80d1-4455f4b3f663 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:10.193959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83323925-bebb-4c40-9c0d-cd1dd8f0599c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:10.215140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 79/158] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:56:10 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:56:10.222524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150d592-e1d4-421a-80d1-4455f4b3f663 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:10.240992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4fef2-0924-490c-ab0e-20db3c447676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:10.241866 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4fef2-0924-490c-ab0e-20db3c447676 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:10.242311 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4fef2-0924-490c-ab0e-20db3c447676 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:10.242688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4fef2-0924-490c-ab0e-20db3c447676 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:10.243605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4fef2-0924-490c-ab0e-20db3c447676 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:10.244047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4fef2-0924-490c-ab0e-20db3c447676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:10.246525 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4fef2-0924-490c-ab0e-20db3c447676 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:10.257686 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 80/159] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:56:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:10.264409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4fef2-0924-490c-ab0e-20db3c447676 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:10.386768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4fef2-0924-490c-ab0e-20db3c447676 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:10.409793 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:10.426616 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a597f-e00e-43c1-9a24-bd8e03171bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:10.427656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a597f-e00e-43c1-9a24-bd8e03171bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:10.428086 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a597f-e00e-43c1-9a24-bd8e03171bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:10.428471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a597f-e00e-43c1-9a24-bd8e03171bc1 None admin] PATH_INFO: `/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:10.430714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a597f-e00e-43c1-9a24-bd8e03171bc1 None admin] RBAC: Authorizing `identity:get_user(user_id=8082f54163cd4ae882a5ec7f9c30f8cf)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:10.432301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a597f-e00e-43c1-9a24-bd8e03171bc1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:10.434162 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 81/160] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:10 2022] GET /identity/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:10.439909 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a597f-e00e-43c1-9a24-bd8e03171bc1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:10.513126 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150d592-e1d4-421a-80d1-4455f4b3f663 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:10.556915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be2ded-629d-4085-a31d-99f55aa83cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:10.558290 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be2ded-629d-4085-a31d-99f55aa83cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:10.558671 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be2ded-629d-4085-a31d-99f55aa83cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:10.559045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be2ded-629d-4085-a31d-99f55aa83cd6 None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:10.561187 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be2ded-629d-4085-a31d-99f55aa83cd6 None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:10.562849 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be2ded-629d-4085-a31d-99f55aa83cd6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:10.564781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 80/161] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:10 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:10.566065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0245da9-7f2f-4a5c-b57a-18c5a369036f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:10.566341 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0245da9-7f2f-4a5c-b57a-18c5a369036f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:10.566623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0245da9-7f2f-4a5c-b57a-18c5a369036f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:10.568181 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 81/162] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:10.571613 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0245da9-7f2f-4a5c-b57a-18c5a369036f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:10.577145 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a597f-e00e-43c1-9a24-bd8e03171bc1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:10.614534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdccd7-c7fc-4804-b4f2-92bd70bcf956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:10.615184 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdccd7-c7fc-4804-b4f2-92bd70bcf956 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:10.615469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdccd7-c7fc-4804-b4f2-92bd70bcf956 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:10.615733 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdccd7-c7fc-4804-b4f2-92bd70bcf956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:10.624770 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:10.699817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:10.705138 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0245da9-7f2f-4a5c-b57a-18c5a369036f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:10.713340 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdccd7-c7fc-4804-b4f2-92bd70bcf956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:10.714863 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdccd7-c7fc-4804-b4f2-92bd70bcf956 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:10.740440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d967c-aab6-4e72-805f-73eacfaaccdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:10.741088 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d967c-aab6-4e72-805f-73eacfaaccdb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:10.741384 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d967c-aab6-4e72-805f-73eacfaaccdb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:10.741697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d967c-aab6-4e72-805f-73eacfaaccdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:10.742580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d967c-aab6-4e72-805f-73eacfaaccdb None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=c63add240dc64d06949b96266e734033, user.id=97dbc9dd817544e5a3eb7457f8275b7b) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:10.742890 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d967c-aab6-4e72-805f-73eacfaaccdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:10.744869 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d967c-aab6-4e72-805f-73eacfaaccdb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:10.751295 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 82/163] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:10 2022] GET /identity/v3/role_assignments?user.id=97dbc9dd817544e5a3eb7457f8275b7b&scope.project.id=c63add240dc64d06949b96266e734033&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:10.752573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e88f-9c31-4ad6-832e-a40f1728eab2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:10.752862 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e88f-9c31-4ad6-832e-a40f1728eab2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:10.753133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e88f-9c31-4ad6-832e-a40f1728eab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:10.774474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1358e88f-9c31-4ad6-832e-a40f1728eab2 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:10.775740 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1358e88f-9c31-4ad6-832e-a40f1728eab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:10.829086 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 82/164] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:10.834378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdccd7-c7fc-4804-b4f2-92bd70bcf956 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:10.866273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 83/165] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:10.891409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358e88f-9c31-4ad6-832e-a40f1728eab2 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:10.932478 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:10.933167 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:10.944589 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdccd7-c7fc-4804-b4f2-92bd70bcf956 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:10.987827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a08ad6-bd57-402e-bc86-77c4a8b0f4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:10.988625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a08ad6-bd57-402e-bc86-77c4a8b0f4ef None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:10.988915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a08ad6-bd57-402e-bc86-77c4a8b0f4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:10.989199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a08ad6-bd57-402e-bc86-77c4a8b0f4ef None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:10.990612 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a08ad6-bd57-402e-bc86-77c4a8b0f4ef None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:10.993055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a08ad6-bd57-402e-bc86-77c4a8b0f4ef None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:10.994940 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 83/166] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:10 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:11.000706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a08ad6-bd57-402e-bc86-77c4a8b0f4ef None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:11.011292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358e88f-9c31-4ad6-832e-a40f1728eab2 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:11.051369 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa2337-7fd1-4ca2-acb5-10912c8a8c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:11.052227 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa2337-7fd1-4ca2-acb5-10912c8a8c83 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:11.052508 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa2337-7fd1-4ca2-acb5-10912c8a8c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:11.052777 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa2337-7fd1-4ca2-acb5-10912c8a8c83 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:11.064998 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa2337-7fd1-4ca2-acb5-10912c8a8c83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:11.074704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-31fa2337-7fd1-4ca2-acb5-10912c8a8c83 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:11.074704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:11.074704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:11.074704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:11.074704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:11.074704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:11.074704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:11.074704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:11.074704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:11.074704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:11.074704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:11.074704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:11.074704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:11.074704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:11.074704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:11.074704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:11.075829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:11.075829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:11.075829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:11.075829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:11.075829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:11.075829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:11.075829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:11.075829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:11.075829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:11.075829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:11.075829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:11.075829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:11.075829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:11.075829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:11.075829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:11.075829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:11.076609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:11.076609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:11.076609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:11.076609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:11.076609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:11.076609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:11.076609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:11.076609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:11.076609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:11.076609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:11.076609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:11.076609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:11.076609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 84/167] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:11.085420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa2337-7fd1-4ca2-acb5-10912c8a8c83 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:11.115909 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a08ad6-bd57-402e-bc86-77c4a8b0f4ef None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:11.154587 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1bf63b-fdcf-46f5-986c-9800b3f7c6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:11.155256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bf63b-fdcf-46f5-986c-9800b3f7c6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:11.155538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bf63b-fdcf-46f5-986c-9800b3f7c6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:11.155813 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bf63b-fdcf-46f5-986c-9800b3f7c6e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:11.156656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1bf63b-fdcf-46f5-986c-9800b3f7c6e0 None admin] RBAC: Adding query filter params (role.id=d6dae1fcff6641fcb71c0203d9c4e161, scope.project.id=c63add240dc64d06949b96266e734033, user.id=8082f54163cd4ae882a5ec7f9c30f8cf) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:11.156964 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1bf63b-fdcf-46f5-986c-9800b3f7c6e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:11.158459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1bf63b-fdcf-46f5-986c-9800b3f7c6e0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:11.164984 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 84/168] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:10 2022] GET /identity/v3/role_assignments?user.id=8082f54163cd4ae882a5ec7f9c30f8cf&scope.project.id=c63add240dc64d06949b96266e734033&role.id=d6dae1fcff6641fcb71c0203d9c4e161 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:11.200332 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:11.209547 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa2337-7fd1-4ca2-acb5-10912c8a8c83 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:11.246010 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24afb4-0790-4a9d-a80c-af776166ab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:11.246603 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24afb4-0790-4a9d-a80c-af776166ab03 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:11.246883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24afb4-0790-4a9d-a80c-af776166ab03 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:11.247151 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24afb4-0790-4a9d-a80c-af776166ab03 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:11.247912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24afb4-0790-4a9d-a80c-af776166ab03 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:11.248210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24afb4-0790-4a9d-a80c-af776166ab03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:11.249661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24afb4-0790-4a9d-a80c-af776166ab03 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:11.260061 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 85/169] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:11.265826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1bf63b-fdcf-46f5-986c-9800b3f7c6e0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:11.310927 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:11.316871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61450d6-eb44-4206-a7b9-469ff7b4d99f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:11.317158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61450d6-eb44-4206-a7b9-469ff7b4d99f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:11.317443 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61450d6-eb44-4206-a7b9-469ff7b4d99f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:11.319026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 86/170] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:11.326822 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd142397-ed54-457d-bc49-1ad9ea5ffd66 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:11.327098 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd142397-ed54-457d-bc49-1ad9ea5ffd66 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:11.327373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd142397-ed54-457d-bc49-1ad9ea5ffd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:11.355717 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cd142397-ed54-457d-bc49-1ad9ea5ffd66 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:11.356916 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cd142397-ed54-457d-bc49-1ad9ea5ffd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:11.444499 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1bf63b-fdcf-46f5-986c-9800b3f7c6e0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:11.467658 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 87/171] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:11.500855 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea4ab1-7bf0-4ecb-bf7f-ab7c84ed7923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:11.501993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea4ab1-7bf0-4ecb-bf7f-ab7c84ed7923 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:11.502439 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea4ab1-7bf0-4ecb-bf7f-ab7c84ed7923 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:11.502846 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea4ab1-7bf0-4ecb-bf7f-ab7c84ed7923 None admin] PATH_INFO: `/v3/users/28d3165a82554787837fc0be46224ee6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:11.510218 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea4ab1-7bf0-4ecb-bf7f-ab7c84ed7923 None admin] RBAC: Authorizing `identity:get_user(user_id=28d3165a82554787837fc0be46224ee6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:11.512105 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea4ab1-7bf0-4ecb-bf7f-ab7c84ed7923 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:11.513963 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 85/172] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:11 2022] GET /identity/v3/users/28d3165a82554787837fc0be46224ee6 => generated 289 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:11.518605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd142397-ed54-457d-bc49-1ad9ea5ffd66 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:11.530397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea4ab1-7bf0-4ecb-bf7f-ab7c84ed7923 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:11.631007 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:11.651268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd142397-ed54-457d-bc49-1ad9ea5ffd66 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:11.658537 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:11.674781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea4ab1-7bf0-4ecb-bf7f-ab7c84ed7923 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:11.704484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d430cb-df82-409c-8e03-643de0631656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:11.704484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d430cb-df82-409c-8e03-643de0631656 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:11.704484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d430cb-df82-409c-8e03-643de0631656 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:11.704833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d430cb-df82-409c-8e03-643de0631656 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:11.719648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d650c-025f-4f40-851b-2e21d4265e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:11.720232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d430cb-df82-409c-8e03-643de0631656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:11.721003 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d650c-025f-4f40-851b-2e21d4265e3f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:11.721515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d650c-025f-4f40-851b-2e21d4265e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:11.721958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d650c-025f-4f40-851b-2e21d4265e3f None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:11.723333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d650c-025f-4f40-851b-2e21d4265e3f None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:11.724970 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d650c-025f-4f40-851b-2e21d4265e3f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:11.727190 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 86/173] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:11 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:11.728718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-52d430cb-df82-409c-8e03-643de0631656 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:11.728718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:11.728718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:11.728718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:11.728718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:11.728718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:11.728718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:11.728718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:11.728718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:11.728718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:11.728718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:11.728718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:11.728718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:11.728718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:11.728718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:11.728718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:11.729652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:11.729652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:11.729652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:11.729652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:11.729652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:11.729652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:11.729652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:11.729652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:11.729652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:11.729652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:11.729652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:11.729652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:11.729652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:11.729652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:11.729652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:11.729652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:11.730441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:11.730441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:11.730441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:11.730441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:11.730441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:11.730441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:11.730441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:11.730441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:11.730441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:11.730441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:11.730441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:11.730441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:11.730441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 88/174] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:11.736595 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d650c-025f-4f40-851b-2e21d4265e3f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:11.736762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d430cb-df82-409c-8e03-643de0631656 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:11.849288 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d430cb-df82-409c-8e03-643de0631656 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:11.864699 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d650c-025f-4f40-851b-2e21d4265e3f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:11.901089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46dcfc-f19a-4b22-9c96-850ad94027f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:11.903273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46dcfc-f19a-4b22-9c96-850ad94027f6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:11.904486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46dcfc-f19a-4b22-9c96-850ad94027f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:11.905503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46dcfc-f19a-4b22-9c96-850ad94027f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:11.906597 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46dcfc-f19a-4b22-9c96-850ad94027f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:11.908961 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46dcfc-f19a-4b22-9c96-850ad94027f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:11.911001 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46dcfc-f19a-4b22-9c96-850ad94027f6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:11.913981 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5acf01-15a9-4c28-b51b-6c608829ae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:11.915076 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5acf01-15a9-4c28-b51b-6c608829ae65 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:11.915561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5acf01-15a9-4c28-b51b-6c608829ae65 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:11.916820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5acf01-15a9-4c28-b51b-6c608829ae65 None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033/users/28d3165a82554787837fc0be46224ee6/roles/6f15d5ee845e4facaee3e8b8d247dd28` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:11.921452 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5acf01-15a9-4c28-b51b-6c608829ae65 None admin] RBAC: Authorizing `identity:create_grant(project_id=c63add240dc64d06949b96266e734033, user_id=28d3165a82554787837fc0be46224ee6, role_id=6f15d5ee845e4facaee3e8b8d247dd28)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:11.923083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5acf01-15a9-4c28-b51b-6c608829ae65 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:11.928824 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 89/175] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:11.936332 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46dcfc-f19a-4b22-9c96-850ad94027f6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:11.955278 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 87/176] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:56:11 2022] PUT /identity/v3/projects/c63add240dc64d06949b96266e734033/users/28d3165a82554787837fc0be46224ee6/roles/6f15d5ee845e4facaee3e8b8d247dd28 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 10:56:11.966411 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:12.098613 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46dcfc-f19a-4b22-9c96-850ad94027f6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:12.138393 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa465a59-0a61-4db1-b24b-20c7d4af48ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:12.139220 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa465a59-0a61-4db1-b24b-20c7d4af48ac None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:12.139471 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa465a59-0a61-4db1-b24b-20c7d4af48ac None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:12.139747 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa465a59-0a61-4db1-b24b-20c7d4af48ac None admin] PATH_INFO: `/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:12.140957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa465a59-0a61-4db1-b24b-20c7d4af48ac None admin] RBAC: Authorizing `identity:get_user(user_id=8082f54163cd4ae882a5ec7f9c30f8cf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:12.142440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa465a59-0a61-4db1-b24b-20c7d4af48ac None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:12.144433 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 90/177] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:11 2022] GET /identity/v3/users/8082f54163cd4ae882a5ec7f9c30f8cf => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:12.149683 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5acf01-15a9-4c28-b51b-6c608829ae65 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:12.176657 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:12.279880 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5acf01-15a9-4c28-b51b-6c608829ae65 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:12.333575 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b92c5-694d-4ccc-8158-8cf4f6a45ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:12.334234 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b92c5-694d-4ccc-8158-8cf4f6a45ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:12.334519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b92c5-694d-4ccc-8158-8cf4f6a45ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:12.334796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b92c5-694d-4ccc-8158-8cf4f6a45ff0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:12.426269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b92c5-694d-4ccc-8158-8cf4f6a45ff0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:12.427661 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b92c5-694d-4ccc-8158-8cf4f6a45ff0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:12.452799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:12.556158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 88/178] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:12.562209 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa465a59-0a61-4db1-b24b-20c7d4af48ac None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:12.711374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:12.741398 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa465a59-0a61-4db1-b24b-20c7d4af48ac None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:12.776568 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfa87f-6ba3-4759-91ce-e3d4c7a96a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:12.777452 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfa87f-6ba3-4759-91ce-e3d4c7a96a6e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:12.777730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfa87f-6ba3-4759-91ce-e3d4c7a96a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:12.778002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfa87f-6ba3-4759-91ce-e3d4c7a96a6e None admin] PATH_INFO: `/v3/projects/15c2680adde3494b9855cab46b02eb89` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:12.779183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfa87f-6ba3-4759-91ce-e3d4c7a96a6e None admin] RBAC: Authorizing `identity:get_project(project_id=15c2680adde3494b9855cab46b02eb89)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:12.780629 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfa87f-6ba3-4759-91ce-e3d4c7a96a6e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:12.782654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 91/179] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:12 2022] GET /identity/v3/projects/15c2680adde3494b9855cab46b02eb89 => generated 312 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:12.788440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b92c5-694d-4ccc-8158-8cf4f6a45ff0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:12.906036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b92c5-694d-4ccc-8158-8cf4f6a45ff0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:12.923660 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:12.953627 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f38e3-502a-41bf-a5e5-af3998752a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:12.954282 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f38e3-502a-41bf-a5e5-af3998752a4e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:12.954561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f38e3-502a-41bf-a5e5-af3998752a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:12.954837 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f38e3-502a-41bf-a5e5-af3998752a4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:12.955677 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f38e3-502a-41bf-a5e5-af3998752a4e None admin] RBAC: Adding query filter params (role.id=2c7768e02a39438fbe2c3551ff3b19a4, scope.project.id=15c2680adde3494b9855cab46b02eb89, user.id=8082f54163cd4ae882a5ec7f9c30f8cf) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:12.955986 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f38e3-502a-41bf-a5e5-af3998752a4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:12.957445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f38e3-502a-41bf-a5e5-af3998752a4e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:12.967117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 89/180] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:12 2022] GET /identity/v3/role_assignments?user.id=8082f54163cd4ae882a5ec7f9c30f8cf&scope.project.id=15c2680adde3494b9855cab46b02eb89&role.id=2c7768e02a39438fbe2c3551ff3b19a4 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:13.389208 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e71b6-5ef1-481e-a778-4b9fd129878f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:13.389750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e71b6-5ef1-481e-a778-4b9fd129878f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:13.389825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e71b6-5ef1-481e-a778-4b9fd129878f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:13.391401 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 92/181] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:13.396923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dbb5a-070d-4acd-936c-2260dca38deb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:13.397215 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dbb5a-070d-4acd-936c-2260dca38deb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:13.397529 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dbb5a-070d-4acd-936c-2260dca38deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:13.415767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ed9dbb5a-070d-4acd-936c-2260dca38deb None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:13.416936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ed9dbb5a-070d-4acd-936c-2260dca38deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:13.493132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 90/182] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:13.516940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e71b6-5ef1-481e-a778-4b9fd129878f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:13.530420 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbd129-634e-4d63-888f-951abe305bb5 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:13.530710 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbd129-634e-4d63-888f-951abe305bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:13.530973 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbd129-634e-4d63-888f-951abe305bb5 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:13.532601 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 91/183] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:13.539813 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1056-b5ae-407f-8866-9011f59dd38c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:13.540094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1056-b5ae-407f-8866-9011f59dd38c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:13.540366 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1056-b5ae-407f-8866-9011f59dd38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:13.558396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-658a1056-b5ae-407f-8866-9011f59dd38c None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:13.559920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-658a1056-b5ae-407f-8866-9011f59dd38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:13.645235 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 92/184] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:13.651965 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e71b6-5ef1-481e-a778-4b9fd129878f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:13.666098 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfac21-be26-4943-ae76-6fdb8e24763b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:13.666681 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfac21-be26-4943-ae76-6fdb8e24763b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:13.667177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfac21-be26-4943-ae76-6fdb8e24763b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:13.668762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 93/185] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:56:13.669650 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfac21-be26-4943-ae76-6fdb8e24763b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:13.689081 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9ed61-1da6-48d9-9516-aa1dfb8b3ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:13.690016 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9ed61-1da6-48d9-9516-aa1dfb8b3ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:13.690298 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9ed61-1da6-48d9-9516-aa1dfb8b3ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:13.690625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9ed61-1da6-48d9-9516-aa1dfb8b3ab3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:13.702052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9ed61-1da6-48d9-9516-aa1dfb8b3ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:13.710413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-93c9ed61-1da6-48d9-9516-aa1dfb8b3ab3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:56:13.710413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:13.710413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:13.710413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:13.710413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:13.710413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:13.710413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:13.710413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:13.710413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:13.710413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:13.710413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:13.710413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:13.710413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:13.710413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:13.710413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:13.710413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:13.711283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:13.711283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:13.711283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:13.711283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:13.711283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:13.711283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:13.711283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:13.711283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:13.711283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:13.711283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:13.711283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:13.711283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:13.711283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:13.711283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:13.711283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:13.711283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:13.712104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:13.712104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:13.712104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:13.712104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:13.712104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:13.712104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:13.712104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:13.712104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:13.712104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:13.712104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:13.712104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:56:13.712104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:13.712104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 93/186] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:56:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:13.712886 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2838a6-cfbd-452a-af0f-bb4a6e743ece None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:13.713461 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2838a6-cfbd-452a-af0f-bb4a6e743ece None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:13.713461 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2838a6-cfbd-452a-af0f-bb4a6e743ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:13.718712 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:13.723634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:13.734633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7f2838a6-cfbd-452a-af0f-bb4a6e743ece None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:13.735845 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7f2838a6-cfbd-452a-af0f-bb4a6e743ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:13.779017 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfac21-be26-4943-ae76-6fdb8e24763b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:13.807820 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 94/187] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:13.813961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03102d-7427-4f80-9195-099da711d4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:13.814764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03102d-7427-4f80-9195-099da711d4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:13.815042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03102d-7427-4f80-9195-099da711d4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:13.815315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03102d-7427-4f80-9195-099da711d4e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:13.818225 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2838a6-cfbd-452a-af0f-bb4a6e743ece None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:13.826902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03102d-7427-4f80-9195-099da711d4e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:13.835093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8f03102d-7427-4f80-9195-099da711d4e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:13.835093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:13.835093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:13.835093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:13.835093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:13.835093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:13.835093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:13.835093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:13.835093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:13.835093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:13.835093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:13.835093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:13.835093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:13.835093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:13.835093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:13.835093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:13.836170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:13.836170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:13.836170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:13.836170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:13.836170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:13.836170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:13.836170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:13.836170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:13.836170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:13.836170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:13.836170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:13.836170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:13.836170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:13.836170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:13.836170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:13.836170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:13.837100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:13.837100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:13.837100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:13.837100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:13.837100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:13.837100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:13.837100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:13.837100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:13.837100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:13.837100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:13.837100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:13.837100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:13.837100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 94/188] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:56:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:13.837100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03102d-7427-4f80-9195-099da711d4e7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:13.926233 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2838a6-cfbd-452a-af0f-bb4a6e743ece None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:13.942508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:13.945332 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03102d-7427-4f80-9195-099da711d4e7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:13.963610 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589939ce-a691-49fe-a190-926042095b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:13.964279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589939ce-a691-49fe-a190-926042095b8b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:13.964620 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589939ce-a691-49fe-a190-926042095b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:13.964902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589939ce-a691-49fe-a190-926042095b8b None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:13.965710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589939ce-a691-49fe-a190-926042095b8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:13.966078 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589939ce-a691-49fe-a190-926042095b8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:13.967471 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589939ce-a691-49fe-a190-926042095b8b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:13.969287 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:13.976848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 95/189] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:13.976848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589939ce-a691-49fe-a190-926042095b8b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:13.989113 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947f2ac-671d-4431-bd8b-9f14779a73ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:13.989929 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947f2ac-671d-4431-bd8b-9f14779a73ae None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:13.990476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947f2ac-671d-4431-bd8b-9f14779a73ae None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:13.990476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947f2ac-671d-4431-bd8b-9f14779a73ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:13.991628 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947f2ac-671d-4431-bd8b-9f14779a73ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:13.993122 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947f2ac-671d-4431-bd8b-9f14779a73ae None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:13.995607 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 95/190] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:13.996203 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947f2ac-671d-4431-bd8b-9f14779a73ae None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:14.087164 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589939ce-a691-49fe-a190-926042095b8b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:14.102436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947f2ac-671d-4431-bd8b-9f14779a73ae None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:14.122956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5a54c-50a7-40db-81ba-97abf0e84bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:14.123630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5a54c-50a7-40db-81ba-97abf0e84bee None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:14.123914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5a54c-50a7-40db-81ba-97abf0e84bee None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:14.124193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5a54c-50a7-40db-81ba-97abf0e84bee None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:14.124942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5a54c-50a7-40db-81ba-97abf0e84bee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:14.125252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5a54c-50a7-40db-81ba-97abf0e84bee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:14.126656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5a54c-50a7-40db-81ba-97abf0e84bee None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:14.134719 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 96/191] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:56:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:14.135938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5a54c-50a7-40db-81ba-97abf0e84bee None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:14.143481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee5215-6c91-478d-99f0-67a0fcb58d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:14.144362 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee5215-6c91-478d-99f0-67a0fcb58d12 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:14.144649 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee5215-6c91-478d-99f0-67a0fcb58d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:14.144930 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee5215-6c91-478d-99f0-67a0fcb58d12 None admin] PATH_INFO: `/v3/users/1e4ad54f93b04182a2003c8fe2671030` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:14.160855 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee5215-6c91-478d-99f0-67a0fcb58d12 None admin] RBAC: Authorizing `identity:get_user(user_id=1e4ad54f93b04182a2003c8fe2671030)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:14.163177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee5215-6c91-478d-99f0-67a0fcb58d12 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:14.170127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 96/192] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:13 2022] GET /identity/v3/users/1e4ad54f93b04182a2003c8fe2671030 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:14.170127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee5215-6c91-478d-99f0-67a0fcb58d12 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:14.198121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:14.203645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:14.243030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5a54c-50a7-40db-81ba-97abf0e84bee None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:14.278175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bb6c7-e5bb-4b39-b153-f28e81e93994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:14.278838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bb6c7-e5bb-4b39-b153-f28e81e93994 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:14.279122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bb6c7-e5bb-4b39-b153-f28e81e93994 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:14.279399 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bb6c7-e5bb-4b39-b153-f28e81e93994 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:14.280101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bb6c7-e5bb-4b39-b153-f28e81e93994 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:14.280536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee5215-6c91-478d-99f0-67a0fcb58d12 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:14.281568 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bb6c7-e5bb-4b39-b153-f28e81e93994 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:14.304070 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 97/193] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:56:14 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:56:14.304888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bb6c7-e5bb-4b39-b153-f28e81e93994 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:14.330917 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e343e-b179-4a03-812d-99042db43f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:14.331806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e343e-b179-4a03-812d-99042db43f91 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:14.332087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e343e-b179-4a03-812d-99042db43f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:14.332358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e343e-b179-4a03-812d-99042db43f91 None admin] PATH_INFO: `/v3/users/1e4ad54f93b04182a2003c8fe2671030` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:14.333665 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e343e-b179-4a03-812d-99042db43f91 None admin] RBAC: Authorizing `identity:get_user(user_id=1e4ad54f93b04182a2003c8fe2671030)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:14.335160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e343e-b179-4a03-812d-99042db43f91 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:14.337051 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 97/194] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:14 2022] GET /identity/v3/users/1e4ad54f93b04182a2003c8fe2671030 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:14.338834 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93f01b-6de8-4949-b7c1-b891d881ff55 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:14.339037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93f01b-6de8-4949-b7c1-b891d881ff55 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:14.339246 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93f01b-6de8-4949-b7c1-b891d881ff55 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:14.340580 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 98/195] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:14.345676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93f01b-6de8-4949-b7c1-b891d881ff55 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:14.423879 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bb6c7-e5bb-4b39-b153-f28e81e93994 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:14.439522 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:14.458641 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:14.464080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16933428-87b4-40d9-a3d8-f532c5c6d6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:14.464736 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16933428-87b4-40d9-a3d8-f532c5c6d6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:14.465022 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16933428-87b4-40d9-a3d8-f532c5c6d6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:14.465438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16933428-87b4-40d9-a3d8-f532c5c6d6a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:14.468607 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93f01b-6de8-4949-b7c1-b891d881ff55 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:14.506746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc7508-01c2-44e1-9067-71671523c5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:14.507397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc7508-01c2-44e1-9067-71671523c5ec None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:14.507709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc7508-01c2-44e1-9067-71671523c5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:14.507988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc7508-01c2-44e1-9067-71671523c5ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:14.545332 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16933428-87b4-40d9-a3d8-f532c5c6d6a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:14.547575 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16933428-87b4-40d9-a3d8-f532c5c6d6a8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:14.600363 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc7508-01c2-44e1-9067-71671523c5ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:14.602352 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc7508-01c2-44e1-9067-71671523c5ec None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:14.676949 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 98/196] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:14.678341 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6004f-6ee0-4496-9ad1-a09d8d7e2a89 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:14.678625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6004f-6ee0-4496-9ad1-a09d8d7e2a89 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:14.678898 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6004f-6ee0-4496-9ad1-a09d8d7e2a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:14.698575 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-27a6004f-6ee0-4496-9ad1-a09d8d7e2a89 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:14.699925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-27a6004f-6ee0-4496-9ad1-a09d8d7e2a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:14.713403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:14.733103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:14.742308 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 99/197] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:14.743070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc7508-01c2-44e1-9067-71671523c5ec None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:14.790435 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 99/198] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:14.791693 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6004f-6ee0-4496-9ad1-a09d8d7e2a89 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:14.852903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc7508-01c2-44e1-9067-71671523c5ec None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:14.895414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da27b8-f8a9-4598-8a42-27bc7b86bbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:14.896439 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da27b8-f8a9-4598-8a42-27bc7b86bbaf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:14.896718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da27b8-f8a9-4598-8a42-27bc7b86bbaf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:14.897035 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da27b8-f8a9-4598-8a42-27bc7b86bbaf None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:14.898595 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da27b8-f8a9-4598-8a42-27bc7b86bbaf None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:14.900519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da27b8-f8a9-4598-8a42-27bc7b86bbaf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:14.902451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 100/199] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:14 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:14.903049 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da27b8-f8a9-4598-8a42-27bc7b86bbaf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:14.918552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6004f-6ee0-4496-9ad1-a09d8d7e2a89 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:14.954613 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde1b77-5777-4903-9aa9-90d8170cb1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:14.955831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde1b77-5777-4903-9aa9-90d8170cb1ab None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:14.956300 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde1b77-5777-4903-9aa9-90d8170cb1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:14.956777 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde1b77-5777-4903-9aa9-90d8170cb1ab None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:14.958180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde1b77-5777-4903-9aa9-90d8170cb1ab None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:14.959820 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde1b77-5777-4903-9aa9-90d8170cb1ab None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:14.965072 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 100/200] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:14 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:14.966104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde1b77-5777-4903-9aa9-90d8170cb1ab None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:14.981298 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:14.984999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:15.029781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da27b8-f8a9-4598-8a42-27bc7b86bbaf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:15.064684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea81d3c-47ff-4be1-b3ff-3594f2408a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:15.065434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea81d3c-47ff-4be1-b3ff-3594f2408a44 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:15.065723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea81d3c-47ff-4be1-b3ff-3594f2408a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:15.066000 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea81d3c-47ff-4be1-b3ff-3594f2408a44 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:15.070587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde1b77-5777-4903-9aa9-90d8170cb1ab None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:15.077048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea81d3c-47ff-4be1-b3ff-3594f2408a44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:15.084770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-cea81d3c-47ff-4be1-b3ff-3594f2408a44 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:15.084770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:15.084770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:15.084770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:15.084770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:15.084770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:15.084770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:15.084770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:15.084770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:15.084770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:15.084770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:15.084770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:15.084770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:15.084770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:15.084770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:15.084770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:15.085684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:15.085684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:15.085684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:15.085684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:15.085684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:15.085684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:15.085684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:15.085684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:15.085684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:15.085684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:15.085684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:15.085684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:15.085684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:15.085684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:15.085684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:15.085684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:15.086467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:15.086467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:15.086467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:15.086467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:15.086467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:15.086467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:15.086467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:15.086467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:15.086467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:15.086467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:15.086467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:15.086467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:15.086467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 101/201] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:15.087104 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea81d3c-47ff-4be1-b3ff-3594f2408a44 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:15.110743 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd757e91-8ab4-4940-a4d9-7fb229efe8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:15.111760 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd757e91-8ab4-4940-a4d9-7fb229efe8ac None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:15.112259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd757e91-8ab4-4940-a4d9-7fb229efe8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:15.112722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd757e91-8ab4-4940-a4d9-7fb229efe8ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:15.113770 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd757e91-8ab4-4940-a4d9-7fb229efe8ac None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b, user.id=1e4ad54f93b04182a2003c8fe2671030) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:15.114270 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd757e91-8ab4-4940-a4d9-7fb229efe8ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:15.115976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd757e91-8ab4-4940-a4d9-7fb229efe8ac None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:15.122682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 101/202] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:14 2022] GET /identity/v3/role_assignments?user.id=1e4ad54f93b04182a2003c8fe2671030&scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:15.123670 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd757e91-8ab4-4940-a4d9-7fb229efe8ac None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:15.200614 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea81d3c-47ff-4be1-b3ff-3594f2408a44 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:15.227634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:15.241068 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b84d5-8421-4e65-b061-1729ff683a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:15.241576 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b84d5-8421-4e65-b061-1729ff683a0b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:15.241861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b84d5-8421-4e65-b061-1729ff683a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:15.242137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b84d5-8421-4e65-b061-1729ff683a0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:15.242996 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b84d5-8421-4e65-b061-1729ff683a0b None admin] RBAC: Adding query filter params (role.id=d6dae1fcff6641fcb71c0203d9c4e161, scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b, user.id=1e4ad54f93b04182a2003c8fe2671030) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:15.243337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b84d5-8421-4e65-b061-1729ff683a0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:15.245489 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b84d5-8421-4e65-b061-1729ff683a0b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:15.258469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 102/203] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:15 2022] GET /identity/v3/role_assignments?user.id=1e4ad54f93b04182a2003c8fe2671030&scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b&role.id=d6dae1fcff6641fcb71c0203d9c4e161 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:15.274371 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:15.310859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd757e91-8ab4-4940-a4d9-7fb229efe8ac None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:15.354755 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bac34e-c156-4176-81ad-e83a0ef2e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:15.355793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bac34e-c156-4176-81ad-e83a0ef2e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:15.356265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bac34e-c156-4176-81ad-e83a0ef2e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:15.356726 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bac34e-c156-4176-81ad-e83a0ef2e3a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:15.357760 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bac34e-c156-4176-81ad-e83a0ef2e3a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:15.358279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bac34e-c156-4176-81ad-e83a0ef2e3a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:15.359858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bac34e-c156-4176-81ad-e83a0ef2e3a1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:15.369800 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 102/204] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:15.377386 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b84d5-8421-4e65-b061-1729ff683a0b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:15.512172 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b84d5-8421-4e65-b061-1729ff683a0b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:15.547445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954168ef-f3b3-4c6e-9841-979845d595ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:15.548321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954168ef-f3b3-4c6e-9841-979845d595ab None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:15.548602 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954168ef-f3b3-4c6e-9841-979845d595ab None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:15.548877 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954168ef-f3b3-4c6e-9841-979845d595ab None admin] PATH_INFO: `/v3/users/28d3165a82554787837fc0be46224ee6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:15.550094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954168ef-f3b3-4c6e-9841-979845d595ab None admin] RBAC: Authorizing `identity:get_user(user_id=28d3165a82554787837fc0be46224ee6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:15.551547 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954168ef-f3b3-4c6e-9841-979845d595ab None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:15.553505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 103/205] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:15 2022] GET /identity/v3/users/28d3165a82554787837fc0be46224ee6 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:15.559496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bac34e-c156-4176-81ad-e83a0ef2e3a1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:15.691364 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bac34e-c156-4176-81ad-e83a0ef2e3a1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:15.736965 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd16746-0f5d-4982-b82f-25667979a5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:15.738026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd16746-0f5d-4982-b82f-25667979a5fc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:15.738501 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd16746-0f5d-4982-b82f-25667979a5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:15.738964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd16746-0f5d-4982-b82f-25667979a5fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:15.761540 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:15.828684 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd16746-0f5d-4982-b82f-25667979a5fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:15.830565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd16746-0f5d-4982-b82f-25667979a5fc None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:15.962027 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 103/206] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:15.968009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954168ef-f3b3-4c6e-9841-979845d595ab None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:16.026041 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:16.071603 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954168ef-f3b3-4c6e-9841-979845d595ab None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:16.106566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8af66-2f25-4b1d-aee4-3715dbcb3f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:16.107345 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8af66-2f25-4b1d-aee4-3715dbcb3f6f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:16.107628 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8af66-2f25-4b1d-aee4-3715dbcb3f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:16.107904 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8af66-2f25-4b1d-aee4-3715dbcb3f6f None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:16.109079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8af66-2f25-4b1d-aee4-3715dbcb3f6f None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:16.110641 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8af66-2f25-4b1d-aee4-3715dbcb3f6f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:16.112638 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 104/207] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:15 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:16.118347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd16746-0f5d-4982-b82f-25667979a5fc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:16.172474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:16.273020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd16746-0f5d-4982-b82f-25667979a5fc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:16.312212 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4231a9-1316-4178-97e4-48c0c54268af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:16.312868 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4231a9-1316-4178-97e4-48c0c54268af None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:16.313150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4231a9-1316-4178-97e4-48c0c54268af None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:16.313454 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4231a9-1316-4178-97e4-48c0c54268af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:16.314293 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4231a9-1316-4178-97e4-48c0c54268af None admin] RBAC: Adding query filter params (role.id=6f15d5ee845e4facaee3e8b8d247dd28, scope.project.id=c63add240dc64d06949b96266e734033, user.id=28d3165a82554787837fc0be46224ee6) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:16.314602 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4231a9-1316-4178-97e4-48c0c54268af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:16.316052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4231a9-1316-4178-97e4-48c0c54268af None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:16.322888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 104/208] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:16 2022] GET /identity/v3/role_assignments?user.id=28d3165a82554787837fc0be46224ee6&scope.project.id=c63add240dc64d06949b96266e734033&role.id=6f15d5ee845e4facaee3e8b8d247dd28 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:16.694708 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41814a2-c58d-4d53-8595-a470c3bd1350 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:16.695383 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41814a2-c58d-4d53-8595-a470c3bd1350 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:16.695886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41814a2-c58d-4d53-8595-a470c3bd1350 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:16.698131 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 105/209] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:16.703460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c0ccf-0857-4ed1-8afa-b443d7922814 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:16.704273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c0ccf-0857-4ed1-8afa-b443d7922814 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:16.704738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c0ccf-0857-4ed1-8afa-b443d7922814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:16.723275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3d5c0ccf-0857-4ed1-8afa-b443d7922814 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:16.724767 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3d5c0ccf-0857-4ed1-8afa-b443d7922814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:16.788316 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1df971-6908-4725-bcba-53489793a726 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:16.788621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1df971-6908-4725-bcba-53489793a726 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:16.788862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1df971-6908-4725-bcba-53489793a726 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:16.790586 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 106/210] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:16.800984 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7245df8-11a2-413f-9014-bb76ee46202c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:16.801558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7245df8-11a2-413f-9014-bb76ee46202c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:16.802030 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7245df8-11a2-413f-9014-bb76ee46202c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:16.805396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 105/211] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:16.830386 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a7245df8-11a2-413f-9014-bb76ee46202c None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:16.831564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a7245df8-11a2-413f-9014-bb76ee46202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:16.843535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c0ccf-0857-4ed1-8afa-b443d7922814 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:16.874320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:16.917063 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 107/212] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:16.940668 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7245df8-11a2-413f-9014-bb76ee46202c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:16.949881 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c0ccf-0857-4ed1-8afa-b443d7922814 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:16.991263 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7957b-7b87-4f9e-9561-53670adbe90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:16.992056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7957b-7b87-4f9e-9561-53670adbe90e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:16.992338 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7957b-7b87-4f9e-9561-53670adbe90e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:16.992615 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7957b-7b87-4f9e-9561-53670adbe90e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:16.994890 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7957b-7b87-4f9e-9561-53670adbe90e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:16.996837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7957b-7b87-4f9e-9561-53670adbe90e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:16.999460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 106/213] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:17.004119 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7957b-7b87-4f9e-9561-53670adbe90e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:17.013653 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:17.069411 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7245df8-11a2-413f-9014-bb76ee46202c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:17.113475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d6234-825b-4470-93ea-b69fd9b8e546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:17.114267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d6234-825b-4470-93ea-b69fd9b8e546 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:17.114549 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d6234-825b-4470-93ea-b69fd9b8e546 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:17.114824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d6234-825b-4470-93ea-b69fd9b8e546 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:17.126108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d6234-825b-4470-93ea-b69fd9b8e546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:17.128284 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:17.132002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7957b-7b87-4f9e-9561-53670adbe90e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:17.133808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-918d6234-825b-4470-93ea-b69fd9b8e546 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:17.133808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:17.133808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:17.133808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:17.133808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:17.133808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:17.133808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:17.133808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:17.133808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:17.133808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:17.133808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:17.133808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:17.133808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:17.133808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:17.133808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:17.133808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:17.134851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:17.134851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:17.134851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:17.134851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:17.134851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:17.134851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:17.134851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:17.134851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:17.134851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:17.134851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:17.134851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:17.134851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:17.134851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:17.134851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:17.134851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:17.134851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:17.135983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:17.135983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:17.135983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:17.135983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:17.135983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:17.135983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:17.135983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:17.135983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:17.135983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:17.135983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:17.135983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:17.135983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:17.135983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 108/214] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:17.141188 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d6234-825b-4470-93ea-b69fd9b8e546 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:17.172329 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607f8b7-c205-4145-98bb-f1f6df46b01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:17.173311 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607f8b7-c205-4145-98bb-f1f6df46b01e None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:17.173889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607f8b7-c205-4145-98bb-f1f6df46b01e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:17.174462 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607f8b7-c205-4145-98bb-f1f6df46b01e None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:17.175526 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607f8b7-c205-4145-98bb-f1f6df46b01e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:17.177203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607f8b7-c205-4145-98bb-f1f6df46b01e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:17.209402 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 107/215] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:56:17 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:56:17.271172 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d6234-825b-4470-93ea-b69fd9b8e546 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:17.293083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:17.318441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7151b61-59f9-4575-bb0c-43b4eaf7736d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:17.319123 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7151b61-59f9-4575-bb0c-43b4eaf7736d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:17.319404 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7151b61-59f9-4575-bb0c-43b4eaf7736d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:17.319680 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7151b61-59f9-4575-bb0c-43b4eaf7736d None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:17.320452 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7151b61-59f9-4575-bb0c-43b4eaf7736d None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:17.320758 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7151b61-59f9-4575-bb0c-43b4eaf7736d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:17.322254 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7151b61-59f9-4575-bb0c-43b4eaf7736d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:17.332420 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 109/216] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:17.338548 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607f8b7-c205-4145-98bb-f1f6df46b01e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:17.446787 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607f8b7-c205-4145-98bb-f1f6df46b01e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:17.483886 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7a1bc-89ad-4b08-b629-3c8fa1ba22d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:17.484683 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a1bc-89ad-4b08-b629-3c8fa1ba22d5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:17.484960 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a1bc-89ad-4b08-b629-3c8fa1ba22d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:17.485229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a1bc-89ad-4b08-b629-3c8fa1ba22d5 None admin] PATH_INFO: `/v3/users/908c9156d4d44d1db4a0c4bf5ff9ab2d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:17.499258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7a1bc-89ad-4b08-b629-3c8fa1ba22d5 None admin] RBAC: Authorizing `identity:get_user(user_id=908c9156d4d44d1db4a0c4bf5ff9ab2d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:17.500888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7a1bc-89ad-4b08-b629-3c8fa1ba22d5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:17.502969 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 108/217] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:17 2022] GET /identity/v3/users/908c9156d4d44d1db4a0c4bf5ff9ab2d => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:17.508553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7151b61-59f9-4575-bb0c-43b4eaf7736d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:17.626147 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7151b61-59f9-4575-bb0c-43b4eaf7736d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:17.633391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640e947-4c8d-4783-a4fb-228f3b6a9fc1 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:17.633391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640e947-4c8d-4783-a4fb-228f3b6a9fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:17.633391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640e947-4c8d-4783-a4fb-228f3b6a9fc1 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:17.635103 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 109/218] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:17.641690 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd4535-3da3-40d0-b0ba-256b372e10dd None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:17.642027 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd4535-3da3-40d0-b0ba-256b372e10dd None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:17.642325 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd4535-3da3-40d0-b0ba-256b372e10dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:17.663079 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-45bd4535-3da3-40d0-b0ba-256b372e10dd None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:17.665143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-45bd4535-3da3-40d0-b0ba-256b372e10dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:17.669286 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5048a1d-8b0c-4718-910c-1a7921ef0b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:17.670001 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5048a1d-8b0c-4718-910c-1a7921ef0b75 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:17.670281 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5048a1d-8b0c-4718-910c-1a7921ef0b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:17.670553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5048a1d-8b0c-4718-910c-1a7921ef0b75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:17.676633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:17.722470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:17.753126 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5048a1d-8b0c-4718-910c-1a7921ef0b75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:17.754569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5048a1d-8b0c-4718-910c-1a7921ef0b75 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:17.763834 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 110/219] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:17.786412 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd4535-3da3-40d0-b0ba-256b372e10dd None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:17.864242 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 110/220] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 10:56:17.870445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5048a1d-8b0c-4718-910c-1a7921ef0b75 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:17.890247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd4535-3da3-40d0-b0ba-256b372e10dd None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:17.924811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da0029-4a6d-4c00-90f2-d0ff6df79016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:17.925626 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da0029-4a6d-4c00-90f2-d0ff6df79016 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:17.925905 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da0029-4a6d-4c00-90f2-d0ff6df79016 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:17.926173 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da0029-4a6d-4c00-90f2-d0ff6df79016 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:17.938185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da0029-4a6d-4c00-90f2-d0ff6df79016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:17.946622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-e8da0029-4a6d-4c00-90f2-d0ff6df79016 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:56:17.946622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:17.946622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:17.946622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:17.946622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:17.946622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:17.946622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:17.946622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:17.946622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:17.946622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:17.946622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:17.946622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:17.946622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:17.946622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:17.946622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:17.946622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:17.947544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:17.947544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:17.947544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:17.947544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:17.947544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:17.947544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:17.947544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:17.947544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:17.947544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:17.947544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:17.947544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:17.947544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:17.947544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:17.947544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:17.947544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:17.947544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:17.948334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:17.948334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:17.948334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:17.948334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:17.948334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:17.948334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:17.948334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:17.948334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:17.948334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:17.948334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:17.948334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:56:17.948334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:17.950218 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 111/221] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:56:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:17.953126 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:17.955209 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062da5cc-bbaf-4cf3-8bc4-d700702f81dc None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:17.956481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062da5cc-bbaf-4cf3-8bc4-d700702f81dc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:17.956481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062da5cc-bbaf-4cf3-8bc4-d700702f81dc None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:17.957575 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 112/222] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:17.958373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062da5cc-bbaf-4cf3-8bc4-d700702f81dc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:17.962961 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:17.978811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5048a1d-8b0c-4718-910c-1a7921ef0b75 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:18.017958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454ea4e-2106-4f03-8999-e356d68331bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:18.018739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454ea4e-2106-4f03-8999-e356d68331bc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:18.019021 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454ea4e-2106-4f03-8999-e356d68331bc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:18.019293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454ea4e-2106-4f03-8999-e356d68331bc None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:18.020686 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454ea4e-2106-4f03-8999-e356d68331bc None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:18.022188 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454ea4e-2106-4f03-8999-e356d68331bc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:18.024426 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 111/223] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:17 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:18.025763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae3a46-7798-4316-8a64-f860dda178ae None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:18.026053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae3a46-7798-4316-8a64-f860dda178ae None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:18.026428 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae3a46-7798-4316-8a64-f860dda178ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:18.043998 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-75ae3a46-7798-4316-8a64-f860dda178ae None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:18.045173 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-75ae3a46-7798-4316-8a64-f860dda178ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:18.066214 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062da5cc-bbaf-4cf3-8bc4-d700702f81dc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:18.101201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94c61b-57a1-4f1f-8dd8-16c32b354072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:18.101906 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94c61b-57a1-4f1f-8dd8-16c32b354072 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:18.102234 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94c61b-57a1-4f1f-8dd8-16c32b354072 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:18.102513 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94c61b-57a1-4f1f-8dd8-16c32b354072 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:18.103936 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94c61b-57a1-4f1f-8dd8-16c32b354072 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:18.104237 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94c61b-57a1-4f1f-8dd8-16c32b354072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:18.105676 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94c61b-57a1-4f1f-8dd8-16c32b354072 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:18.114791 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 113/224] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:18.117822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 112/225] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:18.120092 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94c61b-57a1-4f1f-8dd8-16c32b354072 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:18.120262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae3a46-7798-4316-8a64-f860dda178ae None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:18.198164 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:18.213541 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:18.238952 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94c61b-57a1-4f1f-8dd8-16c32b354072 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:18.252484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae3a46-7798-4316-8a64-f860dda178ae None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:18.274467 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ed818-8398-41a6-a5cf-26fd65100f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:18.275659 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ed818-8398-41a6-a5cf-26fd65100f89 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:18.275942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ed818-8398-41a6-a5cf-26fd65100f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:18.276204 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ed818-8398-41a6-a5cf-26fd65100f89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:18.277030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ed818-8398-41a6-a5cf-26fd65100f89 None admin] RBAC: Adding query filter params (role.id=2c7768e02a39438fbe2c3551ff3b19a4, scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b, user.id=908c9156d4d44d1db4a0c4bf5ff9ab2d) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:18.277333 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ed818-8398-41a6-a5cf-26fd65100f89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:18.278886 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ed818-8398-41a6-a5cf-26fd65100f89 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:18.284769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 114/226] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:18 2022] GET /identity/v3/role_assignments?user.id=908c9156d4d44d1db4a0c4bf5ff9ab2d&scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b&role.id=2c7768e02a39438fbe2c3551ff3b19a4 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:18.285667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ed818-8398-41a6-a5cf-26fd65100f89 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:18.298918 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3315c8-efca-4c3a-9817-d0c5f975ab01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:18.300136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3315c8-efca-4c3a-9817-d0c5f975ab01 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:18.300422 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3315c8-efca-4c3a-9817-d0c5f975ab01 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:18.300781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3315c8-efca-4c3a-9817-d0c5f975ab01 None admin] PATH_INFO: `/v3/users/1e4ad54f93b04182a2003c8fe2671030` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:18.302810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3315c8-efca-4c3a-9817-d0c5f975ab01 None admin] RBAC: Authorizing `identity:get_user(user_id=1e4ad54f93b04182a2003c8fe2671030)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:18.304658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3315c8-efca-4c3a-9817-d0c5f975ab01 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:18.307414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 113/227] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:18 2022] GET /identity/v3/users/1e4ad54f93b04182a2003c8fe2671030 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:18.318493 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3315c8-efca-4c3a-9817-d0c5f975ab01 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:18.477604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3315c8-efca-4c3a-9817-d0c5f975ab01 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:18.492129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ed818-8398-41a6-a5cf-26fd65100f89 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:18.516815 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f5ba9-8438-469b-a35d-0b821782e848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:18.517730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f5ba9-8438-469b-a35d-0b821782e848 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:18.518010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f5ba9-8438-469b-a35d-0b821782e848 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:18.518380 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f5ba9-8438-469b-a35d-0b821782e848 None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:18.519601 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f5ba9-8438-469b-a35d-0b821782e848 None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:18.521049 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f5ba9-8438-469b-a35d-0b821782e848 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:18.523156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 114/228] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:18 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:18.528710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:18.530338 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f5ba9-8438-469b-a35d-0b821782e848 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:18.532321 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8647242-9915-4203-b9b6-d59731edef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:18.533297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647242-9915-4203-b9b6-d59731edef6a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:18.533917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647242-9915-4203-b9b6-d59731edef6a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:18.534447 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647242-9915-4203-b9b6-d59731edef6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:18.542664 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:18.547175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8647242-9915-4203-b9b6-d59731edef6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:18.556064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-d8647242-9915-4203-b9b6-d59731edef6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:18.556064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:18.556064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:18.556064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:18.556064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:18.556064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:18.556064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:18.556064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:18.556064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:18.556064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:18.556064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:18.556064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:18.556064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:18.556064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:18.556064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:18.556064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:18.556985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:18.556985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:18.556985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:18.556985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:18.556985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:18.556985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:18.556985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:18.556985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:18.556985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:18.556985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:18.556985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:18.556985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:18.556985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:18.556985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:18.556985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:18.556985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:18.557831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:18.557831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:18.557831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:18.557831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:18.557831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:18.557831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:18.557831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:18.557831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:18.557831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:18.557831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:18.557831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:18.557831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:18.560491 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 115/229] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:56:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:18.566411 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8647242-9915-4203-b9b6-d59731edef6a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:18.641209 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f5ba9-8438-469b-a35d-0b821782e848 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:18.673798 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8647242-9915-4203-b9b6-d59731edef6a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:18.680736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caec25-481e-4781-aedd-0e364e8f0fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:18.681731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caec25-481e-4781-aedd-0e364e8f0fbb None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:18.682011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caec25-481e-4781-aedd-0e364e8f0fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:18.682287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caec25-481e-4781-aedd-0e364e8f0fbb None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b/users/1e4ad54f93b04182a2003c8fe2671030/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:18.684818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caec25-481e-4781-aedd-0e364e8f0fbb None admin] RBAC: Authorizing `identity:create_grant(project_id=da939275ad904ac98f1c2ad9e6fdc28b, user_id=1e4ad54f93b04182a2003c8fe2671030, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:18.686475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caec25-481e-4781-aedd-0e364e8f0fbb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:18.702280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 115/230] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:56:18 2022] PUT /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b/users/1e4ad54f93b04182a2003c8fe2671030/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:56:18.715531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae9555-e2f4-4fed-85d9-5147517a947a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:18.716589 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae9555-e2f4-4fed-85d9-5147517a947a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:18.717144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae9555-e2f4-4fed-85d9-5147517a947a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:18.717660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae9555-e2f4-4fed-85d9-5147517a947a None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:18.718730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae9555-e2f4-4fed-85d9-5147517a947a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:18.719257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae9555-e2f4-4fed-85d9-5147517a947a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:18.720991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae9555-e2f4-4fed-85d9-5147517a947a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:18.731443 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 116/231] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:56:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:18.737644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caec25-481e-4781-aedd-0e364e8f0fbb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:18.826814 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:18.872531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caec25-481e-4781-aedd-0e364e8f0fbb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:18.914815 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3904d97-9c0c-4334-82b8-f8685b377fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:18.915732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904d97-9c0c-4334-82b8-f8685b377fdb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:18.916010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904d97-9c0c-4334-82b8-f8685b377fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:18.916272 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904d97-9c0c-4334-82b8-f8685b377fdb None admin] PATH_INFO: `/v3/users/1e4ad54f93b04182a2003c8fe2671030` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:18.917553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3904d97-9c0c-4334-82b8-f8685b377fdb None admin] RBAC: Authorizing `identity:get_user(user_id=1e4ad54f93b04182a2003c8fe2671030)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:18.919024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3904d97-9c0c-4334-82b8-f8685b377fdb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:18.920662 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 116/232] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:18 2022] GET /identity/v3/users/1e4ad54f93b04182a2003c8fe2671030 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:18.926198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae9555-e2f4-4fed-85d9-5147517a947a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:18.987324 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:19.036683 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae9555-e2f4-4fed-85d9-5147517a947a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:19.073172 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee4d0f-f017-4e6f-a562-503a282302a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:19.074071 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee4d0f-f017-4e6f-a562-503a282302a6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:19.074409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee4d0f-f017-4e6f-a562-503a282302a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:19.074689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee4d0f-f017-4e6f-a562-503a282302a6 None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:19.075873 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee4d0f-f017-4e6f-a562-503a282302a6 None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:19.077456 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee4d0f-f017-4e6f-a562-503a282302a6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:19.079437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 117/233] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:18 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:19.085144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3904d97-9c0c-4334-82b8-f8685b377fdb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:19.212061 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3904d97-9c0c-4334-82b8-f8685b377fdb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:19.262649 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cad02-0584-4a62-832a-a475c13a6e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:19.263544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cad02-0584-4a62-832a-a475c13a6e8c None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:19.263879 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cad02-0584-4a62-832a-a475c13a6e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:19.264158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cad02-0584-4a62-832a-a475c13a6e8c None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b/users/1e4ad54f93b04182a2003c8fe2671030/roles/d6dae1fcff6641fcb71c0203d9c4e161` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:19.266441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874cad02-0584-4a62-832a-a475c13a6e8c None admin] RBAC: Authorizing `identity:create_grant(project_id=da939275ad904ac98f1c2ad9e6fdc28b, user_id=1e4ad54f93b04182a2003c8fe2671030, role_id=d6dae1fcff6641fcb71c0203d9c4e161)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:19.267933 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874cad02-0584-4a62-832a-a475c13a6e8c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:19.271197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:19.289840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 117/234] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:56:19 2022] PUT /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b/users/1e4ad54f93b04182a2003c8fe2671030/roles/d6dae1fcff6641fcb71c0203d9c4e161 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 10:56:19.868806 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee9104-25ee-4fe8-b670-bc4d3d13761a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:19.869311 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee9104-25ee-4fe8-b670-bc4d3d13761a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:19.869727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee9104-25ee-4fe8-b670-bc4d3d13761a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:19.871211 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 118/235] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:19.876494 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89ebd8-34e4-40aa-8bed-bdc991b709ce None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:19.876894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89ebd8-34e4-40aa-8bed-bdc991b709ce None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:19.877270 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89ebd8-34e4-40aa-8bed-bdc991b709ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:19.894667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ee89ebd8-34e4-40aa-8bed-bdc991b709ce None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:19.895987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ee89ebd8-34e4-40aa-8bed-bdc991b709ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:19.977495 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 118/236] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:20.013357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee9104-25ee-4fe8-b670-bc4d3d13761a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:20.051288 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b895ca-2983-48dd-98f1-881ba5f7468d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:20.051592 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b895ca-2983-48dd-98f1-881ba5f7468d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:20.051862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b895ca-2983-48dd-98f1-881ba5f7468d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:20.053498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 119/237] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:56:20.063374 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817601e9-90b5-463a-9d6f-8781ffa27d86 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:20.063666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817601e9-90b5-463a-9d6f-8781ffa27d86 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:20.063952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817601e9-90b5-463a-9d6f-8781ffa27d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:20.090466 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-817601e9-90b5-463a-9d6f-8781ffa27d86 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:20.091695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-817601e9-90b5-463a-9d6f-8781ffa27d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:20.145204 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee9104-25ee-4fe8-b670-bc4d3d13761a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:20.172127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:20.187113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdad48-9e71-4558-b430-efe3a1e8c70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:20.188051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdad48-9e71-4558-b430-efe3a1e8c70c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:20.188334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdad48-9e71-4558-b430-efe3a1e8c70c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:20.188609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdad48-9e71-4558-b430-efe3a1e8c70c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:20.202134 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdad48-9e71-4558-b430-efe3a1e8c70c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:20.210656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-09bdad48-9e71-4558-b430-efe3a1e8c70c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:20.210656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:20.210656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:20.210656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:20.210656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:20.210656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:20.210656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:20.210656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:20.210656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:20.210656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:20.210656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:20.210656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:20.210656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:20.210656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:20.210656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:20.210656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:20.211536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:20.211536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:20.211536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:20.211536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:20.211536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:20.211536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:20.211536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:20.211536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:20.211536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:20.211536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:20.211536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:20.211536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:20.211536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:20.211536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:20.211536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:20.211536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:20.212975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:20.212975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:20.212975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:20.212975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:20.212975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:20.212975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:20.212975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:20.212975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:20.212975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:20.212975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:20.212975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:20.212975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:20.212975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 119/238] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:20.222349 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdad48-9e71-4558-b430-efe3a1e8c70c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:20.226488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 120/239] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:20.270717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817601e9-90b5-463a-9d6f-8781ffa27d86 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:20.349437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:20.393259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdad48-9e71-4558-b430-efe3a1e8c70c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:20.397611 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817601e9-90b5-463a-9d6f-8781ffa27d86 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:20.433833 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dd0da-d02c-4a1d-a13e-4f6391fa73d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:20.435135 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dd0da-d02c-4a1d-a13e-4f6391fa73d1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:20.435629 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dd0da-d02c-4a1d-a13e-4f6391fa73d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:20.436094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dd0da-d02c-4a1d-a13e-4f6391fa73d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:20.437477 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dd0da-d02c-4a1d-a13e-4f6391fa73d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:20.439284 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dd0da-d02c-4a1d-a13e-4f6391fa73d1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:20.441585 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 121/240] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:20.447425 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dd0da-d02c-4a1d-a13e-4f6391fa73d1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:20.502080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150601b-ecb4-4495-bcc1-15939861e92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:20.502766 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150601b-ecb4-4495-bcc1-15939861e92f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:20.503056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150601b-ecb4-4495-bcc1-15939861e92f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:20.503339 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150601b-ecb4-4495-bcc1-15939861e92f None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:20.504103 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150601b-ecb4-4495-bcc1-15939861e92f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:20.504412 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150601b-ecb4-4495-bcc1-15939861e92f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:20.505837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150601b-ecb4-4495-bcc1-15939861e92f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:20.535317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 120/241] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:20.540774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150601b-ecb4-4495-bcc1-15939861e92f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:20.554746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dd0da-d02c-4a1d-a13e-4f6391fa73d1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:20.592747 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114480a-3162-4858-bab1-00335bf2d95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:20.593825 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114480a-3162-4858-bab1-00335bf2d95a None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:20.594330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114480a-3162-4858-bab1-00335bf2d95a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:20.595042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114480a-3162-4858-bab1-00335bf2d95a None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:20.595934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114480a-3162-4858-bab1-00335bf2d95a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:20.597594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114480a-3162-4858-bab1-00335bf2d95a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:20.601881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:20.629301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 122/242] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:56:20 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:56:20.650989 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:20.716624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150601b-ecb4-4495-bcc1-15939861e92f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:20.768575 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba58458-2c2f-453e-9e76-20425070ae0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:20.770018 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba58458-2c2f-453e-9e76-20425070ae0d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:20.770501 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba58458-2c2f-453e-9e76-20425070ae0d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:20.771244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba58458-2c2f-453e-9e76-20425070ae0d None admin] PATH_INFO: `/v3/users/db68714416df4c4ca5e15d6b22b25568` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:20.791928 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba58458-2c2f-453e-9e76-20425070ae0d None admin] RBAC: Authorizing `identity:get_user(user_id=db68714416df4c4ca5e15d6b22b25568)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:20.793785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba58458-2c2f-453e-9e76-20425070ae0d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:20.796024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 121/243] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:20 2022] GET /identity/v3/users/db68714416df4c4ca5e15d6b22b25568 => generated 297 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:20.801767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114480a-3162-4858-bab1-00335bf2d95a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:20.924934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114480a-3162-4858-bab1-00335bf2d95a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:20.961684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17b396-021a-49ec-aa15-60f7bd790c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:20.962369 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17b396-021a-49ec-aa15-60f7bd790c9a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:20.962658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17b396-021a-49ec-aa15-60f7bd790c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:20.962937 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17b396-021a-49ec-aa15-60f7bd790c9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:21.016528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:21.022976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f9e49-1a4d-4266-85e4-53fa78d51656 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:21.023442 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f9e49-1a4d-4266-85e4-53fa78d51656 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:21.023541 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f9e49-1a4d-4266-85e4-53fa78d51656 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:21.025004 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 122/244] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:21.031070 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb0a04-118f-407b-8ba8-0d8f87e5f6ed None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:21.031623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb0a04-118f-407b-8ba8-0d8f87e5f6ed None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:21.032120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb0a04-118f-407b-8ba8-0d8f87e5f6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:21.038266 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17b396-021a-49ec-aa15-60f7bd790c9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:21.039407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17b396-021a-49ec-aa15-60f7bd790c9a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:21.053933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1acb0a04-118f-407b-8ba8-0d8f87e5f6ed None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:21.057030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1acb0a04-118f-407b-8ba8-0d8f87e5f6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:21.131801 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 123/245] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:21.156873 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb0a04-118f-407b-8ba8-0d8f87e5f6ed None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:21.157450 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 123/246] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:21.163807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17b396-021a-49ec-aa15-60f7bd790c9a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:21.202185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:21.267490 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:21.292639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb0a04-118f-407b-8ba8-0d8f87e5f6ed None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:21.297029 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17b396-021a-49ec-aa15-60f7bd790c9a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:21.330776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b3953-3592-4375-94ae-7cfca2f786cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:21.331931 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b3953-3592-4375-94ae-7cfca2f786cf None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:21.332407 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b3953-3592-4375-94ae-7cfca2f786cf None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:21.333634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b3953-3592-4375-94ae-7cfca2f786cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:21.341348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efe72d-feda-4a16-9329-f03c5a21c659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:21.342333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efe72d-feda-4a16-9329-f03c5a21c659 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:21.342885 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efe72d-feda-4a16-9329-f03c5a21c659 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:21.343241 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efe72d-feda-4a16-9329-f03c5a21c659 None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:21.344894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efe72d-feda-4a16-9329-f03c5a21c659 None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:21.346391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efe72d-feda-4a16-9329-f03c5a21c659 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:21.348335 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b3953-3592-4375-94ae-7cfca2f786cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:21.348840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 124/247] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:21 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:21.355795 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efe72d-feda-4a16-9329-f03c5a21c659 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:21.357871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-890b3953-3592-4375-94ae-7cfca2f786cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:21.357871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:21.357871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:21.357871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:21.357871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:21.357871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:21.357871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:21.357871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:21.357871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:21.357871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:21.357871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:21.357871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:21.357871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:21.357871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:21.357871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:21.357871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:21.358810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:21.358810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:21.358810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:21.358810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:21.358810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:21.358810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:21.358810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:21.358810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:21.358810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:21.358810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:21.358810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:21.358810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:21.358810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:21.358810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:21.358810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:21.358810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:21.359593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:21.359593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:21.359593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:21.359593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:21.359593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:21.359593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:21.359593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:21.359593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:21.359593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:21.359593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:21.359593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:21.359593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:21.362261 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 124/248] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:21.368155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b3953-3592-4375-94ae-7cfca2f786cf None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:21.489488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b3953-3592-4375-94ae-7cfca2f786cf None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:21.492941 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efe72d-feda-4a16-9329-f03c5a21c659 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:21.515166 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:21.532056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f192379-576d-410d-a54f-cea6d847af11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:21.533235 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f192379-576d-410d-a54f-cea6d847af11 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:21.534826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f192379-576d-410d-a54f-cea6d847af11 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:21.535999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f192379-576d-410d-a54f-cea6d847af11 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:21.537545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f192379-576d-410d-a54f-cea6d847af11 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:21.538210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f192379-576d-410d-a54f-cea6d847af11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:21.540724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f192379-576d-410d-a54f-cea6d847af11 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:21.545644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8a50b-c9b8-4d90-be3c-ed18e2f5ef97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:21.547323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8a50b-c9b8-4d90-be3c-ed18e2f5ef97 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:21.547810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8a50b-c9b8-4d90-be3c-ed18e2f5ef97 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:21.551081 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8a50b-c9b8-4d90-be3c-ed18e2f5ef97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:21.552171 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8a50b-c9b8-4d90-be3c-ed18e2f5ef97 None admin] RBAC: Adding query filter params (role.id=6f15d5ee845e4facaee3e8b8d247dd28, scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b, user.id=db68714416df4c4ca5e15d6b22b25568) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:21.552702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8a50b-c9b8-4d90-be3c-ed18e2f5ef97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:21.554392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8a50b-c9b8-4d90-be3c-ed18e2f5ef97 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:21.559652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 125/249] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:21.562297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce86dfb-6c0d-4e85-9ca6-a01f1b8264ed None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:21.567945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce86dfb-6c0d-4e85-9ca6-a01f1b8264ed None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:21.570223 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce86dfb-6c0d-4e85-9ca6-a01f1b8264ed None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:21.572328 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 126/250] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:21.572749 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 125/251] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:21 2022] GET /identity/v3/role_assignments?user.id=db68714416df4c4ca5e15d6b22b25568&scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b&role.id=6f15d5ee845e4facaee3e8b8d247dd28 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:21.573847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8a50b-c9b8-4d90-be3c-ed18e2f5ef97 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:21.578247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5ea47-2f60-408e-bb5a-b5dfac002606 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:21.578833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5ea47-2f60-408e-bb5a-b5dfac002606 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:21.579345 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5ea47-2f60-408e-bb5a-b5dfac002606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:21.606797 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:21.607302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1ef5ea47-2f60-408e-bb5a-b5dfac002606 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:21.608519 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1ef5ea47-2f60-408e-bb5a-b5dfac002606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:21.776065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 127/252] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:21.808257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8a50b-c9b8-4d90-be3c-ed18e2f5ef97 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:21.825261 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5ea47-2f60-408e-bb5a-b5dfac002606 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:21.850471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e9968-b0cd-478e-b974-d24676a616f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:21.852880 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e9968-b0cd-478e-b974-d24676a616f3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:21.854996 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e9968-b0cd-478e-b974-d24676a616f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:21.855484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e9968-b0cd-478e-b974-d24676a616f3 None admin] PATH_INFO: `/v3/users/908c9156d4d44d1db4a0c4bf5ff9ab2d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:21.857712 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e9968-b0cd-478e-b974-d24676a616f3 None admin] RBAC: Authorizing `identity:get_user(user_id=908c9156d4d44d1db4a0c4bf5ff9ab2d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:21.859807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e9968-b0cd-478e-b974-d24676a616f3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:21.865645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 126/253] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:21 2022] GET /identity/v3/users/908c9156d4d44d1db4a0c4bf5ff9ab2d => generated 297 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:21.871731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e9968-b0cd-478e-b974-d24676a616f3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:21.961244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:21.987707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5ea47-2f60-408e-bb5a-b5dfac002606 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:22.014042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:22.030853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9072b98-6f36-4af9-9d98-0efb8221ce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:22.032322 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9072b98-6f36-4af9-9d98-0efb8221ce69 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:22.032823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9072b98-6f36-4af9-9d98-0efb8221ce69 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:22.033303 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9072b98-6f36-4af9-9d98-0efb8221ce69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:22.052183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9072b98-6f36-4af9-9d98-0efb8221ce69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:22.058757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e9968-b0cd-478e-b974-d24676a616f3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:22.064804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-c9072b98-6f36-4af9-9d98-0efb8221ce69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:56:22.064804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:22.064804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:22.064804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:22.064804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:22.064804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:22.064804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:22.064804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:22.064804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:22.064804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:22.064804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:22.064804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:22.064804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:22.064804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:22.064804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:22.064804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:22.065744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:22.065744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:22.065744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:22.065744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:22.065744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:22.065744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:22.065744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:22.065744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:22.065744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:22.065744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:22.065744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:22.065744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:22.065744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:22.065744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:22.065744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:22.065744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:22.066557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:22.066557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:22.066557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:22.066557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:22.066557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:22.066557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:22.066557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:22.066557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:22.066557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:22.066557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:22.066557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:56:22.066557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:22.075563 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 128/254] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:56:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:22.077843 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378dd01-6e89-4e2c-8f31-22edfb22a7fa None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:22.079566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378dd01-6e89-4e2c-8f31-22edfb22a7fa None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:22.080603 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378dd01-6e89-4e2c-8f31-22edfb22a7fa None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:22.082925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 129/255] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:22.084809 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378dd01-6e89-4e2c-8f31-22edfb22a7fa None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:22.130141 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd414942-53f5-4df8-a2f7-4121826a9746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:22.131355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd414942-53f5-4df8-a2f7-4121826a9746 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:22.132804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd414942-53f5-4df8-a2f7-4121826a9746 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:22.133304 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd414942-53f5-4df8-a2f7-4121826a9746 None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:22.135510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd414942-53f5-4df8-a2f7-4121826a9746 None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:22.138061 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd414942-53f5-4df8-a2f7-4121826a9746 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:22.142313 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 127/256] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:21 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:22.146050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5794c-f8cc-4bb6-a718-40d9ff5fc8de None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:22.146879 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5794c-f8cc-4bb6-a718-40d9ff5fc8de None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:22.147362 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5794c-f8cc-4bb6-a718-40d9ff5fc8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:22.178245 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8ef5794c-f8cc-4bb6-a718-40d9ff5fc8de None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:22.182634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8ef5794c-f8cc-4bb6-a718-40d9ff5fc8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:22.279924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378dd01-6e89-4e2c-8f31-22edfb22a7fa None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:22.323916 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 128/257] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:22.324744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5794c-f8cc-4bb6-a718-40d9ff5fc8de None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:22.349196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d24dc-a870-4a56-b5b4-79378807310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:22.349958 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d24dc-a870-4a56-b5b4-79378807310f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:22.350237 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d24dc-a870-4a56-b5b4-79378807310f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:22.350506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d24dc-a870-4a56-b5b4-79378807310f None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:22.354274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d24dc-a870-4a56-b5b4-79378807310f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:22.354597 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d24dc-a870-4a56-b5b4-79378807310f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:22.357641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d24dc-a870-4a56-b5b4-79378807310f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:22.388285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 130/258] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:22.389191 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d24dc-a870-4a56-b5b4-79378807310f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:22.397543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:22.509801 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:22.542481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d24dc-a870-4a56-b5b4-79378807310f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:22.551326 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5794c-f8cc-4bb6-a718-40d9ff5fc8de None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:22.591286 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c74190-4e96-4b0d-a90c-61c5402a45df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:22.592076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c74190-4e96-4b0d-a90c-61c5402a45df None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:22.592390 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c74190-4e96-4b0d-a90c-61c5402a45df None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:22.592621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c74190-4e96-4b0d-a90c-61c5402a45df None admin] PATH_INFO: `/v3/users/1e4ad54f93b04182a2003c8fe2671030` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:22.596607 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c74190-4e96-4b0d-a90c-61c5402a45df None admin] RBAC: Authorizing `identity:get_user(user_id=1e4ad54f93b04182a2003c8fe2671030)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:22.599031 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c74190-4e96-4b0d-a90c-61c5402a45df None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:22.600671 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 131/259] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:22 2022] GET /identity/v3/users/1e4ad54f93b04182a2003c8fe2671030 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:22.610985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c74190-4e96-4b0d-a90c-61c5402a45df None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:22.625770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae03848-f032-4133-b6c0-48d719af61d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:22.626714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae03848-f032-4133-b6c0-48d719af61d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:22.626992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae03848-f032-4133-b6c0-48d719af61d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:22.627269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae03848-f032-4133-b6c0-48d719af61d4 None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b/users/908c9156d4d44d1db4a0c4bf5ff9ab2d/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:22.630271 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae03848-f032-4133-b6c0-48d719af61d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=da939275ad904ac98f1c2ad9e6fdc28b, user_id=908c9156d4d44d1db4a0c4bf5ff9ab2d, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:22.632641 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae03848-f032-4133-b6c0-48d719af61d4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:22.658415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 129/260] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:56:22 2022] PUT /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b/users/908c9156d4d44d1db4a0c4bf5ff9ab2d/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:56:22.659347 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae03848-f032-4133-b6c0-48d719af61d4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:22.781777 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:22.825572 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c74190-4e96-4b0d-a90c-61c5402a45df None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:22.889829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae03848-f032-4133-b6c0-48d719af61d4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:22.914709 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe34e69-3622-4999-ac3b-5927d1f78d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:22.916447 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe34e69-3622-4999-ac3b-5927d1f78d6a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:22.916937 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe34e69-3622-4999-ac3b-5927d1f78d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:22.917425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe34e69-3622-4999-ac3b-5927d1f78d6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:22.935897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe34e69-3622-4999-ac3b-5927d1f78d6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:22.945024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-efe34e69-3622-4999-ac3b-5927d1f78d6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:22.945024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:22.945024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:22.945024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:22.945024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:22.945024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:22.945024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:22.945024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:22.945024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:22.945024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:22.945024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:22.945024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:22.945024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:22.945024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:22.945024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:22.945024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:22.946198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:22.946198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:22.946198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:22.946198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:22.946198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:22.946198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:22.946198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:22.946198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:22.946198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:22.946198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:22.946198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:22.946198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:22.946198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:22.946198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:22.946198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:22.946198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:22.948142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:22.948142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:22.948142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:22.948142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:22.948142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:22.948142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:22.948142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:22.948142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:22.948142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:22.948142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:22.948142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:22.948142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:22.948142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 132/261] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:56:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:22.953739 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe34e69-3622-4999-ac3b-5927d1f78d6a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:23.018067 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd03bf-e1a9-46a3-bde9-c318a39e7507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:23.018730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd03bf-e1a9-46a3-bde9-c318a39e7507 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:23.019018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd03bf-e1a9-46a3-bde9-c318a39e7507 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:23.019299 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd03bf-e1a9-46a3-bde9-c318a39e7507 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:23.029502 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:23.155120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe34e69-3622-4999-ac3b-5927d1f78d6a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:23.198541 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd03bf-e1a9-46a3-bde9-c318a39e7507 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:23.200045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd03bf-e1a9-46a3-bde9-c318a39e7507 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:23.226387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:23.239430 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aed64-384c-48c4-aa39-85a5efd28e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:23.240103 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aed64-384c-48c4-aa39-85a5efd28e2b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:23.240383 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aed64-384c-48c4-aa39-85a5efd28e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:23.240653 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aed64-384c-48c4-aa39-85a5efd28e2b None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:23.248696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4aed64-384c-48c4-aa39-85a5efd28e2b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:23.248696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4aed64-384c-48c4-aa39-85a5efd28e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:23.248696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4aed64-384c-48c4-aa39-85a5efd28e2b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:23.273548 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 133/262] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:56:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:23.274457 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aed64-384c-48c4-aa39-85a5efd28e2b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:23.466405 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aed64-384c-48c4-aa39-85a5efd28e2b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:23.478326 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 130/263] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 819 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:23.490546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd03bf-e1a9-46a3-bde9-c318a39e7507 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:23.537476 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802f5a7-4132-493e-9797-87d02c40ea8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:23.538379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802f5a7-4132-493e-9797-87d02c40ea8e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:23.538659 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802f5a7-4132-493e-9797-87d02c40ea8e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:23.538930 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802f5a7-4132-493e-9797-87d02c40ea8e None admin] PATH_INFO: `/v3/users/1e4ad54f93b04182a2003c8fe2671030` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:23.540238 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802f5a7-4132-493e-9797-87d02c40ea8e None admin] RBAC: Authorizing `identity:get_user(user_id=1e4ad54f93b04182a2003c8fe2671030)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:23.542089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802f5a7-4132-493e-9797-87d02c40ea8e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:23.543898 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 134/264] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:23 2022] GET /identity/v3/users/1e4ad54f93b04182a2003c8fe2671030 => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:23.557819 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802f5a7-4132-493e-9797-87d02c40ea8e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:23.579396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:23.672648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd03bf-e1a9-46a3-bde9-c318a39e7507 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:23.673291 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:23.740106 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f881549-8a85-4a59-bae0-efb0a78a8daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:23.741728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802f5a7-4132-493e-9797-87d02c40ea8e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:23.744434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f881549-8a85-4a59-bae0-efb0a78a8daa None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:23.744720 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f881549-8a85-4a59-bae0-efb0a78a8daa None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:23.744992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f881549-8a85-4a59-bae0-efb0a78a8daa None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:23.747056 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f881549-8a85-4a59-bae0-efb0a78a8daa None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:23.748436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f881549-8a85-4a59-bae0-efb0a78a8daa None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:23.754732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 131/265] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:23 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:23.755984 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468e9fd-fc16-44b6-a712-86aa3042fd58 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:23.756265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468e9fd-fc16-44b6-a712-86aa3042fd58 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:23.756528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468e9fd-fc16-44b6-a712-86aa3042fd58 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:23.764697 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 132/266] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:23.765315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468e9fd-fc16-44b6-a712-86aa3042fd58 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:23.805679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc294c-a94f-41a5-9d9e-55f8ea490d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:23.806988 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc294c-a94f-41a5-9d9e-55f8ea490d71 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:23.807279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc294c-a94f-41a5-9d9e-55f8ea490d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:23.807559 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc294c-a94f-41a5-9d9e-55f8ea490d71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:23.887381 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468e9fd-fc16-44b6-a712-86aa3042fd58 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:23.892917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc294c-a94f-41a5-9d9e-55f8ea490d71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:23.894435 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc294c-a94f-41a5-9d9e-55f8ea490d71 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:23.896440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:23.937102 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48e34d-b804-4f61-8ae6-12bba34d67b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:23.938036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48e34d-b804-4f61-8ae6-12bba34d67b8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:23.938468 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48e34d-b804-4f61-8ae6-12bba34d67b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:23.938894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48e34d-b804-4f61-8ae6-12bba34d67b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:23.941118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48e34d-b804-4f61-8ae6-12bba34d67b8 None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b, user.id=1e4ad54f93b04182a2003c8fe2671030) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:23.941709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48e34d-b804-4f61-8ae6-12bba34d67b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:23.943319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48e34d-b804-4f61-8ae6-12bba34d67b8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:23.951795 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 133/267] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:23 2022] GET /identity/v3/role_assignments?user.id=1e4ad54f93b04182a2003c8fe2671030&scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:23.953849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738e55-3c35-4d7d-94ba-d775c26959d9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:23.954289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738e55-3c35-4d7d-94ba-d775c26959d9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:23.954734 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738e55-3c35-4d7d-94ba-d775c26959d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:23.993243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-07738e55-3c35-4d7d-94ba-d775c26959d9 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:23.995330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-07738e55-3c35-4d7d-94ba-d775c26959d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:23.995779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:24.072593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 135/268] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 10:56:24.074567 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdc5b7-3fad-4b63-9b8a-e3ac0a9d5628 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:24.075467 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdc5b7-3fad-4b63-9b8a-e3ac0a9d5628 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:24.076052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdc5b7-3fad-4b63-9b8a-e3ac0a9d5628 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:24.082413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 136/269] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:24.083607 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdc5b7-3fad-4b63-9b8a-e3ac0a9d5628 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:24.146117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 134/270] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:24.147397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882df288-fe18-4298-9bf4-c76ef0bc681e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:24.147682 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882df288-fe18-4298-9bf4-c76ef0bc681e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:24.147957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882df288-fe18-4298-9bf4-c76ef0bc681e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:24.167233 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-882df288-fe18-4298-9bf4-c76ef0bc681e None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:24.168174 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-882df288-fe18-4298-9bf4-c76ef0bc681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:24.222903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdc5b7-3fad-4b63-9b8a-e3ac0a9d5628 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:24.243461 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 135/271] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:24.247305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e17897-ba8b-4555-80cd-598b92872297 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:24.247305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e17897-ba8b-4555-80cd-598b92872297 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:24.247305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e17897-ba8b-4555-80cd-598b92872297 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:24.247305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 136/272] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:24.247609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e17897-ba8b-4555-80cd-598b92872297 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:24.272640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb3119-9f8b-4528-b060-d35d77ec120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:24.273762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb3119-9f8b-4528-b060-d35d77ec120c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:24.275274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb3119-9f8b-4528-b060-d35d77ec120c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:24.275699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb3119-9f8b-4528-b060-d35d77ec120c None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:24.277698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb3119-9f8b-4528-b060-d35d77ec120c None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:24.279993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb3119-9f8b-4528-b060-d35d77ec120c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:24.282901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 137/273] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:24 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:24.283550 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:24.286335 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f36dcf-7214-49bd-94f4-1dd06797f933 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:24.286904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f36dcf-7214-49bd-94f4-1dd06797f933 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:24.287716 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f36dcf-7214-49bd-94f4-1dd06797f933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:24.306838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e7f36dcf-7214-49bd-94f4-1dd06797f933 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:24.308031 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e7f36dcf-7214-49bd-94f4-1dd06797f933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:24.331027 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:24.364192 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e17897-ba8b-4555-80cd-598b92872297 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:24.389396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 138/274] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:24.389396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f36dcf-7214-49bd-94f4-1dd06797f933 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:24.409824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74201092-aa9a-4b6d-b747-1abffa8dc3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:24.410733 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74201092-aa9a-4b6d-b747-1abffa8dc3ec None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:24.411095 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74201092-aa9a-4b6d-b747-1abffa8dc3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:24.411434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74201092-aa9a-4b6d-b747-1abffa8dc3ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:24.423329 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74201092-aa9a-4b6d-b747-1abffa8dc3ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:24.431091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-74201092-aa9a-4b6d-b747-1abffa8dc3ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:24.431091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:24.431091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:24.431091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:24.431091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:24.431091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:24.431091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:24.431091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:24.431091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:24.431091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:24.431091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:24.431091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:24.431091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:24.431091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:24.431091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:24.431091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:24.431966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:24.431966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:24.431966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:24.431966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:24.431966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:24.431966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:24.431966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:24.431966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:24.431966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:24.431966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:24.431966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:24.431966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:24.431966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:24.431966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:24.431966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:24.431966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:24.432759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:24.432759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:24.432759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:24.432759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:24.432759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:24.432759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:24.432759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:24.432759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:24.432759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:24.432759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:24.432759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:24.432759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:24.432759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 137/275] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:24.433458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74201092-aa9a-4b6d-b747-1abffa8dc3ec None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:24.498530 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f36dcf-7214-49bd-94f4-1dd06797f933 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:24.522679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:24.533535 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74201092-aa9a-4b6d-b747-1abffa8dc3ec None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:24.534298 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422866b-840d-4b64-8e0f-3b07f177322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:24.535406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422866b-840d-4b64-8e0f-3b07f177322c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:24.536585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422866b-840d-4b64-8e0f-3b07f177322c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:24.537027 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422866b-840d-4b64-8e0f-3b07f177322c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:24.538372 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422866b-840d-4b64-8e0f-3b07f177322c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:24.539958 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422866b-840d-4b64-8e0f-3b07f177322c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:24.542518 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 139/276] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:24.543785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422866b-840d-4b64-8e0f-3b07f177322c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:24.566272 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b334cf4-6798-4a29-9ace-5bd428c9c4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:24.566918 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b334cf4-6798-4a29-9ace-5bd428c9c4dd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:24.567197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b334cf4-6798-4a29-9ace-5bd428c9c4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:24.567467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b334cf4-6798-4a29-9ace-5bd428c9c4dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:24.568289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b334cf4-6798-4a29-9ace-5bd428c9c4dd None admin] RBAC: Adding query filter params (role.id=d6dae1fcff6641fcb71c0203d9c4e161, scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b, user.id=1e4ad54f93b04182a2003c8fe2671030) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:24.568617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b334cf4-6798-4a29-9ace-5bd428c9c4dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:24.570074 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b334cf4-6798-4a29-9ace-5bd428c9c4dd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:24.576431 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 138/277] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:24 2022] GET /identity/v3/role_assignments?user.id=1e4ad54f93b04182a2003c8fe2671030&scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b&role.id=d6dae1fcff6641fcb71c0203d9c4e161 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:24.577294 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b334cf4-6798-4a29-9ace-5bd428c9c4dd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:24.586735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:24.687504 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422866b-840d-4b64-8e0f-3b07f177322c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:24.697100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b334cf4-6798-4a29-9ace-5bd428c9c4dd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:24.727629 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79042d85-ab20-4698-8e4f-13aa16fa85f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:24.728818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79042d85-ab20-4698-8e4f-13aa16fa85f4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:24.729280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79042d85-ab20-4698-8e4f-13aa16fa85f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:24.729759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79042d85-ab20-4698-8e4f-13aa16fa85f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:24.735786 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d150b9-4289-4a45-99f9-d2a5e66ee2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:24.736561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d150b9-4289-4a45-99f9-d2a5e66ee2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:24.737776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d150b9-4289-4a45-99f9-d2a5e66ee2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:24.737776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d150b9-4289-4a45-99f9-d2a5e66ee2b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:24.738195 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d150b9-4289-4a45-99f9-d2a5e66ee2b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:24.738571 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d150b9-4289-4a45-99f9-d2a5e66ee2b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:24.740045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d150b9-4289-4a45-99f9-d2a5e66ee2b3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:24.743194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79042d85-ab20-4698-8e4f-13aa16fa85f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:24.749195 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 139/278] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:24.750021 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d150b9-4289-4a45-99f9-d2a5e66ee2b3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:24.755545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-79042d85-ab20-4698-8e4f-13aa16fa85f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:24.755545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:24.755545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:24.755545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:24.755545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:24.755545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:24.755545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:24.755545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:24.755545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:24.755545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:24.755545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:24.755545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:24.755545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:24.755545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:24.755545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:24.755545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:24.756448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:24.756448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:24.756448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:24.756448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:24.756448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:24.756448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:24.756448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:24.756448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:24.756448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:24.756448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:24.756448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:24.756448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:24.756448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:24.756448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:24.756448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:24.756448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:24.757231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:24.757231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:24.757231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:24.757231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:24.757231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:24.757231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:24.757231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:24.757231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:24.757231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:24.757231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:24.757231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:24.757231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:24.757857 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 140/279] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:24.759607 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79042d85-ab20-4698-8e4f-13aa16fa85f4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:24.775819 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:24.866724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:24.874220 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d150b9-4289-4a45-99f9-d2a5e66ee2b3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:24.880661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79042d85-ab20-4698-8e4f-13aa16fa85f4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:24.909205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff075bd-3f9e-4291-ab09-7369f93b6f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:24.909945 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff075bd-3f9e-4291-ab09-7369f93b6f54 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:24.910174 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff075bd-3f9e-4291-ab09-7369f93b6f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:24.910449 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff075bd-3f9e-4291-ab09-7369f93b6f54 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:24.911148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff075bd-3f9e-4291-ab09-7369f93b6f54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:24.912599 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff075bd-3f9e-4291-ab09-7369f93b6f54 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:24.916456 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2145d-789a-40e2-b2c5-0343d3ee43bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:24.917320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2145d-789a-40e2-b2c5-0343d3ee43bf None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:24.917648 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2145d-789a-40e2-b2c5-0343d3ee43bf None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:24.917925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2145d-789a-40e2-b2c5-0343d3ee43bf None admin] PATH_INFO: `/v3/users/10c42acd63dc4e3b8f8bde021d6211ae` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:24.933699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2145d-789a-40e2-b2c5-0343d3ee43bf None admin] RBAC: Authorizing `identity:get_user(user_id=10c42acd63dc4e3b8f8bde021d6211ae)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:24.935182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 140/280] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:56:24 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:56:24.935938 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff075bd-3f9e-4291-ab09-7369f93b6f54 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:24.945750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2145d-789a-40e2-b2c5-0343d3ee43bf None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:24.948289 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 141/281] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:24 2022] GET /identity/v3/users/10c42acd63dc4e3b8f8bde021d6211ae => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:24.963412 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2145d-789a-40e2-b2c5-0343d3ee43bf None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:25.033561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:25.069767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff075bd-3f9e-4291-ab09-7369f93b6f54 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:25.093217 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2145d-789a-40e2-b2c5-0343d3ee43bf None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:25.108128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d26c4-c4c7-4f30-8def-ba0391ea9a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:25.109404 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d26c4-c4c7-4f30-8def-ba0391ea9a2f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:25.110166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d26c4-c4c7-4f30-8def-ba0391ea9a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:25.110444 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d26c4-c4c7-4f30-8def-ba0391ea9a2f None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:25.111206 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d26c4-c4c7-4f30-8def-ba0391ea9a2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:25.111513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d26c4-c4c7-4f30-8def-ba0391ea9a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:25.112951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d26c4-c4c7-4f30-8def-ba0391ea9a2f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:25.122888 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 141/282] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:25.128397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d26c4-c4c7-4f30-8def-ba0391ea9a2f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:25.132990 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff551e-b02a-433f-94c3-e7093cef449a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:25.133895 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff551e-b02a-433f-94c3-e7093cef449a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:25.134889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff551e-b02a-433f-94c3-e7093cef449a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:25.135313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff551e-b02a-433f-94c3-e7093cef449a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:25.136557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff551e-b02a-433f-94c3-e7093cef449a None admin] RBAC: Adding query filter params (role.id=2c7768e02a39438fbe2c3551ff3b19a4, user.id=10c42acd63dc4e3b8f8bde021d6211ae, scope.system=all) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:25.136875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff551e-b02a-433f-94c3-e7093cef449a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:25.138781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff551e-b02a-433f-94c3-e7093cef449a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:25.145490 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 142/283] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Jun 27 10:56:24 2022] GET /identity/v3/role_assignments?user.id=10c42acd63dc4e3b8f8bde021d6211ae&scope.system=all&role.id=2c7768e02a39438fbe2c3551ff3b19a4 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:25.257389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d26c4-c4c7-4f30-8def-ba0391ea9a2f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:25.297291 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46daac-4093-4f4e-b23b-f8f325c7866f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:25.298262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46daac-4093-4f4e-b23b-f8f325c7866f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:25.298548 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46daac-4093-4f4e-b23b-f8f325c7866f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:25.298827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46daac-4093-4f4e-b23b-f8f325c7866f None admin] PATH_INFO: `/v3/users/db68714416df4c4ca5e15d6b22b25568` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:25.301121 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46daac-4093-4f4e-b23b-f8f325c7866f None admin] RBAC: Authorizing `identity:get_user(user_id=db68714416df4c4ca5e15d6b22b25568)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:25.302650 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46daac-4093-4f4e-b23b-f8f325c7866f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:25.304343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 142/284] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:25 2022] GET /identity/v3/users/db68714416df4c4ca5e15d6b22b25568 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:25.309048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaaf96-2ea4-4ac1-95cd-5f73c66267db None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:25.309548 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaaf96-2ea4-4ac1-95cd-5f73c66267db None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:25.309621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaaf96-2ea4-4ac1-95cd-5f73c66267db None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:25.311267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 143/285] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:25.312945 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46daac-4093-4f4e-b23b-f8f325c7866f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:25.315798 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:25.321153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a900887-6742-4f94-8456-cb53dbdcf942 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:25.321478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a900887-6742-4f94-8456-cb53dbdcf942 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:25.321789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a900887-6742-4f94-8456-cb53dbdcf942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:25.344531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8a900887-6742-4f94-8456-cb53dbdcf942 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:25.346144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8a900887-6742-4f94-8456-cb53dbdcf942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:25.349926 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:25.423542 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 144/286] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:25.442437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46daac-4093-4f4e-b23b-f8f325c7866f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:25.447458 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a900887-6742-4f94-8456-cb53dbdcf942 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:25.527162 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9a4d9-5a72-439f-9480-4dad9edd0194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:25.528380 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9a4d9-5a72-439f-9480-4dad9edd0194 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:25.528854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9a4d9-5a72-439f-9480-4dad9edd0194 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:25.529318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9a4d9-5a72-439f-9480-4dad9edd0194 None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:25.534118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9a4d9-5a72-439f-9480-4dad9edd0194 None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:25.535831 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9a4d9-5a72-439f-9480-4dad9edd0194 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:25.537855 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 143/287] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:25 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:25.543994 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9a4d9-5a72-439f-9480-4dad9edd0194 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:25.552488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a900887-6742-4f94-8456-cb53dbdcf942 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:25.589294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113bb21-57e7-4d3c-82cf-fc8dcf0ccd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:25.590154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113bb21-57e7-4d3c-82cf-fc8dcf0ccd72 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:25.590434 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113bb21-57e7-4d3c-82cf-fc8dcf0ccd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:25.590707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113bb21-57e7-4d3c-82cf-fc8dcf0ccd72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:25.598863 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:25.602562 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113bb21-57e7-4d3c-82cf-fc8dcf0ccd72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:25.611902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9113bb21-57e7-4d3c-82cf-fc8dcf0ccd72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:25.611902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:25.611902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:25.611902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:25.611902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:25.611902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:25.611902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:25.611902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:25.611902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:25.611902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:25.611902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:25.611902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:25.611902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:25.611902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:25.611902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:25.611902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:25.612793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:25.612793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:25.612793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:25.612793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:25.612793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:25.612793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:25.612793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:25.612793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:25.612793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:25.612793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:25.612793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:25.612793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:25.612793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:25.612793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:25.612793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:25.612793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:25.613614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:25.613614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:25.613614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:25.613614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:25.613614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:25.613614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:25.613614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:25.613614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:25.613614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:25.613614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:25.613614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:25.613614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:25.613614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 145/288] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:25.618853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113bb21-57e7-4d3c-82cf-fc8dcf0ccd72 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:25.630238 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:25.696065 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9a4d9-5a72-439f-9480-4dad9edd0194 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:25.723961 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113bb21-57e7-4d3c-82cf-fc8dcf0ccd72 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:25.752965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4cb8b-951a-48ce-bf40-cd927c6259ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:25.754033 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4cb8b-951a-48ce-bf40-cd927c6259ad None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:25.754319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4cb8b-951a-48ce-bf40-cd927c6259ad None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:25.754601 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4cb8b-951a-48ce-bf40-cd927c6259ad None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b/users/db68714416df4c4ca5e15d6b22b25568/roles/6f15d5ee845e4facaee3e8b8d247dd28` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:25.756889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4cb8b-951a-48ce-bf40-cd927c6259ad None admin] RBAC: Authorizing `identity:create_grant(project_id=da939275ad904ac98f1c2ad9e6fdc28b, user_id=db68714416df4c4ca5e15d6b22b25568, role_id=6f15d5ee845e4facaee3e8b8d247dd28)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:25.758853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4cb8b-951a-48ce-bf40-cd927c6259ad None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:25.774521 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac26b2-ec9c-413a-bd76-4720ebb43885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:25.781817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 144/289] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:56:25 2022] PUT /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b/users/db68714416df4c4ca5e15d6b22b25568/roles/6f15d5ee845e4facaee3e8b8d247dd28 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 10:56:25.782349 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac26b2-ec9c-413a-bd76-4720ebb43885 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:25.782749 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac26b2-ec9c-413a-bd76-4720ebb43885 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:25.783037 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac26b2-ec9c-413a-bd76-4720ebb43885 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:25.783819 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac26b2-ec9c-413a-bd76-4720ebb43885 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:25.784132 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac26b2-ec9c-413a-bd76-4720ebb43885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:25.785735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac26b2-ec9c-413a-bd76-4720ebb43885 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:25.796499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 146/290] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:25.802049 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4cb8b-951a-48ce-bf40-cd927c6259ad None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:25.920842 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4cb8b-951a-48ce-bf40-cd927c6259ad None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:25.954283 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:25.960621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc219c87-7210-4449-a171-fec789f0b0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:25.961949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc219c87-7210-4449-a171-fec789f0b0df None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:25.963090 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc219c87-7210-4449-a171-fec789f0b0df None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:25.963625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc219c87-7210-4449-a171-fec789f0b0df None admin] PATH_INFO: `/v3/users/908c9156d4d44d1db4a0c4bf5ff9ab2d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:25.965135 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc219c87-7210-4449-a171-fec789f0b0df None admin] RBAC: Authorizing `identity:get_user(user_id=908c9156d4d44d1db4a0c4bf5ff9ab2d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:25.967122 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc219c87-7210-4449-a171-fec789f0b0df None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:25.969298 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 145/291] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:25 2022] GET /identity/v3/users/908c9156d4d44d1db4a0c4bf5ff9ab2d => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:25.978532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac26b2-ec9c-413a-bd76-4720ebb43885 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:26.047046 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:26.103396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac26b2-ec9c-413a-bd76-4720ebb43885 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:26.138360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6721489-deb2-4f1a-825a-4d6e307e1b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:26.139312 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6721489-deb2-4f1a-825a-4d6e307e1b3c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:26.139784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6721489-deb2-4f1a-825a-4d6e307e1b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:26.140265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6721489-deb2-4f1a-825a-4d6e307e1b3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:26.228813 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6721489-deb2-4f1a-825a-4d6e307e1b3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:26.230294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6721489-deb2-4f1a-825a-4d6e307e1b3c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:26.301328 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:26.354257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 147/292] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:26.359625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc219c87-7210-4449-a171-fec789f0b0df None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:26.479375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc219c87-7210-4449-a171-fec789f0b0df None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:26.517616 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe106a-6cf9-4d21-801d-2b7ff79fb2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:26.518480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe106a-6cf9-4d21-801d-2b7ff79fb2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:26.518758 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe106a-6cf9-4d21-801d-2b7ff79fb2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:26.519032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe106a-6cf9-4d21-801d-2b7ff79fb2c6 None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:26.520220 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe106a-6cf9-4d21-801d-2b7ff79fb2c6 None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:26.521681 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe106a-6cf9-4d21-801d-2b7ff79fb2c6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:26.523672 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 146/293] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:26 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:26.530607 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6721489-deb2-4f1a-825a-4d6e307e1b3c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:26.697319 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6721489-deb2-4f1a-825a-4d6e307e1b3c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:26.739984 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d197c8c-d821-4995-9d34-11668bbe83ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:26.740579 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d197c8c-d821-4995-9d34-11668bbe83ab None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:26.740864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d197c8c-d821-4995-9d34-11668bbe83ab None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:26.741143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d197c8c-d821-4995-9d34-11668bbe83ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:26.742013 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d197c8c-d821-4995-9d34-11668bbe83ab None admin] RBAC: Adding query filter params (role.id=2c7768e02a39438fbe2c3551ff3b19a4, scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b, user.id=908c9156d4d44d1db4a0c4bf5ff9ab2d) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:26.742330 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d197c8c-d821-4995-9d34-11668bbe83ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:26.744332 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d197c8c-d821-4995-9d34-11668bbe83ab None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:26.750474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 148/294] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:26 2022] GET /identity/v3/role_assignments?user.id=908c9156d4d44d1db4a0c4bf5ff9ab2d&scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b&role.id=2c7768e02a39438fbe2c3551ff3b19a4 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:27.452455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5981e-2f3b-43ea-a364-988dc216b255 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:27.453285 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5981e-2f3b-43ea-a364-988dc216b255 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:27.453765 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5981e-2f3b-43ea-a364-988dc216b255 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:27.455568 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 147/295] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:27.460556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a50191-c7ec-4268-9a71-4d3833e3444e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:27.461385 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a50191-c7ec-4268-9a71-4d3833e3444e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:27.461860 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a50191-c7ec-4268-9a71-4d3833e3444e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:27.485472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d6a50191-c7ec-4268-9a71-4d3833e3444e None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:27.486972 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d6a50191-c7ec-4268-9a71-4d3833e3444e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:27.508530 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:27.556627 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 149/296] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:27.578358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5981e-2f3b-43ea-a364-988dc216b255 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:27.648522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:27.652690 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19c49c-b1c4-47bb-8157-3d0f1645359f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:27.653240 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19c49c-b1c4-47bb-8157-3d0f1645359f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:27.653763 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19c49c-b1c4-47bb-8157-3d0f1645359f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:27.655347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 150/297] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:27.660595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68121a2f-2ae5-49db-81b1-5f9993734b29 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:27.661128 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68121a2f-2ae5-49db-81b1-5f9993734b29 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:27.661668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68121a2f-2ae5-49db-81b1-5f9993734b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:27.679625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-68121a2f-2ae5-49db-81b1-5f9993734b29 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:27.681769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-68121a2f-2ae5-49db-81b1-5f9993734b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:27.689540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5981e-2f3b-43ea-a364-988dc216b255 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:27.730958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bf15e-b475-4a70-9b4d-18fdb554ae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:27.732151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bf15e-b475-4a70-9b4d-18fdb554ae60 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:27.732587 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bf15e-b475-4a70-9b4d-18fdb554ae60 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:27.733394 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bf15e-b475-4a70-9b4d-18fdb554ae60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:27.735005 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bf15e-b475-4a70-9b4d-18fdb554ae60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:27.737076 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bf15e-b475-4a70-9b4d-18fdb554ae60 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:27.738888 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 148/298] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:27.744981 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bf15e-b475-4a70-9b4d-18fdb554ae60 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:27.758735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 151/299] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:27.781298 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68121a2f-2ae5-49db-81b1-5f9993734b29 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:27.863348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bf15e-b475-4a70-9b4d-18fdb554ae60 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:27.871605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:27.888275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68121a2f-2ae5-49db-81b1-5f9993734b29 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:27.900322 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357aa960-ac74-4a40-82e6-152eef72fbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:27.900985 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357aa960-ac74-4a40-82e6-152eef72fbd5 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:27.901267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357aa960-ac74-4a40-82e6-152eef72fbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:27.901572 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357aa960-ac74-4a40-82e6-152eef72fbd5 None admin] PATH_INFO: `/v3/groups` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:27.902250 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357aa960-ac74-4a40-82e6-152eef72fbd5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:27.903682 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357aa960-ac74-4a40-82e6-152eef72fbd5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:27.906909 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:27.920520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 149/300] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Jun 27 10:56:27 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:56:27.925625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc30c13-6cf4-45ca-8356-7c801b061577 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:27.925625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc30c13-6cf4-45ca-8356-7c801b061577 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:27.925625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc30c13-6cf4-45ca-8356-7c801b061577 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:27.925625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 150/301] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:27.929226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9316eb-d702-46c8-9a0e-8ee9d875a2f4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:27.929546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9316eb-d702-46c8-9a0e-8ee9d875a2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:27.929820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9316eb-d702-46c8-9a0e-8ee9d875a2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:27.937330 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb349d28-ccaa-458a-aa40-731192753931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:27.938186 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb349d28-ccaa-458a-aa40-731192753931 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:27.938477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb349d28-ccaa-458a-aa40-731192753931 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:27.938758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb349d28-ccaa-458a-aa40-731192753931 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:27.951307 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb349d28-ccaa-458a-aa40-731192753931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:27.956445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1b9316eb-d702-46c8-9a0e-8ee9d875a2f4 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:27.958085 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1b9316eb-d702-46c8-9a0e-8ee9d875a2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:27.959605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-cb349d28-ccaa-458a-aa40-731192753931 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:27.959605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:27.959605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:27.959605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:27.959605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:27.959605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:27.959605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:27.959605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:27.959605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:27.959605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:27.959605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:27.959605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:27.959605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:27.959605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:27.959605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:27.959605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:27.960531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:27.960531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:27.960531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:27.960531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:27.960531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:27.960531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:27.960531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:27.960531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:27.960531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:27.960531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:27.960531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:27.960531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:27.960531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:27.960531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:27.960531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:27.960531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:27.961357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:27.961357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:27.961357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:27.961357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:27.961357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:27.961357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:27.961357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:27.961357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:27.961357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:27.961357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:27.961357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:27.961357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:27.961357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 152/302] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:27.971462 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb349d28-ccaa-458a-aa40-731192753931 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:28.069408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 151/303] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:28.089849 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb349d28-ccaa-458a-aa40-731192753931 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:28.092830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9316eb-d702-46c8-9a0e-8ee9d875a2f4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:28.132737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ed97c-9b80-419d-b4c9-74f4d725ca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:28.133453 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ed97c-9b80-419d-b4c9-74f4d725ca2d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:28.133737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ed97c-9b80-419d-b4c9-74f4d725ca2d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:28.134068 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ed97c-9b80-419d-b4c9-74f4d725ca2d None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:28.134814 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ed97c-9b80-419d-b4c9-74f4d725ca2d None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:28.135115 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ed97c-9b80-419d-b4c9-74f4d725ca2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:28.136750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ed97c-9b80-419d-b4c9-74f4d725ca2d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:28.146561 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 153/304] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:28.152020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ed97c-9b80-419d-b4c9-74f4d725ca2d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:28.168218 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:28.214754 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9316eb-d702-46c8-9a0e-8ee9d875a2f4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:28.241703 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:28.255195 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3e5fd-6723-4d5c-8887-5ff4625b611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:28.256001 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3e5fd-6723-4d5c-8887-5ff4625b611d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:28.256282 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3e5fd-6723-4d5c-8887-5ff4625b611d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:28.256556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3e5fd-6723-4d5c-8887-5ff4625b611d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:28.268478 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3e5fd-6723-4d5c-8887-5ff4625b611d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:28.276768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-aef3e5fd-6723-4d5c-8887-5ff4625b611d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:28.276768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:28.276768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:28.276768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:28.276768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:28.276768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:28.276768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:28.276768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:28.276768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:28.276768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:28.276768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:28.276768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:28.276768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:28.276768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:28.276768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:28.276768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:28.277794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:28.277794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:28.277794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:28.277794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:28.277794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:28.277794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:28.277794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:28.277794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:28.277794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:28.277794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:28.277794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:28.277794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:28.277794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:28.277794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:28.277794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:28.277794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:28.278584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:28.278584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:28.278584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:28.278584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:28.278584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:28.278584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:28.278584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:28.278584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:28.278584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:28.278584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:28.278584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:28.278584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:28.279587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ed97c-9b80-419d-b4c9-74f4d725ca2d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:28.281423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 152/305] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:28.283015 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d83958-503b-4fbd-8fce-314925d6d6dc None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:28.283311 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d83958-503b-4fbd-8fce-314925d6d6dc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:28.283587 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d83958-503b-4fbd-8fce-314925d6d6dc None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:28.285025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 153/306] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:28.285598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d83958-503b-4fbd-8fce-314925d6d6dc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:28.318703 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f000f14-0995-4060-8e9b-a6c4f68b8065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:28.319629 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f000f14-0995-4060-8e9b-a6c4f68b8065 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:28.319915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f000f14-0995-4060-8e9b-a6c4f68b8065 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:28.320130 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f000f14-0995-4060-8e9b-a6c4f68b8065 None admin] PATH_INFO: `/v3/users/10c42acd63dc4e3b8f8bde021d6211ae` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:28.321297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f000f14-0995-4060-8e9b-a6c4f68b8065 None admin] RBAC: Authorizing `identity:get_user(user_id=10c42acd63dc4e3b8f8bde021d6211ae)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:28.323320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f000f14-0995-4060-8e9b-a6c4f68b8065 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:28.328783 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 154/307] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:28 2022] GET /identity/v3/users/10c42acd63dc4e3b8f8bde021d6211ae => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:28.330399 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f6ff6-aa61-4bb2-acb7-46336ebbd68c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:28.331095 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f6ff6-aa61-4bb2-acb7-46336ebbd68c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:28.331387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f6ff6-aa61-4bb2-acb7-46336ebbd68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:28.348273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f01f6ff6-aa61-4bb2-acb7-46336ebbd68c None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:28.349472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f01f6ff6-aa61-4bb2-acb7-46336ebbd68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:28.391928 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d83958-503b-4fbd-8fce-314925d6d6dc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:28.425540 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 155/308] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:28.425540 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f6ff6-aa61-4bb2-acb7-46336ebbd68c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:28.431987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:28.439960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeac78-dd0b-4784-a804-598466520fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:28.440817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeac78-dd0b-4784-a804-598466520fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:28.441200 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeac78-dd0b-4784-a804-598466520fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:28.441603 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeac78-dd0b-4784-a804-598466520fb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:28.442651 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebeac78-dd0b-4784-a804-598466520fb4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:28.443073 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebeac78-dd0b-4784-a804-598466520fb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:28.444614 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebeac78-dd0b-4784-a804-598466520fb4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:28.455131 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 154/309] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:28.455778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeac78-dd0b-4784-a804-598466520fb4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:28.506632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:28.539278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f6ff6-aa61-4bb2-acb7-46336ebbd68c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:28.562442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeac78-dd0b-4784-a804-598466520fb4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:28.576595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd495d7-7f22-4276-b985-9166d789ea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:28.577573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd495d7-7f22-4276-b985-9166d789ea6f None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:28.577799 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd495d7-7f22-4276-b985-9166d789ea6f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:28.578071 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd495d7-7f22-4276-b985-9166d789ea6f None admin] PATH_INFO: `/v3/system/users/10c42acd63dc4e3b8f8bde021d6211ae/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:28.579651 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd495d7-7f22-4276-b985-9166d789ea6f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=10c42acd63dc4e3b8f8bde021d6211ae, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:28.581121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd495d7-7f22-4276-b985-9166d789ea6f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:28.590372 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 156/310] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Jun 27 10:56:28 2022] PUT /identity/v3/system/users/10c42acd63dc4e3b8f8bde021d6211ae/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:56:28.591206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd495d7-7f22-4276-b985-9166d789ea6f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:28.627280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d063e-7704-4f3e-91e3-d4e424088d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:28.628511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d063e-7704-4f3e-91e3-d4e424088d04 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:28.629221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d063e-7704-4f3e-91e3-d4e424088d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:28.630739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d063e-7704-4f3e-91e3-d4e424088d04 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:28.647401 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d063e-7704-4f3e-91e3-d4e424088d04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:28.659256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-711d063e-7704-4f3e-91e3-d4e424088d04 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:28.659256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:28.659256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:28.659256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:28.659256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:28.659256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:28.659256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:28.659256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:28.659256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:28.659256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:28.659256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:28.659256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:28.659256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:28.659256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:28.659256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:28.659256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:28.660212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:28.660212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:28.660212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:28.660212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:28.660212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:28.660212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:28.660212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:28.660212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:28.660212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:28.660212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:28.660212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:28.660212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:28.660212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:28.660212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:28.660212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:28.660212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:28.660987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:28.660987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:28.660987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:28.660987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:28.660987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:28.660987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:28.660987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:28.660987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:28.660987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:28.660987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:28.660987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:28.660987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:28.662998 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 155/311] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:28.668588 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d063e-7704-4f3e-91e3-d4e424088d04 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:28.675460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:28.715944 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd495d7-7f22-4276-b985-9166d789ea6f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:28.755423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9fb8b-964e-4566-a7b3-500e0f2540bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:28.755903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9fb8b-964e-4566-a7b3-500e0f2540bf None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:28.756179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9fb8b-964e-4566-a7b3-500e0f2540bf None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:28.756450 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9fb8b-964e-4566-a7b3-500e0f2540bf None admin] PATH_INFO: `/v3/users/3f569570725143f79f79886cf9761874` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:28.773286 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9fb8b-964e-4566-a7b3-500e0f2540bf None admin] RBAC: Authorizing `identity:get_user(user_id=3f569570725143f79f79886cf9761874)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:28.774818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9fb8b-964e-4566-a7b3-500e0f2540bf None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:28.776635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 157/312] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:28 2022] GET /identity/v3/users/3f569570725143f79f79886cf9761874 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:28.782218 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9fb8b-964e-4566-a7b3-500e0f2540bf None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:28.816071 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d063e-7704-4f3e-91e3-d4e424088d04 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:28.826002 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:28.862582 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5de219-e7a8-4d16-a5e4-15b22b53603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:28.863641 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5de219-e7a8-4d16-a5e4-15b22b53603c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:28.864576 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5de219-e7a8-4d16-a5e4-15b22b53603c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:28.865054 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5de219-e7a8-4d16-a5e4-15b22b53603c None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:28.866293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5de219-e7a8-4d16-a5e4-15b22b53603c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:28.866770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5de219-e7a8-4d16-a5e4-15b22b53603c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:28.869276 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5de219-e7a8-4d16-a5e4-15b22b53603c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:28.879887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 156/313] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:28.885035 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5de219-e7a8-4d16-a5e4-15b22b53603c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:28.904927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9fb8b-964e-4566-a7b3-500e0f2540bf None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:28.938204 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:28.950695 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aff79-7dbd-4ed6-8e6b-64abfad3809b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:28.951926 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aff79-7dbd-4ed6-8e6b-64abfad3809b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:28.952562 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aff79-7dbd-4ed6-8e6b-64abfad3809b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:28.952931 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aff79-7dbd-4ed6-8e6b-64abfad3809b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:28.954162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aff79-7dbd-4ed6-8e6b-64abfad3809b None admin] RBAC: Adding query filter params (role.id=6f15d5ee845e4facaee3e8b8d247dd28, user.id=3f569570725143f79f79886cf9761874, scope.system=all) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:28.954927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aff79-7dbd-4ed6-8e6b-64abfad3809b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:28.956564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aff79-7dbd-4ed6-8e6b-64abfad3809b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:28.964946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 158/314] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Jun 27 10:56:28 2022] GET /identity/v3/role_assignments?user.id=3f569570725143f79f79886cf9761874&scope.system=all&role.id=6f15d5ee845e4facaee3e8b8d247dd28 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:29.016599 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5de219-e7a8-4d16-a5e4-15b22b53603c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:29.055091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca254d5-bcc3-4e2a-8a36-94176c391b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:29.056019 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca254d5-bcc3-4e2a-8a36-94176c391b02 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:29.056303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca254d5-bcc3-4e2a-8a36-94176c391b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:29.056580 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca254d5-bcc3-4e2a-8a36-94176c391b02 None admin] PATH_INFO: `/v3/users/db68714416df4c4ca5e15d6b22b25568` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:29.057845 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca254d5-bcc3-4e2a-8a36-94176c391b02 None admin] RBAC: Authorizing `identity:get_user(user_id=db68714416df4c4ca5e15d6b22b25568)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:29.059308 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca254d5-bcc3-4e2a-8a36-94176c391b02 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:29.065504 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 157/315] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:28 2022] GET /identity/v3/users/db68714416df4c4ca5e15d6b22b25568 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:29.067043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aff79-7dbd-4ed6-8e6b-64abfad3809b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:29.175132 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aff79-7dbd-4ed6-8e6b-64abfad3809b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:29.218741 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ab58d-7790-4c71-a25e-9df3aeb2e591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:29.219388 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ab58d-7790-4c71-a25e-9df3aeb2e591 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:29.219667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ab58d-7790-4c71-a25e-9df3aeb2e591 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:29.219939 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ab58d-7790-4c71-a25e-9df3aeb2e591 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:29.279992 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:29.290783 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ab58d-7790-4c71-a25e-9df3aeb2e591 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:29.292249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ab58d-7790-4c71-a25e-9df3aeb2e591 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:29.393350 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 159/316] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:29.398881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca254d5-bcc3-4e2a-8a36-94176c391b02 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:29.435189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:29.505047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca254d5-bcc3-4e2a-8a36-94176c391b02 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:29.541147 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839c4b2-3c3a-4472-89de-2f90bc1be26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:29.542431 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839c4b2-3c3a-4472-89de-2f90bc1be26b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:29.542905 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839c4b2-3c3a-4472-89de-2f90bc1be26b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:29.543391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839c4b2-3c3a-4472-89de-2f90bc1be26b None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:29.544759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839c4b2-3c3a-4472-89de-2f90bc1be26b None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:29.546428 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839c4b2-3c3a-4472-89de-2f90bc1be26b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:29.548615 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 158/317] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:29 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:29.554068 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ab58d-7790-4c71-a25e-9df3aeb2e591 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:29.649141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:29.657922 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ab58d-7790-4c71-a25e-9df3aeb2e591 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:29.693170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbed0d-ef19-47e9-8956-6fe5f16b93fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:29.693762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbed0d-ef19-47e9-8956-6fe5f16b93fa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:29.694041 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbed0d-ef19-47e9-8956-6fe5f16b93fa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:29.694326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbed0d-ef19-47e9-8956-6fe5f16b93fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:29.695143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbed0d-ef19-47e9-8956-6fe5f16b93fa None admin] RBAC: Adding query filter params (role.id=6f15d5ee845e4facaee3e8b8d247dd28, scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b, user.id=db68714416df4c4ca5e15d6b22b25568) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:29.695444 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbed0d-ef19-47e9-8956-6fe5f16b93fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:29.696920 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbed0d-ef19-47e9-8956-6fe5f16b93fa None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:29.702991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 160/318] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:29 2022] GET /identity/v3/role_assignments?user.id=db68714416df4c4ca5e15d6b22b25568&scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b&role.id=6f15d5ee845e4facaee3e8b8d247dd28 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:30.108711 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda2da0-a5ad-4903-94f4-f933b545c346 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:30.109097 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda2da0-a5ad-4903-94f4-f933b545c346 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:30.109277 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda2da0-a5ad-4903-94f4-f933b545c346 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:30.110738 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 159/319] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:30.115946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f93ef5-da1e-4850-b058-977c7111d9ec None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:30.116233 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f93ef5-da1e-4850-b058-977c7111d9ec None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:30.116505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f93ef5-da1e-4850-b058-977c7111d9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:30.132986 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-65f93ef5-da1e-4850-b058-977c7111d9ec None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:30.134202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-65f93ef5-da1e-4850-b058-977c7111d9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:30.208118 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 161/320] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:30.231287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda2da0-a5ad-4903-94f4-f933b545c346 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:30.333506 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda2da0-a5ad-4903-94f4-f933b545c346 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:30.335807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:30.369159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633819f-95bb-40f9-8071-c4d42fff0587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:30.369899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633819f-95bb-40f9-8071-c4d42fff0587 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:30.370172 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633819f-95bb-40f9-8071-c4d42fff0587 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:30.370443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633819f-95bb-40f9-8071-c4d42fff0587 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:30.371588 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633819f-95bb-40f9-8071-c4d42fff0587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:30.373019 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633819f-95bb-40f9-8071-c4d42fff0587 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:30.374820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 160/321] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:30.379996 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f93ef5-da1e-4850-b058-977c7111d9ec None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:30.462719 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:30.477698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f93ef5-da1e-4850-b058-977c7111d9ec None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:30.511122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6fb58-21e2-4f47-8fd6-8c2828b5dc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:30.511782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6fb58-21e2-4f47-8fd6-8c2828b5dc76 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:30.512059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6fb58-21e2-4f47-8fd6-8c2828b5dc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:30.512330 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6fb58-21e2-4f47-8fd6-8c2828b5dc76 None admin] PATH_INFO: `/v3/groups` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:30.513009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6fb58-21e2-4f47-8fd6-8c2828b5dc76 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:30.514477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6fb58-21e2-4f47-8fd6-8c2828b5dc76 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:30.537389 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 162/322] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Jun 27 10:56:30 2022] POST /identity/v3/groups => generated 226 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:56:30.699331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210656fe-0ddc-4aed-810f-9fe2ab6fd1a9 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:30.699804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210656fe-0ddc-4aed-810f-9fe2ab6fd1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:30.699804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210656fe-0ddc-4aed-810f-9fe2ab6fd1a9 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:30.701266 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 161/323] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:30.706780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c62e5-7fee-4a72-99e7-79ac5bb850dd None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:30.707243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c62e5-7fee-4a72-99e7-79ac5bb850dd None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:30.707343 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c62e5-7fee-4a72-99e7-79ac5bb850dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:30.724915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0e7c62e5-7fee-4a72-99e7-79ac5bb850dd None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:30.726153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0e7c62e5-7fee-4a72-99e7-79ac5bb850dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:30.798255 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 163/324] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:30.822137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210656fe-0ddc-4aed-810f-9fe2ab6fd1a9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:30.929147 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210656fe-0ddc-4aed-810f-9fe2ab6fd1a9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:30.966650 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666b56c-2238-4f0c-a9b8-71f084695925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:30.967366 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666b56c-2238-4f0c-a9b8-71f084695925 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:30.967644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666b56c-2238-4f0c-a9b8-71f084695925 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:30.967913 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666b56c-2238-4f0c-a9b8-71f084695925 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:30.978561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666b56c-2238-4f0c-a9b8-71f084695925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:30.986481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8666b56c-2238-4f0c-a9b8-71f084695925 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:30.986481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:30.986481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:30.986481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:30.986481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:30.986481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:30.986481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:30.986481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:30.986481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:30.986481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:30.986481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:30.986481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:30.986481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:30.986481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:30.986481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:30.986481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:30.987397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:30.987397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:30.987397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:30.987397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:30.987397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:30.987397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:30.987397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:30.987397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:30.987397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:30.987397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:30.987397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:30.987397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:30.987397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:30.987397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:30.987397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:30.987397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:30.988168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:30.988168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:30.988168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:30.988168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:30.988168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:30.988168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:30.988168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:30.988168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:30.988168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:30.988168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:30.988168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:30.988168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:30.988168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 162/325] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:30.994279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c62e5-7fee-4a72-99e7-79ac5bb850dd None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:31.076364 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:31.102120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c62e5-7fee-4a72-99e7-79ac5bb850dd None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:31.140260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829950f-4bba-4ed2-838e-0fb4ae9bb67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:31.140930 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829950f-4bba-4ed2-838e-0fb4ae9bb67f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:31.141214 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829950f-4bba-4ed2-838e-0fb4ae9bb67f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:31.141524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829950f-4bba-4ed2-838e-0fb4ae9bb67f None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:31.142278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829950f-4bba-4ed2-838e-0fb4ae9bb67f None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:31.142589 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829950f-4bba-4ed2-838e-0fb4ae9bb67f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:31.143982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829950f-4bba-4ed2-838e-0fb4ae9bb67f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:31.155100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd25c4-0349-49ab-bae5-3c0fbd316d6b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:31.155321 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 164/326] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:31.155414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd25c4-0349-49ab-bae5-3c0fbd316d6b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:31.155682 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd25c4-0349-49ab-bae5-3c0fbd316d6b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:31.157051 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 163/327] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:56:31.162518 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955c0e0-0c69-4503-aa59-9d368c7f8d2d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:31.162806 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955c0e0-0c69-4503-aa59-9d368c7f8d2d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:31.163086 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955c0e0-0c69-4503-aa59-9d368c7f8d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:31.166639 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd25c4-0349-49ab-bae5-3c0fbd316d6b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:31.188883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a955c0e0-0c69-4503-aa59-9d368c7f8d2d None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:31.190464 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a955c0e0-0c69-4503-aa59-9d368c7f8d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:31.222218 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:31.272786 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 165/328] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:31.297732 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955c0e0-0c69-4503-aa59-9d368c7f8d2d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:31.319957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd25c4-0349-49ab-bae5-3c0fbd316d6b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:31.370345 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c71db-e732-4099-b0a1-ae1dac3ea6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:31.372380 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c71db-e732-4099-b0a1-ae1dac3ea6ef None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:31.372873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c71db-e732-4099-b0a1-ae1dac3ea6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:31.373604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c71db-e732-4099-b0a1-ae1dac3ea6ef None admin] PATH_INFO: `/v3/users/10c42acd63dc4e3b8f8bde021d6211ae` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:31.375702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c71db-e732-4099-b0a1-ae1dac3ea6ef None admin] RBAC: Authorizing `identity:get_user(user_id=10c42acd63dc4e3b8f8bde021d6211ae)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:31.377638 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c71db-e732-4099-b0a1-ae1dac3ea6ef None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:31.379128 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:31.381470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 164/329] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:31 2022] GET /identity/v3/users/10c42acd63dc4e3b8f8bde021d6211ae => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:31.387178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c71db-e732-4099-b0a1-ae1dac3ea6ef None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:31.431601 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955c0e0-0c69-4503-aa59-9d368c7f8d2d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:31.470851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72be71-0079-48f0-b2f4-9a554ee7bbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:31.471965 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72be71-0079-48f0-b2f4-9a554ee7bbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:31.472295 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72be71-0079-48f0-b2f4-9a554ee7bbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:31.472517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72be71-0079-48f0-b2f4-9a554ee7bbb0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:31.484824 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72be71-0079-48f0-b2f4-9a554ee7bbb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:31.494210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9c72be71-0079-48f0-b2f4-9a554ee7bbb0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:31.494210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:31.494210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:31.494210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:31.494210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:31.494210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:31.494210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:31.494210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:31.494210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:31.494210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:31.494210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:31.494210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:31.494210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:31.494210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:31.494210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:31.494210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:31.495121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:31.495121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:31.495121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:31.495121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:31.495121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:31.495121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:31.495121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:31.495121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:31.495121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:31.495121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:31.495121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:31.495121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:31.495121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:31.495121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:31.495121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:31.495121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:31.496357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:31.496357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:31.496357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:31.496357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:31.496357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:31.496357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:31.496357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:31.496357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:31.496357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:31.496357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:31.496357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:31.496357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:31.496357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 166/330] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:31.501830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72be71-0079-48f0-b2f4-9a554ee7bbb0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:31.520407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:31.524536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c71db-e732-4099-b0a1-ae1dac3ea6ef None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:31.571664 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d31e37-b844-4550-a433-e229a46b6e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:31.572979 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d31e37-b844-4550-a433-e229a46b6e53 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:31.573490 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d31e37-b844-4550-a433-e229a46b6e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:31.574103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d31e37-b844-4550-a433-e229a46b6e53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:31.575905 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d31e37-b844-4550-a433-e229a46b6e53 None admin] RBAC: Adding query filter params (role.id=2c7768e02a39438fbe2c3551ff3b19a4, user.id=10c42acd63dc4e3b8f8bde021d6211ae, scope.system=all) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:31.576418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d31e37-b844-4550-a433-e229a46b6e53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:31.579013 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d31e37-b844-4550-a433-e229a46b6e53 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:31.593136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 165/331] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Jun 27 10:56:31 2022] GET /identity/v3/role_assignments?user.id=10c42acd63dc4e3b8f8bde021d6211ae&scope.system=all&role.id=2c7768e02a39438fbe2c3551ff3b19a4 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:31.639791 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72be71-0079-48f0-b2f4-9a554ee7bbb0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:31.673460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:31.683276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e2480-6184-417d-bfba-c09b1eb9154f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:31.683961 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e2480-6184-417d-bfba-c09b1eb9154f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:31.684240 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e2480-6184-417d-bfba-c09b1eb9154f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:31.684514 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e2480-6184-417d-bfba-c09b1eb9154f None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:31.685268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e2480-6184-417d-bfba-c09b1eb9154f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:31.685642 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e2480-6184-417d-bfba-c09b1eb9154f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:31.687032 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e2480-6184-417d-bfba-c09b1eb9154f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:31.698260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 167/332] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:31.703955 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d31e37-b844-4550-a433-e229a46b6e53 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:31.832881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d31e37-b844-4550-a433-e229a46b6e53 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:31.872425 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04cfb1-48f5-4ec4-8616-cb12fb81825e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:31.873308 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04cfb1-48f5-4ec4-8616-cb12fb81825e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:31.873628 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04cfb1-48f5-4ec4-8616-cb12fb81825e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:31.873903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04cfb1-48f5-4ec4-8616-cb12fb81825e None admin] PATH_INFO: `/v3/users/3f569570725143f79f79886cf9761874` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:31.875185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04cfb1-48f5-4ec4-8616-cb12fb81825e None admin] RBAC: Authorizing `identity:get_user(user_id=3f569570725143f79f79886cf9761874)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:31.876672 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04cfb1-48f5-4ec4-8616-cb12fb81825e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:31.878741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 166/333] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:31 2022] GET /identity/v3/users/3f569570725143f79f79886cf9761874 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:31.884640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e2480-6184-417d-bfba-c09b1eb9154f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:32.004724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e2480-6184-417d-bfba-c09b1eb9154f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:32.045608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8e2a3-148c-49e8-87bc-7e0f2cb8e70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:32.046472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8e2a3-148c-49e8-87bc-7e0f2cb8e70b None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:32.046748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8e2a3-148c-49e8-87bc-7e0f2cb8e70b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:32.047021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8e2a3-148c-49e8-87bc-7e0f2cb8e70b None admin] PATH_INFO: `/v3/system/users/3f569570725143f79f79886cf9761874/roles/6f15d5ee845e4facaee3e8b8d247dd28` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:32.048518 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8e2a3-148c-49e8-87bc-7e0f2cb8e70b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3f569570725143f79f79886cf9761874, role_id=6f15d5ee845e4facaee3e8b8d247dd28)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:32.049924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8e2a3-148c-49e8-87bc-7e0f2cb8e70b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:32.067305 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 168/334] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Jun 27 10:56:31 2022] PUT /identity/v3/system/users/3f569570725143f79f79886cf9761874/roles/6f15d5ee845e4facaee3e8b8d247dd28 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:56:33.102314 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf14bf-f41d-4032-8774-87f03e9560f4 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:33.103390 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf14bf-f41d-4032-8774-87f03e9560f4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:33.103517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf14bf-f41d-4032-8774-87f03e9560f4 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:33.105475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 167/335] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:33.110533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf66c73-7d3f-4793-90b7-4fb8543efad0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:33.111341 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf66c73-7d3f-4793-90b7-4fb8543efad0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:33.111814 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf66c73-7d3f-4793-90b7-4fb8543efad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:33.138383 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3cf66c73-7d3f-4793-90b7-4fb8543efad0 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:33.139911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3cf66c73-7d3f-4793-90b7-4fb8543efad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:33.200590 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:33.227517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 169/336] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:33.270803 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf14bf-f41d-4032-8774-87f03e9560f4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:33.305269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:33.388985 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf14bf-f41d-4032-8774-87f03e9560f4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:33.418259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75207758-c099-402b-b6dc-f19417aaf519 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:33.418891 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75207758-c099-402b-b6dc-f19417aaf519 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:33.419340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75207758-c099-402b-b6dc-f19417aaf519 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:33.421082 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 170/337] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:33.425630 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619f3b8-b0f1-4640-8a08-e38d9a101ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:33.426436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619f3b8-b0f1-4640-8a08-e38d9a101ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:33.426713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619f3b8-b0f1-4640-8a08-e38d9a101ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:33.426984 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619f3b8-b0f1-4640-8a08-e38d9a101ea7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:33.432008 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34e826-d34d-4fc3-a6f8-258ef9da8795 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:33.432453 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34e826-d34d-4fc3-a6f8-258ef9da8795 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:33.432903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34e826-d34d-4fc3-a6f8-258ef9da8795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:33.444442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619f3b8-b0f1-4640-8a08-e38d9a101ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:33.453315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c619f3b8-b0f1-4640-8a08-e38d9a101ea7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:33.453315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:33.453315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:33.453315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:33.453315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:33.453315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:33.453315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:33.453315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:33.453315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:33.453315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:33.453315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:33.453315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:33.453315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:33.453315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:33.453315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:33.453315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:33.454279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:33.454279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:33.454279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:33.454279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:33.454279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:33.454279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:33.454279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:33.454279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:33.454279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:33.454279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:33.454279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:33.454279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:33.454279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:33.454279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:33.454279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:33.454279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:33.455083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:33.455083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:33.455083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:33.455083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:33.455083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:33.455083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:33.455083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:33.455083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:33.455083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:33.455083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:33.455083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:33.455083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:33.455083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 168/338] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:33.462941 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619f3b8-b0f1-4640-8a08-e38d9a101ea7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:33.470385 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0b34e826-d34d-4fc3-a6f8-258ef9da8795 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:33.472056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0b34e826-d34d-4fc3-a6f8-258ef9da8795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:33.651470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:33.667987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 171/339] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:33.685185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619f3b8-b0f1-4640-8a08-e38d9a101ea7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:33.700045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34e826-d34d-4fc3-a6f8-258ef9da8795 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:33.742991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6a733-1721-43f4-bf30-5aa14cda3917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:33.743700 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6a733-1721-43f4-bf30-5aa14cda3917 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:33.743982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6a733-1721-43f4-bf30-5aa14cda3917 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:33.744257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6a733-1721-43f4-bf30-5aa14cda3917 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:33.745013 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6a733-1721-43f4-bf30-5aa14cda3917 None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:33.745320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6a733-1721-43f4-bf30-5aa14cda3917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:33.749387 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6a733-1721-43f4-bf30-5aa14cda3917 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:33.762668 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 169/340] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:33.768176 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6a733-1721-43f4-bf30-5aa14cda3917 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:33.888770 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34e826-d34d-4fc3-a6f8-258ef9da8795 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:33.921521 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:33.937187 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafafb3a-a8fb-4caa-b39c-a703ea970ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:33.938283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafafb3a-a8fb-4caa-b39c-a703ea970ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:33.938844 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafafb3a-a8fb-4caa-b39c-a703ea970ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:33.939324 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafafb3a-a8fb-4caa-b39c-a703ea970ca6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:33.964202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafafb3a-a8fb-4caa-b39c-a703ea970ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:33.978449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-cafafb3a-a8fb-4caa-b39c-a703ea970ca6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:33.978449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:33.978449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:33.978449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:33.978449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:33.978449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:33.978449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:33.978449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:33.978449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:33.978449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:33.978449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:33.978449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:33.978449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:33.978449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:33.978449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:33.978449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:33.979357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:33.979357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:33.979357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:33.979357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:33.979357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:33.979357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:33.979357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:33.979357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:33.979357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:33.979357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:33.979357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:33.979357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:33.979357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:33.979357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:33.979357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:33.979357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:33.980163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:33.980163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:33.980163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:33.980163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:33.980163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:33.980163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:33.980163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:33.980163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:33.980163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:33.980163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:33.980163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:33.980163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:33.982241 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 172/341] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:56:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:33.988155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafafb3a-a8fb-4caa-b39c-a703ea970ca6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:34.006008 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6a733-1721-43f4-bf30-5aa14cda3917 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:34.088648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923bfd3-8ab9-482e-b8bd-dd02d7271a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:34.089564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923bfd3-8ab9-482e-b8bd-dd02d7271a30 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:34.089989 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923bfd3-8ab9-482e-b8bd-dd02d7271a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:34.090430 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923bfd3-8ab9-482e-b8bd-dd02d7271a30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:34.122137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:34.184046 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafafb3a-a8fb-4caa-b39c-a703ea970ca6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:34.204785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923bfd3-8ab9-482e-b8bd-dd02d7271a30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:34.206525 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923bfd3-8ab9-482e-b8bd-dd02d7271a30 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:34.266082 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055b8a4-1bd8-46c1-9361-6e4bd3e35273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:34.266794 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b8a4-1bd8-46c1-9361-6e4bd3e35273 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:34.267073 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b8a4-1bd8-46c1-9361-6e4bd3e35273 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:34.267347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b8a4-1bd8-46c1-9361-6e4bd3e35273 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:34.268215 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055b8a4-1bd8-46c1-9361-6e4bd3e35273 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:34.268519 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055b8a4-1bd8-46c1-9361-6e4bd3e35273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:34.270027 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055b8a4-1bd8-46c1-9361-6e4bd3e35273 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:34.287193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 173/342] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:56:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:34.293155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055b8a4-1bd8-46c1-9361-6e4bd3e35273 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:34.336742 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:34.359009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 170/343] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 10:56:34.363070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923bfd3-8ab9-482e-b8bd-dd02d7271a30 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:34.414403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055b8a4-1bd8-46c1-9361-6e4bd3e35273 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:34.450803 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43805ec-d2e0-4dad-a9a8-ae9daecb9374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:34.451801 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43805ec-d2e0-4dad-a9a8-ae9daecb9374 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:34.452346 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43805ec-d2e0-4dad-a9a8-ae9daecb9374 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:34.452812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43805ec-d2e0-4dad-a9a8-ae9daecb9374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:34.468086 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:34.525084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43805ec-d2e0-4dad-a9a8-ae9daecb9374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:34.526821 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43805ec-d2e0-4dad-a9a8-ae9daecb9374 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:34.562452 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:34.577113 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923bfd3-8ab9-482e-b8bd-dd02d7271a30 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:34.635533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 174/344] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:34.637539 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208cb62-2c13-4588-a511-c657b6c327e8 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:34.638030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208cb62-2c13-4588-a511-c657b6c327e8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:34.638500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208cb62-2c13-4588-a511-c657b6c327e8 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:34.640227 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 175/345] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:34.649476 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b018d64-6dbf-4be5-8a32-50aaf408739b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:34.650043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b018d64-6dbf-4be5-8a32-50aaf408739b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:34.650514 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b018d64-6dbf-4be5-8a32-50aaf408739b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:34.656615 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b3dab-ba41-4b79-a0d1-754fd1d967f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:34.657526 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b3dab-ba41-4b79-a0d1-754fd1d967f1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:34.657803 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b3dab-ba41-4b79-a0d1-754fd1d967f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:34.658075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b3dab-ba41-4b79-a0d1-754fd1d967f1 None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:34.659522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b3dab-ba41-4b79-a0d1-754fd1d967f1 None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:34.660959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b3dab-ba41-4b79-a0d1-754fd1d967f1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:34.667305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 171/346] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:34 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:34.668436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b3dab-ba41-4b79-a0d1-754fd1d967f1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:34.675908 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1b018d64-6dbf-4be5-8a32-50aaf408739b None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:34.677382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1b018d64-6dbf-4be5-8a32-50aaf408739b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:34.751586 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 176/347] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:34.752721 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b018d64-6dbf-4be5-8a32-50aaf408739b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:34.823761 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:34.861064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b018d64-6dbf-4be5-8a32-50aaf408739b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:34.898109 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d1af1-690b-4fe4-9092-51ba2c5deb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:34.899305 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d1af1-690b-4fe4-9092-51ba2c5deb78 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:34.899837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d1af1-690b-4fe4-9092-51ba2c5deb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:34.900350 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d1af1-690b-4fe4-9092-51ba2c5deb78 None admin] PATH_INFO: `/v3/groups/839693481bbc4a7ea85d25aae678af21` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:34.901268 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b3dab-ba41-4b79-a0d1-754fd1d967f1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:34.907260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d1af1-690b-4fe4-9092-51ba2c5deb78 None admin] RBAC: Authorizing `identity:get_group(group_id=839693481bbc4a7ea85d25aae678af21)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:34.908951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d1af1-690b-4fe4-9092-51ba2c5deb78 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:34.910877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 177/348] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jun 27 10:56:34 2022] GET /identity/v3/groups/839693481bbc4a7ea85d25aae678af21 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:34.911862 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d1af1-690b-4fe4-9092-51ba2c5deb78 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:34.937505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:34.964126 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4800b-1986-4d74-a630-e68524c22845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:34.965009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4800b-1986-4d74-a630-e68524c22845 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:34.965286 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4800b-1986-4d74-a630-e68524c22845 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:34.965591 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4800b-1986-4d74-a630-e68524c22845 None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:34.966924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4800b-1986-4d74-a630-e68524c22845 None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:34.968524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4800b-1986-4d74-a630-e68524c22845 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:34.970309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 172/349] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:34 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:34.980171 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4800b-1986-4d74-a630-e68524c22845 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:35.026885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d1af1-690b-4fe4-9092-51ba2c5deb78 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:35.064902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:35.082794 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78cc8e-acda-49b5-a83b-3bc68a620de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:35.083987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78cc8e-acda-49b5-a83b-3bc68a620de8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:35.084468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78cc8e-acda-49b5-a83b-3bc68a620de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:35.084936 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78cc8e-acda-49b5-a83b-3bc68a620de8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:35.097104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78cc8e-acda-49b5-a83b-3bc68a620de8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:35.106729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9b78cc8e-acda-49b5-a83b-3bc68a620de8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:35.106729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:35.106729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:35.106729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:35.106729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:35.106729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:35.106729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:35.106729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:35.106729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:35.106729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:35.106729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:35.106729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:35.106729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:35.106729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:35.106729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:35.106729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:35.107661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:35.107661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:35.107661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:35.107661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:35.107661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:35.107661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:35.107661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:35.107661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:35.107661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:35.107661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:35.107661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:35.107661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:35.107661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:35.107661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:35.107661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:35.107661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:35.108500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:35.108500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:35.108500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:35.108500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:35.108500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:35.108500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:35.108500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:35.108500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:35.108500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:35.108500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:35.108500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:35.108500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:35.110917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 178/350] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:35.112351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02b9ea-0a5b-425a-b630-b0fea26fd068 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:35.112832 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02b9ea-0a5b-425a-b630-b0fea26fd068 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:35.113300 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02b9ea-0a5b-425a-b630-b0fea26fd068 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:35.115091 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 179/351] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:35.115980 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02b9ea-0a5b-425a-b630-b0fea26fd068 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:35.128008 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4800b-1986-4d74-a630-e68524c22845 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:35.176751 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cacd65-be7e-4d71-9f54-8f91fe10c71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:35.179168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cacd65-be7e-4d71-9f54-8f91fe10c71b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:35.179685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cacd65-be7e-4d71-9f54-8f91fe10c71b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:35.180159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cacd65-be7e-4d71-9f54-8f91fe10c71b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:35.181798 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cacd65-be7e-4d71-9f54-8f91fe10c71b None admin] RBAC: Adding query filter params (group.id=839693481bbc4a7ea85d25aae678af21, role.id=2c7768e02a39438fbe2c3551ff3b19a4, scope.project.id=c63add240dc64d06949b96266e734033) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:35.182337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cacd65-be7e-4d71-9f54-8f91fe10c71b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:35.184042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cacd65-be7e-4d71-9f54-8f91fe10c71b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:35.191140 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 173/352] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jun 27 10:56:34 2022] GET /identity/v3/role_assignments?group.id=839693481bbc4a7ea85d25aae678af21&scope.project.id=c63add240dc64d06949b96266e734033&role.id=2c7768e02a39438fbe2c3551ff3b19a4 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:35.192788 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4aa3-adb3-40ac-9b93-bf5d519c9cbd None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:35.193277 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4aa3-adb3-40ac-9b93-bf5d519c9cbd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:35.193793 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4aa3-adb3-40ac-9b93-bf5d519c9cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:35.214710 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c8dc4aa3-adb3-40ac-9b93-bf5d519c9cbd None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:35.216244 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c8dc4aa3-adb3-40ac-9b93-bf5d519c9cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:35.259239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02b9ea-0a5b-425a-b630-b0fea26fd068 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:35.273820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:35.306596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 174/353] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:35.307824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc4aa3-adb3-40ac-9b93-bf5d519c9cbd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:35.324196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e267e-4db2-4162-b5b0-234a93629076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:35.325255 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e267e-4db2-4162-b5b0-234a93629076 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:35.325568 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e267e-4db2-4162-b5b0-234a93629076 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:35.325843 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e267e-4db2-4162-b5b0-234a93629076 None admin] PATH_INFO: `/v3/groups/839693481bbc4a7ea85d25aae678af21` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:35.334517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e267e-4db2-4162-b5b0-234a93629076 None admin] RBAC: Authorizing `identity:get_group(group_id=839693481bbc4a7ea85d25aae678af21)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:35.336129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e267e-4db2-4162-b5b0-234a93629076 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:35.339776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 180/354] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jun 27 10:56:35 2022] GET /identity/v3/groups/839693481bbc4a7ea85d25aae678af21 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:35.341298 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b8d8c-7934-47dd-8cb4-04bcd99ede4b None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:35.341646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b8d8c-7934-47dd-8cb4-04bcd99ede4b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:35.341934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b8d8c-7934-47dd-8cb4-04bcd99ede4b None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:35.349637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 181/355] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:35.350144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b8d8c-7934-47dd-8cb4-04bcd99ede4b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:35.419444 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc4aa3-adb3-40ac-9b93-bf5d519c9cbd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:35.448433 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:35.472698 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d35b6a-bcdf-48e4-8e3c-80bf875a5edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:35.473412 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d35b6a-bcdf-48e4-8e3c-80bf875a5edc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:35.473688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d35b6a-bcdf-48e4-8e3c-80bf875a5edc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:35.475862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d35b6a-bcdf-48e4-8e3c-80bf875a5edc None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:35.476533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d35b6a-bcdf-48e4-8e3c-80bf875a5edc None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:35.476841 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d35b6a-bcdf-48e4-8e3c-80bf875a5edc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:35.478916 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d35b6a-bcdf-48e4-8e3c-80bf875a5edc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:35.490358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 175/356] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:35.491697 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274b1d3-c8ff-401c-9c61-b2f37416dd0b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:35.491969 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274b1d3-c8ff-401c-9c61-b2f37416dd0b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:35.492307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274b1d3-c8ff-401c-9c61-b2f37416dd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:35.505339 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b8d8c-7934-47dd-8cb4-04bcd99ede4b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:35.512661 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6274b1d3-c8ff-401c-9c61-b2f37416dd0b None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:35.514078 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6274b1d3-c8ff-401c-9c61-b2f37416dd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:35.553391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add17e22-52ff-429d-9ac9-87d718be4a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:35.553391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add17e22-52ff-429d-9ac9-87d718be4a0a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:35.553391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add17e22-52ff-429d-9ac9-87d718be4a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:35.553391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add17e22-52ff-429d-9ac9-87d718be4a0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:35.553788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add17e22-52ff-429d-9ac9-87d718be4a0a None admin] RBAC: Adding query filter params (group.id=839693481bbc4a7ea85d25aae678af21, role.id=d6dae1fcff6641fcb71c0203d9c4e161, scope.project.id=c63add240dc64d06949b96266e734033) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:35.553788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add17e22-52ff-429d-9ac9-87d718be4a0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:35.554943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add17e22-52ff-429d-9ac9-87d718be4a0a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:35.562742 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 182/357] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jun 27 10:56:35 2022] GET /identity/v3/role_assignments?group.id=839693481bbc4a7ea85d25aae678af21&scope.project.id=c63add240dc64d06949b96266e734033&role.id=d6dae1fcff6641fcb71c0203d9c4e161 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:35.563486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add17e22-52ff-429d-9ac9-87d718be4a0a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:35.565774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:35.616033 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 176/358] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:35.617034 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274b1d3-c8ff-401c-9c61-b2f37416dd0b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:35.749337 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add17e22-52ff-429d-9ac9-87d718be4a0a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:35.754617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274b1d3-c8ff-401c-9c61-b2f37416dd0b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:35.782501 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:35.794053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697babf-dfec-4923-9731-187802c94b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:35.794885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697babf-dfec-4923-9731-187802c94b8a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:35.795167 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697babf-dfec-4923-9731-187802c94b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:35.795442 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697babf-dfec-4923-9731-187802c94b8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:35.801971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecb721-d16c-471a-aaad-a9b4f9f30f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:35.802887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecb721-d16c-471a-aaad-a9b4f9f30f58 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:35.803171 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecb721-d16c-471a-aaad-a9b4f9f30f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:35.803446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecb721-d16c-471a-aaad-a9b4f9f30f58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:35.808649 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697babf-dfec-4923-9731-187802c94b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:35.818780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f697babf-dfec-4923-9731-187802c94b8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:35.818780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:35.818780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:35.818780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:35.818780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:35.818780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:35.818780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:35.818780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:35.818780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:35.818780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:35.818780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:35.818780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:35.818780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:35.818780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:35.818780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:35.818780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:35.819754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:35.819754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:35.819754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:35.819754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:35.819754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:35.819754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:35.819754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:35.819754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:35.819754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:35.819754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:35.819754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:35.819754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:35.819754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:35.819754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:35.819754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:35.819754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:35.820812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:35.820812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:35.820812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:35.820812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:35.820812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:35.820812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:35.820812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:35.820812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:35.820812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:35.820812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:35.820812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:35.820812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:35.820812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 183/359] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:56:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:35.831124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697babf-dfec-4923-9731-187802c94b8a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:35.850244 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:35.888482 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ecb721-d16c-471a-aaad-a9b4f9f30f58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:35.890690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ecb721-d16c-471a-aaad-a9b4f9f30f58 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:35.956340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697babf-dfec-4923-9731-187802c94b8a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:36.001300 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9ca18-7856-4e19-a43b-879730657deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:36.002153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9ca18-7856-4e19-a43b-879730657deb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:36.002430 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9ca18-7856-4e19-a43b-879730657deb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:36.002701 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9ca18-7856-4e19-a43b-879730657deb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:36.017987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9ca18-7856-4e19-a43b-879730657deb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:36.025413 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 177/360] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:36.026366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-c9e9ca18-7856-4e19-a43b-879730657deb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:56:36.026366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:36.026366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:36.026366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:36.026366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:36.026366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:36.026366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:36.026366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:36.026366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:36.026366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:36.026366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:36.026366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:36.026366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:36.026366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:36.026366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:36.026366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:36.028544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:36.028544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:36.028544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:36.028544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:36.028544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:36.028544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:36.028544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:36.028544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:36.028544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:36.028544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:36.028544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:36.028544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:36.028544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:36.028544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:36.028544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:36.028544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:36.029871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:36.029871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:36.029871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:36.029871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:36.029871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:36.029871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:36.029871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:36.029871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:36.029871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:36.029871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:36.029871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:56:36.029871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:36.030507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c4e9d-9164-47d4-aa62-f7130bf30428 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:36.030507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c4e9d-9164-47d4-aa62-f7130bf30428 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:36.030507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c4e9d-9164-47d4-aa62-f7130bf30428 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:36.030708 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 184/361] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:56:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:36.030708 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9ca18-7856-4e19-a43b-879730657deb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:36.030956 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 178/362] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:36.037404 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b2dcf-96fd-46a9-a2fd-00246ecabd72 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:36.037404 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b2dcf-96fd-46a9-a2fd-00246ecabd72 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:36.037404 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b2dcf-96fd-46a9-a2fd-00246ecabd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:36.051832 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-991b2dcf-96fd-46a9-a2fd-00246ecabd72 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:36.053115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-991b2dcf-96fd-46a9-a2fd-00246ecabd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:36.082036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:36.127587 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:36.133884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 179/363] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:36.135277 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b2dcf-96fd-46a9-a2fd-00246ecabd72 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:36.147949 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9ca18-7856-4e19-a43b-879730657deb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:36.206769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330afe32-1534-442b-ac21-cad9e1a1d9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:36.207537 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330afe32-1534-442b-ac21-cad9e1a1d9ec None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:36.207924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330afe32-1534-442b-ac21-cad9e1a1d9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:36.208206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330afe32-1534-442b-ac21-cad9e1a1d9ec None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:36.208952 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330afe32-1534-442b-ac21-cad9e1a1d9ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:36.209254 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330afe32-1534-442b-ac21-cad9e1a1d9ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:36.210663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330afe32-1534-442b-ac21-cad9e1a1d9ec None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:36.224050 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 185/364] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:56:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:36.225114 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330afe32-1534-442b-ac21-cad9e1a1d9ec None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:36.247938 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b2dcf-96fd-46a9-a2fd-00246ecabd72 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:36.291027 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0172d0-e384-4d1d-ab78-80e8e7541372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:36.291891 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0172d0-e384-4d1d-ab78-80e8e7541372 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:36.292171 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0172d0-e384-4d1d-ab78-80e8e7541372 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:36.292444 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0172d0-e384-4d1d-ab78-80e8e7541372 None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:36.293792 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0172d0-e384-4d1d-ab78-80e8e7541372 None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:36.295255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0172d0-e384-4d1d-ab78-80e8e7541372 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:36.296957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 180/365] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:36 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:36.299467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0172d0-e384-4d1d-ab78-80e8e7541372 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:36.340900 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330afe32-1534-442b-ac21-cad9e1a1d9ec None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:36.343919 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:36.376634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80515f8e-e23f-45bd-82d8-05353778c59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:36.377323 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80515f8e-e23f-45bd-82d8-05353778c59c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:36.377633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80515f8e-e23f-45bd-82d8-05353778c59c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:36.377905 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80515f8e-e23f-45bd-82d8-05353778c59c None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:36.378644 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80515f8e-e23f-45bd-82d8-05353778c59c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:36.378944 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80515f8e-e23f-45bd-82d8-05353778c59c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:36.380368 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80515f8e-e23f-45bd-82d8-05353778c59c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:36.387546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:36.389988 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 186/366] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:36.395915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80515f8e-e23f-45bd-82d8-05353778c59c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:36.428510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0172d0-e384-4d1d-ab78-80e8e7541372 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:36.467271 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bacb5-d3a6-4c32-9793-f37ef9c5b8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:36.468539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bacb5-d3a6-4c32-9793-f37ef9c5b8cc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:36.469029 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bacb5-d3a6-4c32-9793-f37ef9c5b8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:36.469538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bacb5-d3a6-4c32-9793-f37ef9c5b8cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:36.482531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bacb5-d3a6-4c32-9793-f37ef9c5b8cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:36.491310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-954bacb5-d3a6-4c32-9793-f37ef9c5b8cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:36.491310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:36.491310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:36.491310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:36.491310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:36.491310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:36.491310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:36.491310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:36.491310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:36.491310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:36.491310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:36.491310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:36.491310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:36.491310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:36.491310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:36.491310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:36.492186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:36.492186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:36.492186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:36.492186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:36.492186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:36.492186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:36.492186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:36.492186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:36.492186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:36.492186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:36.492186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:36.492186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:36.492186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:36.492186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:36.492186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:36.492186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:36.492974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:36.492974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:36.492974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:36.492974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:36.492974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:36.492974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:36.492974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:36.492974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:36.492974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:36.492974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:36.492974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 10:56:36.492974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:36.496744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 181/367] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:36.498136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bacb5-d3a6-4c32-9793-f37ef9c5b8cc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:36.500779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80515f8e-e23f-45bd-82d8-05353778c59c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:36.535221 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10ea36-c916-4ca8-bd99-92889424f9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:36.535863 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10ea36-c916-4ca8-bd99-92889424f9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:36.536142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10ea36-c916-4ca8-bd99-92889424f9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:36.536419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10ea36-c916-4ca8-bd99-92889424f9f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:36.570754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:36.607259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10ea36-c916-4ca8-bd99-92889424f9f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:36.608642 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10ea36-c916-4ca8-bd99-92889424f9f8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:36.621659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bacb5-d3a6-4c32-9793-f37ef9c5b8cc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:36.659198 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:36.671724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00441f-90a2-4448-a702-216fe886b55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:36.673104 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00441f-90a2-4448-a702-216fe886b55b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:36.673638 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00441f-90a2-4448-a702-216fe886b55b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:36.674143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00441f-90a2-4448-a702-216fe886b55b None admin] PATH_INFO: `/v3/groups/839693481bbc4a7ea85d25aae678af21` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:36.675760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00441f-90a2-4448-a702-216fe886b55b None admin] RBAC: Authorizing `identity:get_group(group_id=839693481bbc4a7ea85d25aae678af21)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:36.677833 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00441f-90a2-4448-a702-216fe886b55b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:36.679901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 182/368] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jun 27 10:56:36 2022] GET /identity/v3/groups/839693481bbc4a7ea85d25aae678af21 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:36.681785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00441f-90a2-4448-a702-216fe886b55b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:36.713452 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 187/369] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:36.714291 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10ea36-c916-4ca8-bd99-92889424f9f8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:36.786004 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:36.808651 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00441f-90a2-4448-a702-216fe886b55b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:36.822962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10ea36-c916-4ca8-bd99-92889424f9f8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:36.850786 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5271d-fdea-4531-9b44-d3ece4385bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:36.851964 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5271d-fdea-4531-9b44-d3ece4385bfc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:36.852451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5271d-fdea-4531-9b44-d3ece4385bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:36.852972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5271d-fdea-4531-9b44-d3ece4385bfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:36.857416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030bb53-00aa-49ac-a832-ca0577a01f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:36.858038 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030bb53-00aa-49ac-a832-ca0577a01f9c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:36.858317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030bb53-00aa-49ac-a832-ca0577a01f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:36.858590 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030bb53-00aa-49ac-a832-ca0577a01f9c None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:36.859331 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030bb53-00aa-49ac-a832-ca0577a01f9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:36.859633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030bb53-00aa-49ac-a832-ca0577a01f9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:36.861100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030bb53-00aa-49ac-a832-ca0577a01f9c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:36.870430 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 188/370] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:36.870973 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030bb53-00aa-49ac-a832-ca0577a01f9c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:36.929102 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:36.939376 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5271d-fdea-4531-9b44-d3ece4385bfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:36.941547 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5271d-fdea-4531-9b44-d3ece4385bfc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:36.977120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030bb53-00aa-49ac-a832-ca0577a01f9c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:37.003887 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:37.013670 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ceee6-7175-4e18-a58c-437690419487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:37.014469 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ceee6-7175-4e18-a58c-437690419487 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:37.014847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ceee6-7175-4e18-a58c-437690419487 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:37.015218 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ceee6-7175-4e18-a58c-437690419487 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:37.016143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ceee6-7175-4e18-a58c-437690419487 None admin] RBAC: Adding query filter params (group.id=839693481bbc4a7ea85d25aae678af21, role.id=2c7768e02a39438fbe2c3551ff3b19a4, scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:37.016550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ceee6-7175-4e18-a58c-437690419487 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:37.018094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ceee6-7175-4e18-a58c-437690419487 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:37.024148 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 189/371] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jun 27 10:56:36 2022] GET /identity/v3/role_assignments?group.id=839693481bbc4a7ea85d25aae678af21&scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b&role.id=2c7768e02a39438fbe2c3551ff3b19a4 => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:37.025092 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ceee6-7175-4e18-a58c-437690419487 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:37.060270 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 183/372] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:37.066544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5271d-fdea-4531-9b44-d3ece4385bfc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:37.137972 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ceee6-7175-4e18-a58c-437690419487 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:37.173212 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88282e32-814d-445b-b568-c8ae8237045e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:37.174168 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88282e32-814d-445b-b568-c8ae8237045e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:37.174447 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88282e32-814d-445b-b568-c8ae8237045e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:37.174767 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88282e32-814d-445b-b568-c8ae8237045e None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:37.175959 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88282e32-814d-445b-b568-c8ae8237045e None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:37.177400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88282e32-814d-445b-b568-c8ae8237045e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:37.180052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 190/373] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:37 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:37.180179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88282e32-814d-445b-b568-c8ae8237045e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:37.247738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:37.252195 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:37.275466 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5271d-fdea-4531-9b44-d3ece4385bfc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:37.295033 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88282e32-814d-445b-b568-c8ae8237045e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:37.334034 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bdcfe-f2a4-4ce1-a744-69a42e57ce96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:37.335456 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bdcfe-f2a4-4ce1-a744-69a42e57ce96 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:37.335742 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bdcfe-f2a4-4ce1-a744-69a42e57ce96 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:37.336030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bdcfe-f2a4-4ce1-a744-69a42e57ce96 None admin] PATH_INFO: `/v3/projects/4ccd8cb3bebf4369b70aa2f145132951` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:37.340846 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bdcfe-f2a4-4ce1-a744-69a42e57ce96 None admin] RBAC: Authorizing `identity:get_project(project_id=4ccd8cb3bebf4369b70aa2f145132951)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:37.340846 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bdcfe-f2a4-4ce1-a744-69a42e57ce96 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:37.340846 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 191/374] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:37 2022] GET /identity/v3/projects/4ccd8cb3bebf4369b70aa2f145132951 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:37.341579 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bdcfe-f2a4-4ce1-a744-69a42e57ce96 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:37.370719 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5aef5-6e37-45a8-ade1-a7ed915264d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:37.371970 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5aef5-6e37-45a8-ade1-a7ed915264d4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:37.372456 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5aef5-6e37-45a8-ade1-a7ed915264d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:37.372926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5aef5-6e37-45a8-ade1-a7ed915264d4 None admin] PATH_INFO: `/v3/users/3f569570725143f79f79886cf9761874` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:37.374405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5aef5-6e37-45a8-ade1-a7ed915264d4 None admin] RBAC: Authorizing `identity:get_user(user_id=3f569570725143f79f79886cf9761874)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:37.376050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5aef5-6e37-45a8-ade1-a7ed915264d4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:37.386291 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 184/375] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:56:37 2022] GET /identity/v3/users/3f569570725143f79f79886cf9761874 => generated 293 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:37.387526 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5aef5-6e37-45a8-ade1-a7ed915264d4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:37.460926 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bdcfe-f2a4-4ce1-a744-69a42e57ce96 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:37.491417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:37.502834 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ea1ef-3c1f-42c7-b76f-021201c7991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:37.503845 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ea1ef-3c1f-42c7-b76f-021201c7991e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:37.504127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ea1ef-3c1f-42c7-b76f-021201c7991e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:37.504401 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ea1ef-3c1f-42c7-b76f-021201c7991e None admin] PATH_INFO: `/v3/groups/839693481bbc4a7ea85d25aae678af21` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:37.505957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ea1ef-3c1f-42c7-b76f-021201c7991e None admin] RBAC: Authorizing `identity:get_group(group_id=839693481bbc4a7ea85d25aae678af21)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:37.507448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ea1ef-3c1f-42c7-b76f-021201c7991e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:37.509120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 192/376] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jun 27 10:56:37 2022] GET /identity/v3/groups/839693481bbc4a7ea85d25aae678af21 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:37.510124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ea1ef-3c1f-42c7-b76f-021201c7991e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:37.623087 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ea1ef-3c1f-42c7-b76f-021201c7991e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:37.637985 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5aef5-6e37-45a8-ade1-a7ed915264d4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:37.658493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711fd74-c65c-4730-b6f4-1606f9b018af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:37.659150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711fd74-c65c-4730-b6f4-1606f9b018af None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:37.659427 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711fd74-c65c-4730-b6f4-1606f9b018af None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:37.659698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711fd74-c65c-4730-b6f4-1606f9b018af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:37.660529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711fd74-c65c-4730-b6f4-1606f9b018af None admin] RBAC: Adding query filter params (role.id=6f15d5ee845e4facaee3e8b8d247dd28, user.id=3f569570725143f79f79886cf9761874, scope.system=all) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:37.660838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711fd74-c65c-4730-b6f4-1606f9b018af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:37.662381 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711fd74-c65c-4730-b6f4-1606f9b018af None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:37.675647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 193/377] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Jun 27 10:56:37 2022] GET /identity/v3/role_assignments?user.id=3f569570725143f79f79886cf9761874&scope.system=all&role.id=6f15d5ee845e4facaee3e8b8d247dd28 => generated 510 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:37.676269 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711fd74-c65c-4730-b6f4-1606f9b018af None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:37.699010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06d5ae-2a3c-4c04-ab92-18f321f03f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:37.699887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06d5ae-2a3c-4c04-ab92-18f321f03f88 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:37.700170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06d5ae-2a3c-4c04-ab92-18f321f03f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:37.700443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06d5ae-2a3c-4c04-ab92-18f321f03f88 None admin] PATH_INFO: `/v3/groups/b1c67b62d3b24635a8db931a1ea1af4e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:37.711807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06d5ae-2a3c-4c04-ab92-18f321f03f88 None admin] RBAC: Authorizing `identity:get_group(group_id=b1c67b62d3b24635a8db931a1ea1af4e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:37.713781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06d5ae-2a3c-4c04-ab92-18f321f03f88 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:37.715838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 185/378] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jun 27 10:56:37 2022] GET /identity/v3/groups/b1c67b62d3b24635a8db931a1ea1af4e => generated 229 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:37.739135 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06d5ae-2a3c-4c04-ab92-18f321f03f88 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:37.746962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:37.793851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:37.799236 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711fd74-c65c-4730-b6f4-1606f9b018af None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:37.836322 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675f8cf-a275-4b82-8148-2356b43316a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:37.837528 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675f8cf-a275-4b82-8148-2356b43316a8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:37.837809 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675f8cf-a275-4b82-8148-2356b43316a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:37.838082 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675f8cf-a275-4b82-8148-2356b43316a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:37.838921 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675f8cf-a275-4b82-8148-2356b43316a8 None admin] RBAC: Adding query filter params (group.id=839693481bbc4a7ea85d25aae678af21, role.id=d6dae1fcff6641fcb71c0203d9c4e161, scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:37.839227 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675f8cf-a275-4b82-8148-2356b43316a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:37.840678 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675f8cf-a275-4b82-8148-2356b43316a8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:37.847234 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 194/379] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jun 27 10:56:37 2022] GET /identity/v3/role_assignments?group.id=839693481bbc4a7ea85d25aae678af21&scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b&role.id=d6dae1fcff6641fcb71c0203d9c4e161 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:37.900942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06d5ae-2a3c-4c04-ab92-18f321f03f88 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:37.920544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afbd97-48da-4eb8-86aa-b62ca2dc6c1b None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:37.920852 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afbd97-48da-4eb8-86aa-b62ca2dc6c1b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:37.921107 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afbd97-48da-4eb8-86aa-b62ca2dc6c1b None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:37.922839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 195/380] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:37.935925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fba29c-a0a9-4a56-98e2-786a7c7736bb None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:37.936261 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fba29c-a0a9-4a56-98e2-786a7c7736bb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:37.936628 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fba29c-a0a9-4a56-98e2-786a7c7736bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:37.944041 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a71e2f-0ce6-4302-8784-121cc25fe0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:37.944717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a71e2f-0ce6-4302-8784-121cc25fe0bc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:37.944993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a71e2f-0ce6-4302-8784-121cc25fe0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:37.945271 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a71e2f-0ce6-4302-8784-121cc25fe0bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:37.946160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a71e2f-0ce6-4302-8784-121cc25fe0bc None admin] RBAC: Adding query filter params (group.id=b1c67b62d3b24635a8db931a1ea1af4e, role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=4ccd8cb3bebf4369b70aa2f145132951) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:37.947004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a71e2f-0ce6-4302-8784-121cc25fe0bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:37.948499 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a71e2f-0ce6-4302-8784-121cc25fe0bc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:37.955225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 186/381] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jun 27 10:56:37 2022] GET /identity/v3/role_assignments?group.id=b1c67b62d3b24635a8db931a1ea1af4e&scope.project.id=4ccd8cb3bebf4369b70aa2f145132951&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:37.973770 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-56fba29c-a0a9-4a56-98e2-786a7c7736bb None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:37.974928 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-56fba29c-a0a9-4a56-98e2-786a7c7736bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:38.084674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 196/382] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:38.108024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a71e2f-0ce6-4302-8784-121cc25fe0bc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:38.137697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78003e8-fe6b-46a6-b8b8-9dd414698cb9 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:38.138265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78003e8-fe6b-46a6-b8b8-9dd414698cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:38.138729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78003e8-fe6b-46a6-b8b8-9dd414698cb9 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:38.140641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 197/383] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:56:38.147031 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540877d-b568-40d0-914e-b506bc0f7d30 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:38.147607 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540877d-b568-40d0-914e-b506bc0f7d30 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:38.148066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540877d-b568-40d0-914e-b506bc0f7d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:38.168462 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2540877d-b568-40d0-914e-b506bc0f7d30 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:38.169963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2540877d-b568-40d0-914e-b506bc0f7d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:38.235959 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:38.242433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:38.251110 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a71e2f-0ce6-4302-8784-121cc25fe0bc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:38.270785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 198/384] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:38.296783 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059a748-8b55-4cbf-93f8-3cf77a831d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:38.298401 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059a748-8b55-4cbf-93f8-3cf77a831d9b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:38.298924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059a748-8b55-4cbf-93f8-3cf77a831d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:38.299429 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059a748-8b55-4cbf-93f8-3cf77a831d9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:38.301023 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540877d-b568-40d0-914e-b506bc0f7d30 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:38.314991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059a748-8b55-4cbf-93f8-3cf77a831d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:38.324317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-f059a748-8b55-4cbf-93f8-3cf77a831d9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:38.324317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:38.324317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:38.324317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:38.324317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:38.324317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:38.324317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:38.324317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:38.324317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:38.324317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:38.324317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:38.324317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:38.324317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:38.324317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:38.324317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:38.324317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:38.325197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:38.325197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:38.325197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:38.325197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:38.325197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:38.325197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:38.325197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:38.325197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:38.325197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:38.325197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:38.325197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:38.325197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:38.325197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:38.325197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:38.325197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:38.325197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:38.326026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:38.326026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:38.326026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:38.326026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:38.326026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:38.326026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:38.326026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:38.326026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:38.326026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:38.326026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:38.326026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:38.326026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:38.328519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 187/385] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:38.334770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059a748-8b55-4cbf-93f8-3cf77a831d9b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:38.439307 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540877d-b568-40d0-914e-b506bc0f7d30 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:38.494996 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059a748-8b55-4cbf-93f8-3cf77a831d9b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:38.500695 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab2f55-1151-4aca-b9ca-72dbb6e4e270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:38.504348 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab2f55-1151-4aca-b9ca-72dbb6e4e270 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:38.504925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab2f55-1151-4aca-b9ca-72dbb6e4e270 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:38.505409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab2f55-1151-4aca-b9ca-72dbb6e4e270 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:38.523632 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab2f55-1151-4aca-b9ca-72dbb6e4e270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:38.533826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-18ab2f55-1151-4aca-b9ca-72dbb6e4e270 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:38.533826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:38.533826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:38.533826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:38.533826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:38.533826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:38.533826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:38.533826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:38.533826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:38.533826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:38.533826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:38.533826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:38.533826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:38.533826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:38.533826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:38.533826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:38.534727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:38.534727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:38.534727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:38.534727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:38.534727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:38.534727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:38.534727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:38.534727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:38.534727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:38.534727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:38.534727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:38.534727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:38.534727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:38.534727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:38.534727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:38.534727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:38.535495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:38.535495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:38.535495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:38.535495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:38.535495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:38.535495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:38.535495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:38.535495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:38.535495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:38.535495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:38.535495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:38.535495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:38.545645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 199/386] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:56:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:38.551482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab2f55-1151-4aca-b9ca-72dbb6e4e270 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:38.568910 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e944c6-1350-4c3a-8660-867505ca2ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:38.570032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e944c6-1350-4c3a-8660-867505ca2ede None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:38.570509 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e944c6-1350-4c3a-8660-867505ca2ede None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:38.570988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e944c6-1350-4c3a-8660-867505ca2ede None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:38.572497 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e944c6-1350-4c3a-8660-867505ca2ede None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:38.573533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e944c6-1350-4c3a-8660-867505ca2ede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:38.575920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e944c6-1350-4c3a-8660-867505ca2ede None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:38.593218 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 188/387] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:38.607771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e944c6-1350-4c3a-8660-867505ca2ede None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:38.632628 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:38.636679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:38.752369 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab2f55-1151-4aca-b9ca-72dbb6e4e270 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:38.780245 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e944c6-1350-4c3a-8660-867505ca2ede None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:38.819602 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad0379-2619-4cd9-89f9-8ce8201854f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:38.820269 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad0379-2619-4cd9-89f9-8ce8201854f6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:38.820547 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad0379-2619-4cd9-89f9-8ce8201854f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:38.820822 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad0379-2619-4cd9-89f9-8ce8201854f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:38.821632 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad0379-2619-4cd9-89f9-8ce8201854f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:38.821932 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad0379-2619-4cd9-89f9-8ce8201854f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:38.823284 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad0379-2619-4cd9-89f9-8ce8201854f6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:38.840688 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 200/388] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:56:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:38.842990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ca643-d108-4bf8-948d-2e744d563133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:38.844911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad0379-2619-4cd9-89f9-8ce8201854f6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:38.845025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ca643-d108-4bf8-948d-2e744d563133 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:38.845304 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ca643-d108-4bf8-948d-2e744d563133 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:38.845615 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ca643-d108-4bf8-948d-2e744d563133 None admin] PATH_INFO: `/v3/groups/839693481bbc4a7ea85d25aae678af21` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:38.847464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ca643-d108-4bf8-948d-2e744d563133 None admin] RBAC: Authorizing `identity:get_group(group_id=839693481bbc4a7ea85d25aae678af21)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:38.850893 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ca643-d108-4bf8-948d-2e744d563133 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:38.854227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 189/389] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jun 27 10:56:38 2022] GET /identity/v3/groups/839693481bbc4a7ea85d25aae678af21 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:38.859524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ca643-d108-4bf8-948d-2e744d563133 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:39.009179 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:39.026466 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:39.031102 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad0379-2619-4cd9-89f9-8ce8201854f6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:39.047207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ca643-d108-4bf8-948d-2e744d563133 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:39.090245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b5081-6bef-43ce-b1ff-e6b5ed509a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:39.091293 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b5081-6bef-43ce-b1ff-e6b5ed509a90 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:39.091570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b5081-6bef-43ce-b1ff-e6b5ed509a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:39.091840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b5081-6bef-43ce-b1ff-e6b5ed509a90 None admin] PATH_INFO: `/v3/groups/839693481bbc4a7ea85d25aae678af21` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:39.093730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b5081-6bef-43ce-b1ff-e6b5ed509a90 None admin] RBAC: Authorizing `identity:get_group(group_id=839693481bbc4a7ea85d25aae678af21)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:39.095164 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b5081-6bef-43ce-b1ff-e6b5ed509a90 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:39.097913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 201/390] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jun 27 10:56:38 2022] GET /identity/v3/groups/839693481bbc4a7ea85d25aae678af21 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:39.104756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b5081-6bef-43ce-b1ff-e6b5ed509a90 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:39.112399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89248-cae3-435c-baf2-ea638f6074de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:39.113252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89248-cae3-435c-baf2-ea638f6074de None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:39.113559 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89248-cae3-435c-baf2-ea638f6074de None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:39.113834 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89248-cae3-435c-baf2-ea638f6074de None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:39.118450 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e89248-cae3-435c-baf2-ea638f6074de None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:39.119908 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e89248-cae3-435c-baf2-ea638f6074de None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:39.125630 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 190/391] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:38 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:39.128915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89248-cae3-435c-baf2-ea638f6074de None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:39.300101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b5081-6bef-43ce-b1ff-e6b5ed509a90 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:39.329292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89248-cae3-435c-baf2-ea638f6074de None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:39.354001 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515ba10-268e-4dca-96f3-41848b5a6234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:39.355212 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515ba10-268e-4dca-96f3-41848b5a6234 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:39.355689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515ba10-268e-4dca-96f3-41848b5a6234 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:39.356174 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515ba10-268e-4dca-96f3-41848b5a6234 None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:39.359060 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515ba10-268e-4dca-96f3-41848b5a6234 None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:39.360744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515ba10-268e-4dca-96f3-41848b5a6234 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:39.372640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 202/392] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:39 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:39.386701 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515ba10-268e-4dca-96f3-41848b5a6234 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:39.400485 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce5def-4908-491e-9ce3-1cb25a025877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:39.403003 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5def-4908-491e-9ce3-1cb25a025877 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:39.404166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5def-4908-491e-9ce3-1cb25a025877 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:39.404823 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5def-4908-491e-9ce3-1cb25a025877 None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033/groups/839693481bbc4a7ea85d25aae678af21/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:39.409224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce5def-4908-491e-9ce3-1cb25a025877 None admin] RBAC: Authorizing `identity:create_grant(project_id=c63add240dc64d06949b96266e734033, group_id=839693481bbc4a7ea85d25aae678af21, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:39.411976 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce5def-4908-491e-9ce3-1cb25a025877 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:39.437037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 191/393] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Jun 27 10:56:39 2022] PUT /identity/v3/projects/c63add240dc64d06949b96266e734033/groups/839693481bbc4a7ea85d25aae678af21/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:56:39.444189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:39.530805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515ba10-268e-4dca-96f3-41848b5a6234 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:39.576703 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626f258-5274-4169-bcf1-84d6d74ce5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:39.577967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626f258-5274-4169-bcf1-84d6d74ce5a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:39.578470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626f258-5274-4169-bcf1-84d6d74ce5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:39.578941 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626f258-5274-4169-bcf1-84d6d74ce5a1 None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033/groups/839693481bbc4a7ea85d25aae678af21/roles/d6dae1fcff6641fcb71c0203d9c4e161` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:39.581484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626f258-5274-4169-bcf1-84d6d74ce5a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c63add240dc64d06949b96266e734033, group_id=839693481bbc4a7ea85d25aae678af21, role_id=d6dae1fcff6641fcb71c0203d9c4e161)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:39.583200 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626f258-5274-4169-bcf1-84d6d74ce5a1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:39.605695 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 203/394] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Jun 27 10:56:39 2022] PUT /identity/v3/projects/c63add240dc64d06949b96266e734033/groups/839693481bbc4a7ea85d25aae678af21/roles/d6dae1fcff6641fcb71c0203d9c4e161 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 10:56:39.825004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4973a3-5be1-421f-a05f-e53162005dd9 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:39.825643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4973a3-5be1-421f-a05f-e53162005dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:39.825926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4973a3-5be1-421f-a05f-e53162005dd9 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:39.827519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 192/395] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:39.833018 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0364d6-8b12-4858-8487-27e43a388984 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:39.833425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0364d6-8b12-4858-8487-27e43a388984 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:39.833694 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0364d6-8b12-4858-8487-27e43a388984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:39.851947 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3e0364d6-8b12-4858-8487-27e43a388984 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:39.853594 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3e0364d6-8b12-4858-8487-27e43a388984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:39.929552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 204/396] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:39.952795 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4973a3-5be1-421f-a05f-e53162005dd9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:39.966401 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:40.067340 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4973a3-5be1-421f-a05f-e53162005dd9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:40.106642 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3f750-c973-4ee6-90e5-f2ede54c8b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:40.107408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3f750-c973-4ee6-90e5-f2ede54c8b30 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:40.107746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3f750-c973-4ee6-90e5-f2ede54c8b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:40.108027 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3f750-c973-4ee6-90e5-f2ede54c8b30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:40.121080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3f750-c973-4ee6-90e5-f2ede54c8b30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:40.129004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-87c3f750-c973-4ee6-90e5-f2ede54c8b30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:40.129004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:40.129004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:40.129004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:40.129004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:40.129004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:40.129004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:40.129004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:40.129004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:40.129004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:40.129004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:40.129004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:40.129004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:40.129004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:40.129004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:40.129004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:40.129936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:40.129936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:40.129936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:40.129936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:40.129936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:40.129936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:40.129936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:40.129936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:40.129936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:40.129936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:40.129936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:40.129936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:40.129936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:40.129936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:40.129936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:40.129936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:40.130717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:40.130717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:40.130717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:40.130717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:40.130717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:40.130717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:40.130717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:40.130717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:40.130717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:40.130717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:40.130717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:40.130717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:40.130717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 193/397] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:40.138514 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0364d6-8b12-4858-8487-27e43a388984 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:40.167698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:40.248705 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0364d6-8b12-4858-8487-27e43a388984 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:40.284122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d5d4e-b112-4e6e-b023-6a72f3e560c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:40.284788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5d4e-b112-4e6e-b023-6a72f3e560c4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:40.285071 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5d4e-b112-4e6e-b023-6a72f3e560c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:40.285346 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5d4e-b112-4e6e-b023-6a72f3e560c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:40.286128 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d5d4e-b112-4e6e-b023-6a72f3e560c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:40.286435 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d5d4e-b112-4e6e-b023-6a72f3e560c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:40.287925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d5d4e-b112-4e6e-b023-6a72f3e560c4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:40.301498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 205/398] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:40.303177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3f750-c973-4ee6-90e5-f2ede54c8b30 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:40.383935 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:40.420261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3f750-c973-4ee6-90e5-f2ede54c8b30 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:40.442137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90675d35-4702-4675-9223-2339e4ff636b None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:40.442482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90675d35-4702-4675-9223-2339e4ff636b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:40.442705 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90675d35-4702-4675-9223-2339e4ff636b None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:40.444357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 206/399] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:40.453007 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c45340-bd34-4e4a-91e4-fd3514b3717c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:40.453295 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c45340-bd34-4e4a-91e4-fd3514b3717c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:40.453611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c45340-bd34-4e4a-91e4-fd3514b3717c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:40.475060 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b6c45340-bd34-4e4a-91e4-fd3514b3717c None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:40.476260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b6c45340-bd34-4e4a-91e4-fd3514b3717c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:40.488265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c8ce8-cb3e-470b-9e53-41c714ac07ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:40.489130 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c8ce8-cb3e-470b-9e53-41c714ac07ca None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:40.489441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c8ce8-cb3e-470b-9e53-41c714ac07ca None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:40.489723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c8ce8-cb3e-470b-9e53-41c714ac07ca None admin] PATH_INFO: `/v3/groups/839693481bbc4a7ea85d25aae678af21` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:40.495943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c8ce8-cb3e-470b-9e53-41c714ac07ca None admin] RBAC: Authorizing `identity:get_group(group_id=839693481bbc4a7ea85d25aae678af21)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:40.497490 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c8ce8-cb3e-470b-9e53-41c714ac07ca None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:40.503649 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 194/400] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jun 27 10:56:40 2022] GET /identity/v3/groups/839693481bbc4a7ea85d25aae678af21 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:40.522934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c8ce8-cb3e-470b-9e53-41c714ac07ca None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:40.628399 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 207/401] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:40.667810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c45340-bd34-4e4a-91e4-fd3514b3717c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:40.695359 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:40.710944 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c8ce8-cb3e-470b-9e53-41c714ac07ca None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:40.775812 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8be09-e6ce-442a-936a-ad2933d5fa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:40.776780 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8be09-e6ce-442a-936a-ad2933d5fa1a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:40.777083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8be09-e6ce-442a-936a-ad2933d5fa1a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:40.780600 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8be09-e6ce-442a-936a-ad2933d5fa1a None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:40.781892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8be09-e6ce-442a-936a-ad2933d5fa1a None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:40.783524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8be09-e6ce-442a-936a-ad2933d5fa1a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:40.789492 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 195/402] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:40 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:40.792147 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8be09-e6ce-442a-936a-ad2933d5fa1a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:40.801705 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:40.909350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8be09-e6ce-442a-936a-ad2933d5fa1a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:40.951686 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f5c15-aad2-4890-af65-bec2af9ff0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:40.952505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f5c15-aad2-4890-af65-bec2af9ff0d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:40.952793 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f5c15-aad2-4890-af65-bec2af9ff0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:40.953074 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f5c15-aad2-4890-af65-bec2af9ff0d8 None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b/groups/839693481bbc4a7ea85d25aae678af21/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:40.955292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f5c15-aad2-4890-af65-bec2af9ff0d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=da939275ad904ac98f1c2ad9e6fdc28b, group_id=839693481bbc4a7ea85d25aae678af21, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:40.956767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f5c15-aad2-4890-af65-bec2af9ff0d8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:40.964021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c45340-bd34-4e4a-91e4-fd3514b3717c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:40.981803 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 196/403] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Jun 27 10:56:40 2022] PUT /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b/groups/839693481bbc4a7ea85d25aae678af21/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:56:41.011199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459ca72-3038-452b-9e88-447ca6d321f1 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:41.011530 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459ca72-3038-452b-9e88-447ca6d321f1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:41.011767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459ca72-3038-452b-9e88-447ca6d321f1 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:41.013354 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 197/404] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:56:41.019059 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74ac77-ea22-4e5a-94ec-e9b5f1b121ad None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:41.019356 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74ac77-ea22-4e5a-94ec-e9b5f1b121ad None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:41.019640 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74ac77-ea22-4e5a-94ec-e9b5f1b121ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:41.040481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7456e3f-3b99-4e8a-975c-f18ee0771049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:41.041762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7456e3f-3b99-4e8a-975c-f18ee0771049 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:41.042324 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7456e3f-3b99-4e8a-975c-f18ee0771049 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:41.042795 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7456e3f-3b99-4e8a-975c-f18ee0771049 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:41.054935 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cc74ac77-ea22-4e5a-94ec-e9b5f1b121ad None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:41.058140 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cc74ac77-ea22-4e5a-94ec-e9b5f1b121ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:41.067489 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7456e3f-3b99-4e8a-975c-f18ee0771049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:41.083968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-b7456e3f-3b99-4e8a-975c-f18ee0771049 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:41.083968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:41.083968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:41.083968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:41.083968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:41.083968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:41.083968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:41.083968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:41.083968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:41.083968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:41.083968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:41.083968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:41.083968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:41.083968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:41.083968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:41.083968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:41.084907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:41.084907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:41.084907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:41.084907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:41.084907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:41.084907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:41.084907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:41.084907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:41.084907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:41.084907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:41.084907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:41.084907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:41.084907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:41.084907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:41.084907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:41.084907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:41.085750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:41.085750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:41.085750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:41.085750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:41.085750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:41.085750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:41.085750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:41.085750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:41.085750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:41.085750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:41.085750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:41.085750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:41.090621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 208/405] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:56:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:41.096627 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7456e3f-3b99-4e8a-975c-f18ee0771049 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:41.175426 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:41.189007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 198/406] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:41.218702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74ac77-ea22-4e5a-94ec-e9b5f1b121ad None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:41.240706 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:41.269652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7456e3f-3b99-4e8a-975c-f18ee0771049 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:41.311751 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c640b12-89c9-40ae-b476-6865c92d0ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:41.312548 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c640b12-89c9-40ae-b476-6865c92d0ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:41.312831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c640b12-89c9-40ae-b476-6865c92d0ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:41.313103 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c640b12-89c9-40ae-b476-6865c92d0ac8 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:41.313973 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c640b12-89c9-40ae-b476-6865c92d0ac8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:41.314268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c640b12-89c9-40ae-b476-6865c92d0ac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:41.315690 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c640b12-89c9-40ae-b476-6865c92d0ac8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:41.325883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 209/407] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:56:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:41.333836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c640b12-89c9-40ae-b476-6865c92d0ac8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:41.350289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74ac77-ea22-4e5a-94ec-e9b5f1b121ad None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:41.393964 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee44b6b-829d-4b41-855e-20248c596ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:41.395844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee44b6b-829d-4b41-855e-20248c596ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:41.396755 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee44b6b-829d-4b41-855e-20248c596ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:41.397180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee44b6b-829d-4b41-855e-20248c596ee8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:41.411852 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee44b6b-829d-4b41-855e-20248c596ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:41.423251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-fee44b6b-829d-4b41-855e-20248c596ee8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:56:41.423251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:41.423251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:41.423251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:41.423251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:41.423251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:41.423251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:41.423251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:41.423251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:41.423251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:41.423251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:41.423251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:41.423251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:41.423251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:41.423251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:41.423251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:41.424337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:41.424337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:41.424337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:41.424337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:41.424337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:41.424337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:41.424337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:41.424337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:41.424337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:41.424337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:41.424337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:41.424337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:41.424337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:41.424337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:41.424337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:41.424337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:41.425343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:41.425343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:41.425343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:41.425343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:41.425343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:41.425343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:41.425343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:41.425343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:41.425343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:41.425343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:41.425343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:56:41.425343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:41.427618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 199/408] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:56:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:41.436226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee44b6b-829d-4b41-855e-20248c596ee8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:41.466496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c640b12-89c9-40ae-b476-6865c92d0ac8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:41.504722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca003b9b-47e3-4909-a35f-700dab613b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:41.505951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca003b9b-47e3-4909-a35f-700dab613b76 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:41.506427 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca003b9b-47e3-4909-a35f-700dab613b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:41.506976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca003b9b-47e3-4909-a35f-700dab613b76 None admin] PATH_INFO: `/v3/groups/839693481bbc4a7ea85d25aae678af21` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:41.510062 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca003b9b-47e3-4909-a35f-700dab613b76 None admin] RBAC: Authorizing `identity:get_group(group_id=839693481bbc4a7ea85d25aae678af21)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:41.511995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca003b9b-47e3-4909-a35f-700dab613b76 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:41.513922 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 210/409] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jun 27 10:56:41 2022] GET /identity/v3/groups/839693481bbc4a7ea85d25aae678af21 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:41.519344 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca003b9b-47e3-4909-a35f-700dab613b76 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:41.538525 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:41.560093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:41.616145 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee44b6b-829d-4b41-855e-20248c596ee8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:41.667897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c245f2-d2e4-42a0-91cf-0af948472a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:41.668899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c245f2-d2e4-42a0-91cf-0af948472a64 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:41.669357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c245f2-d2e4-42a0-91cf-0af948472a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:41.671011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c245f2-d2e4-42a0-91cf-0af948472a64 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:41.673315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c245f2-d2e4-42a0-91cf-0af948472a64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:41.673840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c245f2-d2e4-42a0-91cf-0af948472a64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:41.675493 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c245f2-d2e4-42a0-91cf-0af948472a64 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:41.697004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 200/410] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:41.702665 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c245f2-d2e4-42a0-91cf-0af948472a64 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:41.761092 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca003b9b-47e3-4909-a35f-700dab613b76 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:41.831759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bd1aa-04a0-42c0-add6-b077996ff280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:41.832943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bd1aa-04a0-42c0-add6-b077996ff280 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:41.833416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bd1aa-04a0-42c0-add6-b077996ff280 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:41.833861 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bd1aa-04a0-42c0-add6-b077996ff280 None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:41.836095 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bd1aa-04a0-42c0-add6-b077996ff280 None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:41.837767 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bd1aa-04a0-42c0-add6-b077996ff280 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:41.840612 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 211/411] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:41 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:41.850406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bd1aa-04a0-42c0-add6-b077996ff280 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:41.890433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c245f2-d2e4-42a0-91cf-0af948472a64 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:41.928536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:41.947973 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa220ec-9732-4893-be06-6da342eb5a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:41.949488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa220ec-9732-4893-be06-6da342eb5a60 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:41.949970 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa220ec-9732-4893-be06-6da342eb5a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:41.950437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa220ec-9732-4893-be06-6da342eb5a60 None admin] PATH_INFO: `/v3/groups/b1c67b62d3b24635a8db931a1ea1af4e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:41.951854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa220ec-9732-4893-be06-6da342eb5a60 None admin] RBAC: Authorizing `identity:get_group(group_id=b1c67b62d3b24635a8db931a1ea1af4e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:41.953577 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa220ec-9732-4893-be06-6da342eb5a60 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:41.956278 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 201/412] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jun 27 10:56:41 2022] GET /identity/v3/groups/b1c67b62d3b24635a8db931a1ea1af4e => generated 229 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:41.967332 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa220ec-9732-4893-be06-6da342eb5a60 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:41.990608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:42.033173 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bd1aa-04a0-42c0-add6-b077996ff280 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:42.107373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68265b85-4da8-49ed-8c5b-92efbd05801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:42.108614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265b85-4da8-49ed-8c5b-92efbd05801e None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:42.109258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265b85-4da8-49ed-8c5b-92efbd05801e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:42.110518 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265b85-4da8-49ed-8c5b-92efbd05801e None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b/groups/839693481bbc4a7ea85d25aae678af21/roles/d6dae1fcff6641fcb71c0203d9c4e161` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:42.114330 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68265b85-4da8-49ed-8c5b-92efbd05801e None admin] RBAC: Authorizing `identity:create_grant(project_id=da939275ad904ac98f1c2ad9e6fdc28b, group_id=839693481bbc4a7ea85d25aae678af21, role_id=d6dae1fcff6641fcb71c0203d9c4e161)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:42.117312 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68265b85-4da8-49ed-8c5b-92efbd05801e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:42.140768 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 212/413] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Jun 27 10:56:41 2022] PUT /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b/groups/839693481bbc4a7ea85d25aae678af21/roles/d6dae1fcff6641fcb71c0203d9c4e161 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:56:42.163785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa220ec-9732-4893-be06-6da342eb5a60 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:42.213149 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2aafc3-9b16-454d-ab3e-72d0566dbce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:42.214343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aafc3-9b16-454d-ab3e-72d0566dbce7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:42.214854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aafc3-9b16-454d-ab3e-72d0566dbce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:42.215328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aafc3-9b16-454d-ab3e-72d0566dbce7 None admin] PATH_INFO: `/v3/projects/4ccd8cb3bebf4369b70aa2f145132951` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:42.216761 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2aafc3-9b16-454d-ab3e-72d0566dbce7 None admin] RBAC: Authorizing `identity:get_project(project_id=4ccd8cb3bebf4369b70aa2f145132951)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:42.218518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2aafc3-9b16-454d-ab3e-72d0566dbce7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:42.220546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 202/414] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:41 2022] GET /identity/v3/projects/4ccd8cb3bebf4369b70aa2f145132951 => generated 344 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:42.226327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68265b85-4da8-49ed-8c5b-92efbd05801e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:42.239107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92e1de-8601-4feb-8635-a23dcb3ab93d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:42.239107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92e1de-8601-4feb-8635-a23dcb3ab93d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:42.239355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92e1de-8601-4feb-8635-a23dcb3ab93d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:42.241020 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 203/415] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:56:42.247127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e59731-4210-4c72-a0bf-4443e5fd4798 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:42.247541 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e59731-4210-4c72-a0bf-4443e5fd4798 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:42.247645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e59731-4210-4c72-a0bf-4443e5fd4798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:42.266329 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-16e59731-4210-4c72-a0bf-4443e5fd4798 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:42.267371 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-16e59731-4210-4c72-a0bf-4443e5fd4798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:42.322064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:42.345689 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 204/416] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:42.349503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68265b85-4da8-49ed-8c5b-92efbd05801e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:42.363863 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e59731-4210-4c72-a0bf-4443e5fd4798 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:42.395950 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b862ea-ab5f-48b7-bd81-5dcf3ad912db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:42.397245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b862ea-ab5f-48b7-bd81-5dcf3ad912db None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:42.397788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b862ea-ab5f-48b7-bd81-5dcf3ad912db None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:42.398368 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b862ea-ab5f-48b7-bd81-5dcf3ad912db None admin] PATH_INFO: `/v3/projects/4ccd8cb3bebf4369b70aa2f145132951/groups/b1c67b62d3b24635a8db931a1ea1af4e/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:42.400733 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b862ea-ab5f-48b7-bd81-5dcf3ad912db None admin] RBAC: Authorizing `identity:create_grant(project_id=4ccd8cb3bebf4369b70aa2f145132951, group_id=b1c67b62d3b24635a8db931a1ea1af4e, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:42.402614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b862ea-ab5f-48b7-bd81-5dcf3ad912db None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:42.407337 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:42.424251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 213/417] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Jun 27 10:56:42 2022] PUT /identity/v3/projects/4ccd8cb3bebf4369b70aa2f145132951/groups/b1c67b62d3b24635a8db931a1ea1af4e/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:56:42.439774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a834da2-5e8e-4bcb-987a-8ccaafcd625d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:42.440543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a834da2-5e8e-4bcb-987a-8ccaafcd625d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:42.441094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a834da2-5e8e-4bcb-987a-8ccaafcd625d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:42.443495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 214/418] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:42.450827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08a6a0-c4eb-469a-9de6-f0b33e72717c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:42.451246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08a6a0-c4eb-469a-9de6-f0b33e72717c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:42.451449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08a6a0-c4eb-469a-9de6-f0b33e72717c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:42.471266 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5c08a6a0-c4eb-469a-9de6-f0b33e72717c None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:42.472487 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5c08a6a0-c4eb-469a-9de6-f0b33e72717c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:42.532044 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e59731-4210-4c72-a0bf-4443e5fd4798 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:42.560734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 215/419] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:42.576850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadd857-99be-4c63-8a96-6a9858b0f45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:42.577928 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadd857-99be-4c63-8a96-6a9858b0f45d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:42.578358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadd857-99be-4c63-8a96-6a9858b0f45d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:42.578797 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadd857-99be-4c63-8a96-6a9858b0f45d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:42.580684 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08a6a0-c4eb-469a-9de6-f0b33e72717c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:42.594189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadd857-99be-4c63-8a96-6a9858b0f45d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:42.605567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5dadd857-99be-4c63-8a96-6a9858b0f45d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:42.605567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:42.605567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:42.605567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:42.605567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:42.605567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:42.605567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:42.605567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:42.605567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:42.605567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:42.605567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:42.605567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:42.605567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:42.605567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:42.605567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:42.605567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:42.606723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:42.606723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:42.606723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:42.606723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:42.606723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:42.606723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:42.606723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:42.606723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:42.606723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:42.606723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:42.606723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:42.606723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:42.606723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:42.606723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:42.606723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:42.606723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:42.607781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:42.607781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:42.607781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:42.607781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:42.607781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:42.607781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:42.607781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:42.607781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:42.607781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:42.607781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:42.607781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:42.607781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:42.610996 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 205/420] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:42.619047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadd857-99be-4c63-8a96-6a9858b0f45d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:42.688122 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:42.694115 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08a6a0-c4eb-469a-9de6-f0b33e72717c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:42.721779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:42.731658 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215a77e-1cbe-47e2-9b63-338ca5005826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:42.732771 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215a77e-1cbe-47e2-9b63-338ca5005826 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:42.732978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215a77e-1cbe-47e2-9b63-338ca5005826 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:42.733385 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215a77e-1cbe-47e2-9b63-338ca5005826 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:42.745005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215a77e-1cbe-47e2-9b63-338ca5005826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:42.753089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a215a77e-1cbe-47e2-9b63-338ca5005826 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:42.753089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:42.753089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:42.753089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:42.753089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:42.753089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:42.753089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:42.753089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:42.753089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:42.753089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:42.753089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:42.753089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:42.753089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:42.753089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:42.753089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:42.753089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:42.754222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:42.754222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:42.754222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:42.754222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:42.754222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:42.754222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:42.754222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:42.754222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:42.754222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:42.754222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:42.754222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:42.754222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:42.754222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:42.754222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:42.754222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:42.754222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:42.755216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:42.755216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:42.755216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:42.755216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:42.755216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:42.755216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:42.755216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:42.755216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:42.755216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:42.755216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:42.755216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:42.755216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:42.757181 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadd857-99be-4c63-8a96-6a9858b0f45d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:42.761455 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 216/421] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:56:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:42.762685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215a77e-1cbe-47e2-9b63-338ca5005826 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:42.795894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81ab74-ed76-4d07-8be2-b71c14a9c96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:42.796885 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81ab74-ed76-4d07-8be2-b71c14a9c96f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:42.797348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81ab74-ed76-4d07-8be2-b71c14a9c96f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:42.797842 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81ab74-ed76-4d07-8be2-b71c14a9c96f None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:42.798786 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81ab74-ed76-4d07-8be2-b71c14a9c96f None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:42.799295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81ab74-ed76-4d07-8be2-b71c14a9c96f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:42.800892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81ab74-ed76-4d07-8be2-b71c14a9c96f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:42.810730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 206/422] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:42.818832 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81ab74-ed76-4d07-8be2-b71c14a9c96f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:42.943632 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215a77e-1cbe-47e2-9b63-338ca5005826 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:42.957847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81ab74-ed76-4d07-8be2-b71c14a9c96f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:42.966552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:43.008746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e071b3-afee-4781-b716-886ada8c2aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:43.009441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e071b3-afee-4781-b716-886ada8c2aed None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:43.009727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e071b3-afee-4781-b716-886ada8c2aed None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:43.010005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e071b3-afee-4781-b716-886ada8c2aed None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:43.010999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e071b3-afee-4781-b716-886ada8c2aed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:43.011313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e071b3-afee-4781-b716-886ada8c2aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:43.012704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e071b3-afee-4781-b716-886ada8c2aed None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:43.023930 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 217/423] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:56:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:43.031956 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21444101-e96a-435d-b977-65c2efdad102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:43.032610 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21444101-e96a-435d-b977-65c2efdad102 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:43.032890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21444101-e96a-435d-b977-65c2efdad102 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:43.033164 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21444101-e96a-435d-b977-65c2efdad102 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:43.034355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e071b3-afee-4781-b716-886ada8c2aed None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:43.126951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:43.147974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21444101-e96a-435d-b977-65c2efdad102 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:43.149987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21444101-e96a-435d-b977-65c2efdad102 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:43.225237 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e071b3-afee-4781-b716-886ada8c2aed None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:43.288422 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad0553-582a-4c57-ab7f-62fac36b78db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:43.289069 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad0553-582a-4c57-ab7f-62fac36b78db None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:43.290911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad0553-582a-4c57-ab7f-62fac36b78db None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:43.291193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad0553-582a-4c57-ab7f-62fac36b78db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:43.319740 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 207/424] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:43.322362 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21444101-e96a-435d-b977-65c2efdad102 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:43.336227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:43.422467 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad0553-582a-4c57-ab7f-62fac36b78db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:43.423940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad0553-582a-4c57-ab7f-62fac36b78db None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:43.464401 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21444101-e96a-435d-b977-65c2efdad102 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:43.491988 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:43.511623 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087204a-d0c4-4801-8f43-77e28f2a30b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:43.512795 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087204a-d0c4-4801-8f43-77e28f2a30b0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:43.513307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087204a-d0c4-4801-8f43-77e28f2a30b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:43.513812 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087204a-d0c4-4801-8f43-77e28f2a30b0 None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:43.515270 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087204a-d0c4-4801-8f43-77e28f2a30b0 None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:43.517008 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087204a-d0c4-4801-8f43-77e28f2a30b0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:43.519457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 208/425] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:43 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:43.520850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcc097-bbc7-420a-bb86-0d0a3af569b6 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:43.521339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcc097-bbc7-420a-bb86-0d0a3af569b6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:43.521834 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcc097-bbc7-420a-bb86-0d0a3af569b6 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:43.528206 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 209/426] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:43.529311 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcc097-bbc7-420a-bb86-0d0a3af569b6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:43.557443 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 218/427] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:43.559076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042cf50-fed3-470e-ab33-668eaa4eab4f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:43.559561 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042cf50-fed3-470e-ab33-668eaa4eab4f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:43.560031 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042cf50-fed3-470e-ab33-668eaa4eab4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:43.577798 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1042cf50-fed3-470e-ab33-668eaa4eab4f None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:43.579261 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1042cf50-fed3-470e-ab33-668eaa4eab4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:43.619556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:43.648277 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcc097-bbc7-420a-bb86-0d0a3af569b6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:43.681517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 219/428] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:43.681517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042cf50-fed3-470e-ab33-668eaa4eab4f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:43.697398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f87019-f749-4d41-80cf-233002a0cecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:43.699385 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f87019-f749-4d41-80cf-233002a0cecd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:43.699664 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f87019-f749-4d41-80cf-233002a0cecd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:43.699937 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f87019-f749-4d41-80cf-233002a0cecd None admin] PATH_INFO: `/v3/groups/839693481bbc4a7ea85d25aae678af21` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:43.701200 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f87019-f749-4d41-80cf-233002a0cecd None admin] RBAC: Authorizing `identity:get_group(group_id=839693481bbc4a7ea85d25aae678af21)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:43.702661 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f87019-f749-4d41-80cf-233002a0cecd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:43.704384 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 210/429] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jun 27 10:56:43 2022] GET /identity/v3/groups/839693481bbc4a7ea85d25aae678af21 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:43.707575 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f87019-f749-4d41-80cf-233002a0cecd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:43.785479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:43.813223 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042cf50-fed3-470e-ab33-668eaa4eab4f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:43.852555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d7b1a-54fb-4a1b-abc1-5949f85dd968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:43.853483 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d7b1a-54fb-4a1b-abc1-5949f85dd968 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:43.853768 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d7b1a-54fb-4a1b-abc1-5949f85dd968 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:43.854052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d7b1a-54fb-4a1b-abc1-5949f85dd968 None admin] PATH_INFO: `/v3/projects/c63add240dc64d06949b96266e734033` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:43.855007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f87019-f749-4d41-80cf-233002a0cecd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:43.855335 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d7b1a-54fb-4a1b-abc1-5949f85dd968 None admin] RBAC: Authorizing `identity:get_project(project_id=c63add240dc64d06949b96266e734033)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:43.856810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d7b1a-54fb-4a1b-abc1-5949f85dd968 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:43.860057 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 220/430] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:43 2022] GET /identity/v3/projects/c63add240dc64d06949b96266e734033 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:43.860887 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d7b1a-54fb-4a1b-abc1-5949f85dd968 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:43.901059 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc1380-8219-4ccf-95b5-438793e03b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:43.902760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc1380-8219-4ccf-95b5-438793e03b2e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:43.903245 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc1380-8219-4ccf-95b5-438793e03b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:43.903700 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc1380-8219-4ccf-95b5-438793e03b2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:43.916795 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc1380-8219-4ccf-95b5-438793e03b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:43.927117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-3efc1380-8219-4ccf-95b5-438793e03b2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:43.927117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:43.927117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:43.927117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:43.927117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:43.927117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:43.927117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:43.927117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:43.927117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:43.927117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:43.927117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:43.927117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:43.927117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:43.927117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:43.927117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:43.927117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:43.928011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:43.928011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:43.928011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:43.928011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:43.928011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:43.928011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:43.928011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:43.928011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:43.928011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:43.928011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:43.928011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:43.928011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:43.928011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:43.928011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:43.928011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:43.928011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:43.928805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:43.928805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:43.928805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:43.928805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:43.928805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:43.928805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:43.928805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:43.928805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:43.928805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:43.928805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:43.928805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 10:56:43.928805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:43.938390 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 211/431] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:43.938390 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc1380-8219-4ccf-95b5-438793e03b2e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:43.938390 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:44.004540 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d7b1a-54fb-4a1b-abc1-5949f85dd968 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:44.044974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc1380-8219-4ccf-95b5-438793e03b2e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:44.045282 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff0acc-ac2b-467d-abe6-925b331e8995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:44.046323 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff0acc-ac2b-467d-abe6-925b331e8995 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:44.046819 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff0acc-ac2b-467d-abe6-925b331e8995 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:44.047362 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff0acc-ac2b-467d-abe6-925b331e8995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:44.048384 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff0acc-ac2b-467d-abe6-925b331e8995 None admin] RBAC: Adding query filter params (group.id=839693481bbc4a7ea85d25aae678af21, role.id=2c7768e02a39438fbe2c3551ff3b19a4, scope.project.id=c63add240dc64d06949b96266e734033) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:44.048907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff0acc-ac2b-467d-abe6-925b331e8995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:44.050707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff0acc-ac2b-467d-abe6-925b331e8995 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:44.057815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 221/432] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jun 27 10:56:43 2022] GET /identity/v3/role_assignments?group.id=839693481bbc4a7ea85d25aae678af21&scope.project.id=c63add240dc64d06949b96266e734033&role.id=2c7768e02a39438fbe2c3551ff3b19a4 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:44.058918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff0acc-ac2b-467d-abe6-925b331e8995 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:44.072606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:44.084546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a188ba6-a1ba-4870-87d8-9f5b1cace45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:44.085836 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a188ba6-a1ba-4870-87d8-9f5b1cace45e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:44.086265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a188ba6-a1ba-4870-87d8-9f5b1cace45e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:44.086713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a188ba6-a1ba-4870-87d8-9f5b1cace45e None admin] PATH_INFO: `/v3/groups/839693481bbc4a7ea85d25aae678af21` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:44.088163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a188ba6-a1ba-4870-87d8-9f5b1cace45e None admin] RBAC: Authorizing `identity:get_group(group_id=839693481bbc4a7ea85d25aae678af21)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:44.090063 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a188ba6-a1ba-4870-87d8-9f5b1cace45e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:44.092490 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 212/433] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jun 27 10:56:43 2022] GET /identity/v3/groups/839693481bbc4a7ea85d25aae678af21 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:44.099263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a188ba6-a1ba-4870-87d8-9f5b1cace45e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:44.174566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff0acc-ac2b-467d-abe6-925b331e8995 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:44.214918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205d2b7-27cb-4e41-96f1-afabd92943a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:44.215793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d2b7-27cb-4e41-96f1-afabd92943a5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:44.216150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d2b7-27cb-4e41-96f1-afabd92943a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:44.216501 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d2b7-27cb-4e41-96f1-afabd92943a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:44.217344 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205d2b7-27cb-4e41-96f1-afabd92943a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:44.217752 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205d2b7-27cb-4e41-96f1-afabd92943a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:44.219205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205d2b7-27cb-4e41-96f1-afabd92943a5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:44.229862 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 222/434] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:56:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:44.235454 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205d2b7-27cb-4e41-96f1-afabd92943a5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:44.239239 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:44.315763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a188ba6-a1ba-4870-87d8-9f5b1cace45e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:44.342842 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:44.371537 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054360b6-833e-4b33-9be7-beb174bccd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:44.372566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054360b6-833e-4b33-9be7-beb174bccd7b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:44.372855 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054360b6-833e-4b33-9be7-beb174bccd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:44.373136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054360b6-833e-4b33-9be7-beb174bccd7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:44.374200 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054360b6-833e-4b33-9be7-beb174bccd7b None admin] RBAC: Adding query filter params (group.id=839693481bbc4a7ea85d25aae678af21, role.id=d6dae1fcff6641fcb71c0203d9c4e161, scope.project.id=c63add240dc64d06949b96266e734033) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:44.374524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054360b6-833e-4b33-9be7-beb174bccd7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:44.376833 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054360b6-833e-4b33-9be7-beb174bccd7b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:44.377833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205d2b7-27cb-4e41-96f1-afabd92943a5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:44.393403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 213/435] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jun 27 10:56:44 2022] GET /identity/v3/role_assignments?group.id=839693481bbc4a7ea85d25aae678af21&scope.project.id=c63add240dc64d06949b96266e734033&role.id=d6dae1fcff6641fcb71c0203d9c4e161 => generated 611 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:44.431010 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf87f61-8dd1-4960-b497-42e25bc3dde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:44.431722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf87f61-8dd1-4960-b497-42e25bc3dde7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:44.432013 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf87f61-8dd1-4960-b497-42e25bc3dde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:44.432294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf87f61-8dd1-4960-b497-42e25bc3dde7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:44.509155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf87f61-8dd1-4960-b497-42e25bc3dde7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:44.510672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf87f61-8dd1-4960-b497-42e25bc3dde7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:44.586514 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:44.619560 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 223/436] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 10:56:44.624928 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054360b6-833e-4b33-9be7-beb174bccd7b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:44.687588 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a63341-60f4-46df-a0a8-fba617ed546e None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:44.687867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a63341-60f4-46df-a0a8-fba617ed546e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:44.688149 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a63341-60f4-46df-a0a8-fba617ed546e None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:44.689810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 224/437] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:56:44.695694 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb900c8-5ccd-40b7-a777-d28205b00aed None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:44.695991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb900c8-5ccd-40b7-a777-d28205b00aed None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:44.696809 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb900c8-5ccd-40b7-a777-d28205b00aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:44.724453 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2eb900c8-5ccd-40b7-a777-d28205b00aed None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:44.725688 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2eb900c8-5ccd-40b7-a777-d28205b00aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:44.745524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054360b6-833e-4b33-9be7-beb174bccd7b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:44.787713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aca85f-2461-4950-a770-284001d91d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:44.788580 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca85f-2461-4950-a770-284001d91d23 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:44.788863 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca85f-2461-4950-a770-284001d91d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:44.789134 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca85f-2461-4950-a770-284001d91d23 None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:44.790423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aca85f-2461-4950-a770-284001d91d23 None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:44.791881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aca85f-2461-4950-a770-284001d91d23 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:44.793816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 214/438] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:44 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:44.798904 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aca85f-2461-4950-a770-284001d91d23 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:44.801601 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:44.817114 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 225/439] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:44.841252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb900c8-5ccd-40b7-a777-d28205b00aed None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:44.916463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aca85f-2461-4950-a770-284001d91d23 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:44.959189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7beb3-f1f4-4c97-b22f-cb382f7c7b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:44.961527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7beb3-f1f4-4c97-b22f-cb382f7c7b02 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:44.961527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7beb3-f1f4-4c97-b22f-cb382f7c7b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:44.961527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7beb3-f1f4-4c97-b22f-cb382f7c7b02 None admin] PATH_INFO: `/v3/groups/839693481bbc4a7ea85d25aae678af21` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:44.962478 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7beb3-f1f4-4c97-b22f-cb382f7c7b02 None admin] RBAC: Authorizing `identity:get_group(group_id=839693481bbc4a7ea85d25aae678af21)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:44.963947 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7beb3-f1f4-4c97-b22f-cb382f7c7b02 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:44.965622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 215/440] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jun 27 10:56:44 2022] GET /identity/v3/groups/839693481bbc4a7ea85d25aae678af21 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:44.966818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521723c5-b514-4b4d-b908-b2dd29c27337 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:44.967105 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521723c5-b514-4b4d-b908-b2dd29c27337 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:44.967385 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521723c5-b514-4b4d-b908-b2dd29c27337 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:44.968504 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb900c8-5ccd-40b7-a777-d28205b00aed None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:44.968614 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 216/441] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:44.972590 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521723c5-b514-4b4d-b908-b2dd29c27337 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:44.973541 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:45.012541 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8af8c4-f36a-4312-a075-fff77a6bf65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:45.013354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8af8c4-f36a-4312-a075-fff77a6bf65e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:45.016326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8af8c4-f36a-4312-a075-fff77a6bf65e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:45.016326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8af8c4-f36a-4312-a075-fff77a6bf65e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:45.026945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8af8c4-f36a-4312-a075-fff77a6bf65e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:45.035267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-fc8af8c4-f36a-4312-a075-fff77a6bf65e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:45.035267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:45.035267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:45.035267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:45.035267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:45.035267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:45.035267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:45.035267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:45.035267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:45.035267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:45.035267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:45.035267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:45.035267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:45.035267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:45.035267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:45.035267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:45.036193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:45.036193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:45.036193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:45.036193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:45.036193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:45.036193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:45.036193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:45.036193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:45.036193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:45.036193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:45.036193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:45.036193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:45.036193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:45.036193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:45.036193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:45.036193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:45.036993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:45.036993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:45.036993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:45.036993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:45.036993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:45.036993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:45.036993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:45.036993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:45.036993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:45.036993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:45.036993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:45.036993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:45.036993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 226/442] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:56:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:45.037712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771156a-c1d2-4777-b227-0af616b2e143 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:45.038012 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771156a-c1d2-4777-b227-0af616b2e143 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:45.038456 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771156a-c1d2-4777-b227-0af616b2e143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:45.056715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2771156a-c1d2-4777-b227-0af616b2e143 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:45.057948 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2771156a-c1d2-4777-b227-0af616b2e143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:45.063773 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:45.096399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521723c5-b514-4b4d-b908-b2dd29c27337 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:45.123011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 227/443] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:45.123739 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771156a-c1d2-4777-b227-0af616b2e143 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:45.132054 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad0d44-b898-4af1-a1a7-64232c457227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:45.132708 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad0d44-b898-4af1-a1a7-64232c457227 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:45.133014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad0d44-b898-4af1-a1a7-64232c457227 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:45.133266 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad0d44-b898-4af1-a1a7-64232c457227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:45.134749 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad0d44-b898-4af1-a1a7-64232c457227 None admin] RBAC: Adding query filter params (group.id=839693481bbc4a7ea85d25aae678af21, role.id=2c7768e02a39438fbe2c3551ff3b19a4, scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:45.135063 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad0d44-b898-4af1-a1a7-64232c457227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:45.136733 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad0d44-b898-4af1-a1a7-64232c457227 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:45.143128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 217/444] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jun 27 10:56:44 2022] GET /identity/v3/role_assignments?group.id=839693481bbc4a7ea85d25aae678af21&scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b&role.id=2c7768e02a39438fbe2c3551ff3b19a4 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:45.150734 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad0d44-b898-4af1-a1a7-64232c457227 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:45.228812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:45.238559 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771156a-c1d2-4777-b227-0af616b2e143 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:45.273702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad0d44-b898-4af1-a1a7-64232c457227 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:45.286284 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc38ee-b9b0-4c02-adf7-601ad7b507e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:45.286967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc38ee-b9b0-4c02-adf7-601ad7b507e7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:45.287250 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc38ee-b9b0-4c02-adf7-601ad7b507e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:45.287533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc38ee-b9b0-4c02-adf7-601ad7b507e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:45.288297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc38ee-b9b0-4c02-adf7-601ad7b507e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:45.288605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc38ee-b9b0-4c02-adf7-601ad7b507e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:45.290069 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc38ee-b9b0-4c02-adf7-601ad7b507e7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:45.300498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 228/445] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:56:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:45.306639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc38ee-b9b0-4c02-adf7-601ad7b507e7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:45.311801 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3062e35-fa7f-4d2e-b209-a147d38bf5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:45.312584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3062e35-fa7f-4d2e-b209-a147d38bf5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:45.312864 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3062e35-fa7f-4d2e-b209-a147d38bf5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:45.313137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3062e35-fa7f-4d2e-b209-a147d38bf5d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:45.315192 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:45.328546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3062e35-fa7f-4d2e-b209-a147d38bf5d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:45.336415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e3062e35-fa7f-4d2e-b209-a147d38bf5d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:56:45.336415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:45.336415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:45.336415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:45.336415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:45.336415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:45.336415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:45.336415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:45.336415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:45.336415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:45.336415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:45.336415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:45.336415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:45.336415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:45.336415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:45.336415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:45.337643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:45.337643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:45.337643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:45.337643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:45.337643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:45.337643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:45.337643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:45.337643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:45.337643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:45.337643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:45.337643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:45.337643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:45.337643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:45.337643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:45.337643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:45.337643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:45.338488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:45.338488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:45.338488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:45.338488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:45.338488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:45.338488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:45.338488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:45.338488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:45.338488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:45.338488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:45.338488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:56:45.338488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:45.338488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 218/446] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:56:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:45.343329 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3062e35-fa7f-4d2e-b209-a147d38bf5d7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:45.431988 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc38ee-b9b0-4c02-adf7-601ad7b507e7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:45.471766 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b2c35-7038-4b9f-9274-479408401633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:45.472428 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b2c35-7038-4b9f-9274-479408401633 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:45.472710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b2c35-7038-4b9f-9274-479408401633 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:45.472989 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b2c35-7038-4b9f-9274-479408401633 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:45.476250 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3062e35-fa7f-4d2e-b209-a147d38bf5d7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:45.499595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:45.513122 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb68204-8c6f-4f32-92fd-de937aa4aac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:45.513834 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb68204-8c6f-4f32-92fd-de937aa4aac1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:45.514119 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb68204-8c6f-4f32-92fd-de937aa4aac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:45.514394 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb68204-8c6f-4f32-92fd-de937aa4aac1 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:45.515137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb68204-8c6f-4f32-92fd-de937aa4aac1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:45.515443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb68204-8c6f-4f32-92fd-de937aa4aac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:45.516821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb68204-8c6f-4f32-92fd-de937aa4aac1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:45.524806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 219/447] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:45.530185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb68204-8c6f-4f32-92fd-de937aa4aac1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:45.543694 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b2c35-7038-4b9f-9274-479408401633 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:45.545146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b2c35-7038-4b9f-9274-479408401633 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:45.583786 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:45.628014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb68204-8c6f-4f32-92fd-de937aa4aac1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:45.642707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 229/448] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 10:56:45.648359 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b2c35-7038-4b9f-9274-479408401633 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:45.663821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbcca8-563a-410b-8960-935ce594157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:45.664467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbcca8-563a-410b-8960-935ce594157a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:45.664754 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbcca8-563a-410b-8960-935ce594157a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:45.665581 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbcca8-563a-410b-8960-935ce594157a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:45.702442 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:45.732392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbcca8-563a-410b-8960-935ce594157a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:45.733900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbcca8-563a-410b-8960-935ce594157a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:45.746660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b2c35-7038-4b9f-9274-479408401633 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:45.779600 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16068586-64cd-487c-8b24-fc9c44fb5099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:45.780448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16068586-64cd-487c-8b24-fc9c44fb5099 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:45.780731 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16068586-64cd-487c-8b24-fc9c44fb5099 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:45.781008 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16068586-64cd-487c-8b24-fc9c44fb5099 None admin] PATH_INFO: `/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:45.782214 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16068586-64cd-487c-8b24-fc9c44fb5099 None admin] RBAC: Authorizing `identity:get_project(project_id=da939275ad904ac98f1c2ad9e6fdc28b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:45.783645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16068586-64cd-487c-8b24-fc9c44fb5099 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:45.785331 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 230/449] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:45 2022] GET /identity/v3/projects/da939275ad904ac98f1c2ad9e6fdc28b => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:45.787048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:45.791507 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16068586-64cd-487c-8b24-fc9c44fb5099 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:45.831499 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 220/450] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 10:56:45.837359 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbcca8-563a-410b-8960-935ce594157a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:45.886591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16068586-64cd-487c-8b24-fc9c44fb5099 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:45.908776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:45.921055 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef3bb0-9ecb-4843-a804-c9aba5ba28dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:45.922001 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef3bb0-9ecb-4843-a804-c9aba5ba28dd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:45.922275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef3bb0-9ecb-4843-a804-c9aba5ba28dd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:45.922542 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef3bb0-9ecb-4843-a804-c9aba5ba28dd None admin] PATH_INFO: `/v3/groups/839693481bbc4a7ea85d25aae678af21` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:45.923722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef3bb0-9ecb-4843-a804-c9aba5ba28dd None admin] RBAC: Authorizing `identity:get_group(group_id=839693481bbc4a7ea85d25aae678af21)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:45.925150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef3bb0-9ecb-4843-a804-c9aba5ba28dd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:45.927206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 231/451] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jun 27 10:56:45 2022] GET /identity/v3/groups/839693481bbc4a7ea85d25aae678af21 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:45.932369 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef3bb0-9ecb-4843-a804-c9aba5ba28dd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:45.934318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbcca8-563a-410b-8960-935ce594157a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:45.973315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729b41a-5e11-42e8-938e-7325bf53a8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:45.974111 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729b41a-5e11-42e8-938e-7325bf53a8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:45.974391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729b41a-5e11-42e8-938e-7325bf53a8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:45.974659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729b41a-5e11-42e8-938e-7325bf53a8e7 None admin] PATH_INFO: `/v3/projects/4ccd8cb3bebf4369b70aa2f145132951` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:45.975825 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729b41a-5e11-42e8-938e-7325bf53a8e7 None admin] RBAC: Authorizing `identity:get_project(project_id=4ccd8cb3bebf4369b70aa2f145132951)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:45.977345 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729b41a-5e11-42e8-938e-7325bf53a8e7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:45.979544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 221/452] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:56:45 2022] GET /identity/v3/projects/4ccd8cb3bebf4369b70aa2f145132951 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:45.984903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729b41a-5e11-42e8-938e-7325bf53a8e7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:46.008536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:46.029563 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef3bb0-9ecb-4843-a804-c9aba5ba28dd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:46.062898 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce281c5-0200-44b6-b729-196596147aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:46.063539 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce281c5-0200-44b6-b729-196596147aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:46.063820 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce281c5-0200-44b6-b729-196596147aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:46.064089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce281c5-0200-44b6-b729-196596147aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:46.064912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce281c5-0200-44b6-b729-196596147aa8 None admin] RBAC: Adding query filter params (group.id=839693481bbc4a7ea85d25aae678af21, role.id=d6dae1fcff6641fcb71c0203d9c4e161, scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:46.065218 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce281c5-0200-44b6-b729-196596147aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:46.066671 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce281c5-0200-44b6-b729-196596147aa8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:46.072487 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 232/453] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jun 27 10:56:45 2022] GET /identity/v3/role_assignments?group.id=839693481bbc4a7ea85d25aae678af21&scope.project.id=da939275ad904ac98f1c2ad9e6fdc28b&role.id=d6dae1fcff6641fcb71c0203d9c4e161 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:46.086460 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729b41a-5e11-42e8-938e-7325bf53a8e7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:46.124309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fe26e-a586-4204-a2c8-af6d2c7e1236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:46.125175 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe26e-a586-4204-a2c8-af6d2c7e1236 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:46.125485 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe26e-a586-4204-a2c8-af6d2c7e1236 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:46.125756 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe26e-a586-4204-a2c8-af6d2c7e1236 None admin] PATH_INFO: `/v3/groups/b1c67b62d3b24635a8db931a1ea1af4e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:46.127043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fe26e-a586-4204-a2c8-af6d2c7e1236 None admin] RBAC: Authorizing `identity:get_group(group_id=b1c67b62d3b24635a8db931a1ea1af4e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:46.128523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fe26e-a586-4204-a2c8-af6d2c7e1236 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:46.130226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 222/454] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jun 27 10:56:45 2022] GET /identity/v3/groups/b1c67b62d3b24635a8db931a1ea1af4e => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:46.137116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce281c5-0200-44b6-b729-196596147aa8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:46.194835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:46.242806 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce281c5-0200-44b6-b729-196596147aa8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:46.278075 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5835c3-d147-4a60-bfd5-f6cd2c1b7aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:46.278974 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5835c3-d147-4a60-bfd5-f6cd2c1b7aab None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:46.279249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5835c3-d147-4a60-bfd5-f6cd2c1b7aab None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:46.279520 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5835c3-d147-4a60-bfd5-f6cd2c1b7aab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:46.280342 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5835c3-d147-4a60-bfd5-f6cd2c1b7aab None admin] RBAC: Adding query filter params (group.id=b1c67b62d3b24635a8db931a1ea1af4e, role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=4ccd8cb3bebf4369b70aa2f145132951) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:46.280646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5835c3-d147-4a60-bfd5-f6cd2c1b7aab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:46.282083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5835c3-d147-4a60-bfd5-f6cd2c1b7aab None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:46.288116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 233/455] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jun 27 10:56:46 2022] GET /identity/v3/role_assignments?group.id=b1c67b62d3b24635a8db931a1ea1af4e&scope.project.id=4ccd8cb3bebf4369b70aa2f145132951&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:48.845491 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3788062-c338-4af7-b5ac-f9e3b668a720 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:48.846010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3788062-c338-4af7-b5ac-f9e3b668a720 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:48.846085 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3788062-c338-4af7-b5ac-f9e3b668a720 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:48.847763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 223/456] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:48.854005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb8b6b-9c4b-4ddf-ad45-9de819a5f9d9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:48.854439 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb8b6b-9c4b-4ddf-ad45-9de819a5f9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:48.854607 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb8b6b-9c4b-4ddf-ad45-9de819a5f9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:48.878344 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1edb8b6b-9c4b-4ddf-ad45-9de819a5f9d9 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:48.879566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1edb8b6b-9c4b-4ddf-ad45-9de819a5f9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:48.968864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 234/457] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:48.989381 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64830fd0-293c-453e-a642-a0f738171ffd None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:48.989676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64830fd0-293c-453e-a642-a0f738171ffd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:48.989966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64830fd0-293c-453e-a642-a0f738171ffd None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:48.991348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 224/458] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:48.997125 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55c32c-9321-4ca2-895f-f4f7b15c59ed None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:48.997439 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55c32c-9321-4ca2-895f-f4f7b15c59ed None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:48.997735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55c32c-9321-4ca2-895f-f4f7b15c59ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:49.002524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f26a19-5ccb-4099-bc20-d59bb95be148 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:49.002814 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f26a19-5ccb-4099-bc20-d59bb95be148 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:49.003094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f26a19-5ccb-4099-bc20-d59bb95be148 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:49.004648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 225/459] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:49.006318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f26a19-5ccb-4099-bc20-d59bb95be148 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:49.021960 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-eb55c32c-9321-4ca2-895f-f4f7b15c59ed None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:49.023245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-eb55c32c-9321-4ca2-895f-f4f7b15c59ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:49.097475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 235/460] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:49.097475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7c311-1316-498c-8f46-c47ba06b82c5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:49.097475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7c311-1316-498c-8f46-c47ba06b82c5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:49.097475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7c311-1316-498c-8f46-c47ba06b82c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:49.109836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:49.120679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:49.122129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a5e7c311-1316-498c-8f46-c47ba06b82c5 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:49.123992 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a5e7c311-1316-498c-8f46-c47ba06b82c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:49.133154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f26a19-5ccb-4099-bc20-d59bb95be148 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:49.170482 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3215d-69b9-4b21-9617-3c689f59c9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:49.171394 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3215d-69b9-4b21-9617-3c689f59c9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:49.171680 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3215d-69b9-4b21-9617-3c689f59c9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:49.171959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3215d-69b9-4b21-9617-3c689f59c9a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:49.185849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3215d-69b9-4b21-9617-3c689f59c9a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:49.187316 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3215d-69b9-4b21-9617-3c689f59c9a6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:49.205666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-25c3215d-69b9-4b21-9617-3c689f59c9a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:49.205666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:49.205666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:49.205666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:49.205666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:49.205666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:49.205666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:49.205666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:49.205666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:49.205666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:49.205666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:49.205666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:49.205666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:56:49.205666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:56:49.205666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:56:49.206533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:56:49.206533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:49.206533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:49.206533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:49.206533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:49.206533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:49.206533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:49.206533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:49.206533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:49.206533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:49.206533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:49.206533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:49.206533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:49.206533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:49.206533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:49.206533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:49.206533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:49.207372 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:56:49.207372 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:56:49.207372 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:49.207372 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:49.211254 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 226/461] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:49.212229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3215d-69b9-4b21-9617-3c689f59c9a6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:49.224979 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 236/462] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:49.225967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7c311-1316-498c-8f46-c47ba06b82c5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:49.342152 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3215d-69b9-4b21-9617-3c689f59c9a6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:49.343315 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7c311-1316-498c-8f46-c47ba06b82c5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:49.354014 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:49.378031 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8fda9-4a50-4aa4-b260-9a60862ee7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:49.378816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8fda9-4a50-4aa4-b260-9a60862ee7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:49.379102 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8fda9-4a50-4aa4-b260-9a60862ee7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:49.379377 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8fda9-4a50-4aa4-b260-9a60862ee7c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:49.383148 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09b3e4-8b1a-451b-9a4b-7f1f47dfdcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:49.383838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09b3e4-8b1a-451b-9a4b-7f1f47dfdcfa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:49.384116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09b3e4-8b1a-451b-9a4b-7f1f47dfdcfa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:49.384388 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09b3e4-8b1a-451b-9a4b-7f1f47dfdcfa None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:49.385106 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09b3e4-8b1a-451b-9a4b-7f1f47dfdcfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:49.385426 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09b3e4-8b1a-451b-9a4b-7f1f47dfdcfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:49.387163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09b3e4-8b1a-451b-9a4b-7f1f47dfdcfa None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:49.389997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8fda9-4a50-4aa4-b260-9a60862ee7c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:49.391451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8fda9-4a50-4aa4-b260-9a60862ee7c3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:49.394091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:49.400438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 237/463] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:49.401260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09b3e4-8b1a-451b-9a4b-7f1f47dfdcfa None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:49.410667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-75c8fda9-4a50-4aa4-b260-9a60862ee7c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:49.410667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:49.410667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:49.410667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:49.410667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:49.410667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:49.410667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:49.410667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:49.410667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:49.410667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:49.410667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:49.410667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:49.410667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:56:49.410667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:56:49.410667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:56:49.411531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:56:49.411531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:49.411531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:49.411531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:49.411531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:49.411531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:49.411531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:49.411531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:49.411531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:49.411531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:49.411531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:49.411531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:49.411531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:49.411531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:49.411531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:49.411531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:49.411531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:49.412400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:56:49.412400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:56:49.412400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:49.412400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:49.412400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 227/464] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:49.413442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7a964-bbfa-40a7-bdee-674ffaf28b8d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:49.413639 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7a964-bbfa-40a7-bdee-674ffaf28b8d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:49.413797 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7a964-bbfa-40a7-bdee-674ffaf28b8d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:49.418473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 228/465] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:49.418473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7a964-bbfa-40a7-bdee-674ffaf28b8d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:49.509579 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09b3e4-8b1a-451b-9a4b-7f1f47dfdcfa None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:49.525242 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7a964-bbfa-40a7-bdee-674ffaf28b8d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:49.543195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe1143-59d5-4a2b-9475-5a0765ec64a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:49.543978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe1143-59d5-4a2b-9475-5a0765ec64a9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:49.544262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe1143-59d5-4a2b-9475-5a0765ec64a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:49.544535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe1143-59d5-4a2b-9475-5a0765ec64a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:49.557732 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe1143-59d5-4a2b-9475-5a0765ec64a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:49.559163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe1143-59d5-4a2b-9475-5a0765ec64a9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:49.565198 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb96c18-ed54-40bf-bc49-6ccfcdd05fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:49.566258 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96c18-ed54-40bf-bc49-6ccfcdd05fce None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:49.566552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96c18-ed54-40bf-bc49-6ccfcdd05fce None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:49.566826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96c18-ed54-40bf-bc49-6ccfcdd05fce None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:49.567897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb96c18-ed54-40bf-bc49-6ccfcdd05fce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:49.569316 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb96c18-ed54-40bf-bc49-6ccfcdd05fce None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:49.577002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-5ebe1143-59d5-4a2b-9475-5a0765ec64a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:49.577002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:49.577002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:49.577002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:49.577002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:49.577002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:49.577002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:49.577002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:49.577002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:49.577002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:49.577002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:49.577002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:49.577002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:56:49.577002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:56:49.577002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:56:49.578017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:56:49.578017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:49.578017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:49.578017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:49.578017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:49.578017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:49.578017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:49.578017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:49.578017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:49.578017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:49.578017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:49.578017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:49.578017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:49.578017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:49.578017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:49.578017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:49.578017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:49.578853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:56:49.578853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:56:49.578853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:49.578853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:49.578853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 238/466] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:49.579122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe1143-59d5-4a2b-9475-5a0765ec64a9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:49.592992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 229/467] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:56:49 2022] POST /identity/v3/users => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:56:49.594578 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ba132-e8a1-49a4-a9d3-a44c68bbc4e5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:49.594939 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ba132-e8a1-49a4-a9d3-a44c68bbc4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:49.595291 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ba132-e8a1-49a4-a9d3-a44c68bbc4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:49.619378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2c6ba132-e8a1-49a4-a9d3-a44c68bbc4e5 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:49.621381 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2c6ba132-e8a1-49a4-a9d3-a44c68bbc4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:49.624762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:49.697401 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:49.708482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe1143-59d5-4a2b-9475-5a0765ec64a9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:49.735735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 230/468] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:49.737065 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ba132-e8a1-49a4-a9d3-a44c68bbc4e5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:49.748380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157a60d-21d5-4294-aa61-4f0b382e2e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:49.749349 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157a60d-21d5-4294-aa61-4f0b382e2e47 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:49.749870 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157a60d-21d5-4294-aa61-4f0b382e2e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:49.750355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157a60d-21d5-4294-aa61-4f0b382e2e47 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:49.751266 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157a60d-21d5-4294-aa61-4f0b382e2e47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:49.751753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157a60d-21d5-4294-aa61-4f0b382e2e47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:49.753336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157a60d-21d5-4294-aa61-4f0b382e2e47 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:49.767460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 239/469] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:49.773827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157a60d-21d5-4294-aa61-4f0b382e2e47 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:49.871987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ba132-e8a1-49a4-a9d3-a44c68bbc4e5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:49.874386 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:49.898146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157a60d-21d5-4294-aa61-4f0b382e2e47 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:49.917684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d2048-3e8b-4458-900c-60f0302fc736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:49.918350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d2048-3e8b-4458-900c-60f0302fc736 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:49.918640 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d2048-3e8b-4458-900c-60f0302fc736 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:49.918919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d2048-3e8b-4458-900c-60f0302fc736 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:49.919647 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d2048-3e8b-4458-900c-60f0302fc736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:49.919952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d2048-3e8b-4458-900c-60f0302fc736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:49.921329 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d2048-3e8b-4458-900c-60f0302fc736 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:49.945299 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 231/470] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:49.946610 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d2048-3e8b-4458-900c-60f0302fc736 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:49.959153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4ccb7-da6a-4ffa-8ae6-9f2892d6d200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:49.959884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4ccb7-da6a-4ffa-8ae6-9f2892d6d200 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:49.960171 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4ccb7-da6a-4ffa-8ae6-9f2892d6d200 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:49.960446 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4ccb7-da6a-4ffa-8ae6-9f2892d6d200 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:49.961161 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4ccb7-da6a-4ffa-8ae6-9f2892d6d200 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:49.963546 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4ccb7-da6a-4ffa-8ae6-9f2892d6d200 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:49.986375 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 240/471] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:56:49 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:56:49.987486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4ccb7-da6a-4ffa-8ae6-9f2892d6d200 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:50.003837 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:50.108564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4ccb7-da6a-4ffa-8ae6-9f2892d6d200 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:50.141335 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d2048-3e8b-4458-900c-60f0302fc736 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:50.148101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f2412-7957-4fca-b9e5-5e8a327716c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:50.148775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f2412-7957-4fca-b9e5-5e8a327716c1 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:50.149119 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f2412-7957-4fca-b9e5-5e8a327716c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:50.149955 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f2412-7957-4fca-b9e5-5e8a327716c1 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:50.150670 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f2412-7957-4fca-b9e5-5e8a327716c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:50.152137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f2412-7957-4fca-b9e5-5e8a327716c1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:50.160628 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:50.181300 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 241/472] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:56:49 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:56:50.214627 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df9e61-b736-4fd7-9c52-4caf1534dbc3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:50.214941 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df9e61-b736-4fd7-9c52-4caf1534dbc3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:50.215183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df9e61-b736-4fd7-9c52-4caf1534dbc3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:50.216884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 242/473] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:56:50.219641 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d80fc-398f-4a52-8d63-e7614eab0d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:50.220468 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d80fc-398f-4a52-8d63-e7614eab0d13 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:50.220812 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d80fc-398f-4a52-8d63-e7614eab0d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:50.221100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d80fc-398f-4a52-8d63-e7614eab0d13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:50.222556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8daf5-b8c6-46a9-9410-f5fee0199444 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:50.222837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8daf5-b8c6-46a9-9410-f5fee0199444 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:50.223109 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8daf5-b8c6-46a9-9410-f5fee0199444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:50.238085 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d80fc-398f-4a52-8d63-e7614eab0d13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:50.239584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d80fc-398f-4a52-8d63-e7614eab0d13 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:50.243171 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ccd8daf5-b8c6-46a9-9410-f5fee0199444 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:50.244899 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ccd8daf5-b8c6-46a9-9410-f5fee0199444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:50.265971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c39d80fc-398f-4a52-8d63-e7614eab0d13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:50.265971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:50.265971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:50.265971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:50.265971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:50.265971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:50.265971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:50.265971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:50.265971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:50.265971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:50.265971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:50.265971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:50.265971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:56:50.265971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:56:50.265971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:56:50.267094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:56:50.267094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:50.267094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:50.267094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:50.267094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:50.267094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:50.267094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:50.267094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:50.267094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:50.267094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:50.267094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:50.267094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:50.267094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:50.267094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:50.267094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:50.267094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:50.267094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:50.267987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:56:50.267987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:56:50.267987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:50.267987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:50.267987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 232/474] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:50.274903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d80fc-398f-4a52-8d63-e7614eab0d13 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:50.338621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 243/475] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:50.371666 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8daf5-b8c6-46a9-9410-f5fee0199444 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:50.407689 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:50.415881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d80fc-398f-4a52-8d63-e7614eab0d13 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:50.464928 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ed54e-e583-4b4a-9b45-214b7b9070ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:50.465623 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ed54e-e583-4b4a-9b45-214b7b9070ca None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:50.465909 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ed54e-e583-4b4a-9b45-214b7b9070ca None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:50.466188 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ed54e-e583-4b4a-9b45-214b7b9070ca None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:50.466924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ed54e-e583-4b4a-9b45-214b7b9070ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:50.467232 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ed54e-e583-4b4a-9b45-214b7b9070ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:50.469130 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ed54e-e583-4b4a-9b45-214b7b9070ca None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:50.484516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 233/476] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:50.491508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ed54e-e583-4b4a-9b45-214b7b9070ca None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:50.503978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8daf5-b8c6-46a9-9410-f5fee0199444 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:50.529019 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:50.540851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc33ed8-0b62-479f-bc16-6e9d2760c62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:50.541572 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc33ed8-0b62-479f-bc16-6e9d2760c62a None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:50.541856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc33ed8-0b62-479f-bc16-6e9d2760c62a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:50.542134 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc33ed8-0b62-479f-bc16-6e9d2760c62a None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:50.542892 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc33ed8-0b62-479f-bc16-6e9d2760c62a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:50.544268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc33ed8-0b62-479f-bc16-6e9d2760c62a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:50.552780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.sql.core [None req-1cc33ed8-0b62-479f-bc16-6e9d2760c62a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 27 10:56:50.552780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 27 10:56:50.552780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [parameters: {'id': 'c16f0f6c2f0b41b49f08843f579b8dec', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 27 10:56:50.552780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80241) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 27 10:56:50.571762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-1cc33ed8-0b62-479f-bc16-6e9d2760c62a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 27 10:56:50.571762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:50.571762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 10:56:50.571762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 10:56:50.571762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 10:56:50.571762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 10:56:50.571762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 10:56:50.571762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 10:56:50.571762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 10:56:50.571762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application conn.query(q) Jun 27 10:56:50.571762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 10:56:50.571762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 10:56:50.571762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 10:56:50.571762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result.read() Jun 27 10:56:50.571762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return ref.to_dict() Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 10:56:50.572677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application next(self.gen) Jun 27 10:56:50.574170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 27 10:56:50.574170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application yield resource Jun 27 10:56:50.574170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 10:56:50.574170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application next(self.gen) Jun 27 10:56:50.574170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 27 10:56:50.574170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.session.rollback() Jun 27 10:56:50.574170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 27 10:56:50.574170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.force_reraise() Jun 27 10:56:50.574170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 27 10:56:50.574170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise self.value Jun 27 10:56:50.574170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 27 10:56:50.574170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 27 10:56:50.574170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 27 10:56:50.574170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application session.commit() Jun 27 10:56:50.574170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 27 10:56:50.574170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 27 10:56:50.574170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 27 10:56:50.575185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._prepare_impl() Jun 27 10:56:50.575185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 27 10:56:50.575185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.session.flush() Jun 27 10:56:50.575185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 27 10:56:50.575185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._flush(objects) Jun 27 10:56:50.575185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 27 10:56:50.575185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 27 10:56:50.575185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 27 10:56:50.575185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application compat.raise_( Jun 27 10:56:50.575185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 10:56:50.575185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception Jun 27 10:56:50.575185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 27 10:56:50.575185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application flush_context.execute() Jun 27 10:56:50.575185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 27 10:56:50.575185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rec.execute(self) Jun 27 10:56:50.575185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 27 10:56:50.575185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 27 10:56:50.576036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 27 10:56:50.576036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 27 10:56:50.576036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 27 10:56:50.576036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 27 10:56:50.576036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 27 10:56:50.576036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 27 10:56:50.576036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 27 10:56:50.576036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 27 10:56:50.576036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 27 10:56:50.576036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 27 10:56:50.576036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 27 10:56:50.576036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 27 10:56:50.576036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 27 10:56:50.576036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 27 10:56:50.576036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 10:56:50.576036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception Jun 27 10:56:50.576839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 10:56:50.576839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 10:56:50.576839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 10:56:50.576839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 10:56:50.576839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 10:56:50.576839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 10:56:50.576839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 10:56:50.576839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application conn.query(q) Jun 27 10:56:50.576839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 10:56:50.576839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 10:56:50.576839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 10:56:50.576839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result.read() Jun 27 10:56:50.576839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 10:56:50.576839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 10:56:50.576839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 10:56:50.576839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 10:56:50.578712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 10:56:50.578712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 10:56:50.578712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 10:56:50.578712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 10:56:50.578712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 27 10:56:50.578712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 27 10:56:50.578712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [parameters: {'id': 'c16f0f6c2f0b41b49f08843f579b8dec', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 27 10:56:50.578712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 27 10:56:50.578712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:50.578712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:56:50.578712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:50.578712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:50.578712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:50.578712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:50.578712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:50.578712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:50.580660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:50.580660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:50.580660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:50.580660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:50.580660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:50.580660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:50.580660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 27 10:56:50.580660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 27 10:56:50.580660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:50.580660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:50.580660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 27 10:56:50.580660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 27 10:56:50.580660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 27 10:56:50.580660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 27 10:56:50.580660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 27 10:56:50.580660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:50.583388 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 244/477] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Jun 27 10:56:50 2022] POST /identity/v3/roles => generated 144 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:50.583388 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc33ed8-0b62-479f-bc16-6e9d2760c62a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:50.637350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ed54e-e583-4b4a-9b45-214b7b9070ca None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:50.707725 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cf25d-9bca-427e-bfc8-b7452b3c242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:50.708316 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cf25d-9bca-427e-bfc8-b7452b3c242f None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:50.708606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cf25d-9bca-427e-bfc8-b7452b3c242f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:50.708885 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cf25d-9bca-427e-bfc8-b7452b3c242f None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:50.709621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03cf25d-9bca-427e-bfc8-b7452b3c242f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:50.713798 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03cf25d-9bca-427e-bfc8-b7452b3c242f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:50.759733 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 234/478] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:56:50 2022] POST /identity/v3/users => generated 249 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 10:56:50.772025 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc33ed8-0b62-479f-bc16-6e9d2760c62a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:50.822672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a804bb1-30ba-4726-a7cc-3e734628e790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:50.823499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a804bb1-30ba-4726-a7cc-3e734628e790 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:50.823812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a804bb1-30ba-4726-a7cc-3e734628e790 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:50.824100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a804bb1-30ba-4726-a7cc-3e734628e790 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:50.836153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a804bb1-30ba-4726-a7cc-3e734628e790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:50.844904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-3a804bb1-30ba-4726-a7cc-3e734628e790 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:50.844904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:50.844904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:50.844904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:50.844904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:50.844904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:50.844904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:50.844904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:50.844904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:50.844904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:50.844904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:50.844904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:50.844904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:50.844904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:50.844904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:50.844904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:50.845912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:50.845912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:50.845912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:50.845912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:50.845912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:50.845912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:50.845912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:50.845912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:50.845912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:50.845912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:50.845912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:50.845912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:50.845912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:50.845912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:50.845912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:50.845912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:50.847310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:50.847310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:50.847310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:50.847310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:50.847310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:50.847310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:50.847310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:50.847310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:50.847310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:50.847310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:50.847310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 10:56:50.847310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:50.847310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 245/479] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:56:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:50.854518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cf25d-9bca-427e-bfc8-b7452b3c242f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:50.874012 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:50.984857 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cf25d-9bca-427e-bfc8-b7452b3c242f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:51.021395 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95ff40-3b7e-4c1e-9b87-abd08e4637ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:51.022083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95ff40-3b7e-4c1e-9b87-abd08e4637ac None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:51.022367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95ff40-3b7e-4c1e-9b87-abd08e4637ac None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:51.022646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95ff40-3b7e-4c1e-9b87-abd08e4637ac None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:51.023401 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95ff40-3b7e-4c1e-9b87-abd08e4637ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:51.023708 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95ff40-3b7e-4c1e-9b87-abd08e4637ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:51.025144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95ff40-3b7e-4c1e-9b87-abd08e4637ac None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:51.034357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 235/480] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:56:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:52.234785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6bc70-9d67-4251-983d-eae0cff53908 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:52.235627 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6bc70-9d67-4251-983d-eae0cff53908 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:52.236048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6bc70-9d67-4251-983d-eae0cff53908 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:52.237851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 246/481] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:52.242831 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a346f-f85a-444b-81a7-029d0cb4cc12 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:52.243582 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a346f-f85a-444b-81a7-029d0cb4cc12 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:52.244007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a346f-f85a-444b-81a7-029d0cb4cc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:52.266112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e52a346f-f85a-444b-81a7-029d0cb4cc12 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:52.267505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e52a346f-f85a-444b-81a7-029d0cb4cc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:52.359175 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 236/482] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:52.402880 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6bc70-9d67-4251-983d-eae0cff53908 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:52.454067 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:52.526866 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6bc70-9d67-4251-983d-eae0cff53908 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:52.572564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cbae9-1dd8-46b7-a915-000e6126debd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:52.573779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cbae9-1dd8-46b7-a915-000e6126debd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:52.574295 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cbae9-1dd8-46b7-a915-000e6126debd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:52.574772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cbae9-1dd8-46b7-a915-000e6126debd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:52.593885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cbae9-1dd8-46b7-a915-000e6126debd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:52.601987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-d14cbae9-1dd8-46b7-a915-000e6126debd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:56:52.601987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:52.601987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:52.601987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:52.601987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:52.601987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:52.601987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:52.601987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:52.601987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:52.601987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:52.601987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:52.601987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:52.601987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:52.601987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:52.601987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:52.601987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:52.602938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:52.602938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:52.602938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:52.602938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:52.602938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:52.602938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:52.602938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:52.602938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:52.602938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:52.602938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:52.602938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:52.602938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:52.602938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:52.602938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:52.602938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:52.602938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:52.603734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:52.603734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:52.603734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:52.603734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:52.603734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:52.603734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:52.603734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:52.603734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:52.603734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:52.603734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:52.603734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:56:52.603734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:52.610592 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 247/483] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:56:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:52.616623 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a346f-f85a-444b-81a7-029d0cb4cc12 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:52.619395 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:52.704728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0b7c4-6914-405b-9dfe-92ed277de2ef None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:52.705379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0b7c4-6914-405b-9dfe-92ed277de2ef None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:52.705922 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0b7c4-6914-405b-9dfe-92ed277de2ef None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:52.710390 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 248/484] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:52.714321 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfdc6d-2e2b-44dc-931d-c404bef53236 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:52.714610 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfdc6d-2e2b-44dc-931d-c404bef53236 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:52.714888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfdc6d-2e2b-44dc-931d-c404bef53236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:52.739312 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-85dfdc6d-2e2b-44dc-931d-c404bef53236 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:52.741591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-85dfdc6d-2e2b-44dc-931d-c404bef53236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:52.789335 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a346f-f85a-444b-81a7-029d0cb4cc12 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:52.828955 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc5f0c-3535-42c4-a0e9-1c70fa781058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:52.830393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc5f0c-3535-42c4-a0e9-1c70fa781058 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:52.831129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc5f0c-3535-42c4-a0e9-1c70fa781058 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:52.831628 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc5f0c-3535-42c4-a0e9-1c70fa781058 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:52.833165 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc5f0c-3535-42c4-a0e9-1c70fa781058 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:52.833952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc5f0c-3535-42c4-a0e9-1c70fa781058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:52.835727 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc5f0c-3535-42c4-a0e9-1c70fa781058 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:52.841400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 249/485] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:52.841400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62db2df-b12b-4792-80ba-397c505c45d5 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:52.841400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62db2df-b12b-4792-80ba-397c505c45d5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:52.841400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62db2df-b12b-4792-80ba-397c505c45d5 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:52.841400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 250/486] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:52.853716 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9263b0-546d-481e-a7f2-b9b1d8ba51ab None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:52.854226 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9263b0-546d-481e-a7f2-b9b1d8ba51ab None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:52.854679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9263b0-546d-481e-a7f2-b9b1d8ba51ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:52.864383 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 237/487] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:56:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:52.869285 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc5f0c-3535-42c4-a0e9-1c70fa781058 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:52.873795 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5c9263b0-546d-481e-a7f2-b9b1d8ba51ab None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:52.874969 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5c9263b0-546d-481e-a7f2-b9b1d8ba51ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:52.913688 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:52.949785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:52.960828 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 251/488] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:56:52.962635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9263b0-546d-481e-a7f2-b9b1d8ba51ab None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:52.987210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc5f0c-3535-42c4-a0e9-1c70fa781058 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:53.025988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898e380-3716-4ce3-8a76-780f8baec292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:53.026934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898e380-3716-4ce3-8a76-780f8baec292 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:53.027280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898e380-3716-4ce3-8a76-780f8baec292 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:53.027627 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898e380-3716-4ce3-8a76-780f8baec292 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:53.039127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898e380-3716-4ce3-8a76-780f8baec292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:53.047895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b898e380-3716-4ce3-8a76-780f8baec292 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:56:53.047895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:53.047895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:53.047895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:53.047895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:53.047895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:53.047895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:53.047895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:53.047895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:53.047895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:53.047895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:53.047895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:53.047895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:53.047895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:53.047895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:53.047895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:53.048810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:53.048810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:53.048810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:53.048810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:53.048810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:53.048810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:53.048810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:53.048810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:53.048810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:53.048810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:53.048810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:53.048810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:53.048810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:53.048810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:53.048810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:53.048810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:53.050069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:53.050069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:53.050069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:53.050069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:53.050069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:53.050069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:53.050069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:53.050069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:53.050069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:53.050069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:53.050069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:56:53.050069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:53.050069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 238/489] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:56:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:53.051010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898e380-3716-4ce3-8a76-780f8baec292 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:53.094276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9263b0-546d-481e-a7f2-b9b1d8ba51ab None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:53.141715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bbbf7-e7d5-4c26-8e53-44c901878c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:53.142777 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bbbf7-e7d5-4c26-8e53-44c901878c37 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:53.143060 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bbbf7-e7d5-4c26-8e53-44c901878c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:53.143332 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bbbf7-e7d5-4c26-8e53-44c901878c37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:53.157311 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bbbf7-e7d5-4c26-8e53-44c901878c37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:53.159474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bbbf7-e7d5-4c26-8e53-44c901878c37 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:53.163473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898e380-3716-4ce3-8a76-780f8baec292 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:53.185674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-439bbbf7-e7d5-4c26-8e53-44c901878c37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:53.185674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:53.185674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:53.185674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:53.185674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:53.185674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:53.185674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:53.185674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:53.185674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:53.185674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:53.185674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:53.185674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:53.185674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:56:53.185674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:56:53.185674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:56:53.188030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:56:53.188030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:53.188030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:53.188030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:53.188030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:53.188030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:53.188030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:53.188030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:53.188030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:53.188030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:53.188030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:53.188030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:53.188030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:53.188030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:53.188030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:53.188030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:53.188030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:53.190144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:56:53.190144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:56:53.190144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:53.190144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:53.190144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 252/490] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:53.190144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bbbf7-e7d5-4c26-8e53-44c901878c37 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:53.196108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:53.211910 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:53.215636 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72c405-c24a-4147-84ed-6008b2f4623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:53.217083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72c405-c24a-4147-84ed-6008b2f4623d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:53.217624 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72c405-c24a-4147-84ed-6008b2f4623d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:53.218369 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72c405-c24a-4147-84ed-6008b2f4623d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:53.232897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72c405-c24a-4147-84ed-6008b2f4623d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:53.242392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6b72c405-c24a-4147-84ed-6008b2f4623d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:56:53.242392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:53.242392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:53.242392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:53.242392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:53.242392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:53.242392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:53.242392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:53.242392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:53.242392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:53.242392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:53.242392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:53.242392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:53.242392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:53.242392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:53.242392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:53.244261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:53.244261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:53.244261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:53.244261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:53.244261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:53.244261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:53.244261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:53.244261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:53.244261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:53.244261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:53.244261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:53.244261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:53.244261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:53.244261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:53.244261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:53.244261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:53.245045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:53.245045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:53.245045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:53.245045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:53.245045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:53.245045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:53.245045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:53.245045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:53.245045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:53.245045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:53.245045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:56:53.245045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:53.247685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 239/491] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:56:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:53.248315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72c405-c24a-4147-84ed-6008b2f4623d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:53.303172 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bbbf7-e7d5-4c26-8e53-44c901878c37 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:53.338881 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bf528-ec40-4b72-ba56-b8777744f29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:53.339531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bf528-ec40-4b72-ba56-b8777744f29a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:53.339815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bf528-ec40-4b72-ba56-b8777744f29a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:53.340091 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bf528-ec40-4b72-ba56-b8777744f29a None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:53.340836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52bf528-ec40-4b72-ba56-b8777744f29a None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:53.341195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52bf528-ec40-4b72-ba56-b8777744f29a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:53.343007 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52bf528-ec40-4b72-ba56-b8777744f29a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:53.356404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 253/492] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:56:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:53.357295 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bf528-ec40-4b72-ba56-b8777744f29a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:53.384132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72c405-c24a-4147-84ed-6008b2f4623d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:53.429168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3532667-c778-440c-8b01-33bda1e18f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:53.429910 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3532667-c778-440c-8b01-33bda1e18f82 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:53.430196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3532667-c778-440c-8b01-33bda1e18f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:53.430511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3532667-c778-440c-8b01-33bda1e18f82 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:53.431400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3532667-c778-440c-8b01-33bda1e18f82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:53.432189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3532667-c778-440c-8b01-33bda1e18f82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:53.433934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3532667-c778-440c-8b01-33bda1e18f82 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:53.447660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:53.452434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 240/493] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:53.452434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3532667-c778-440c-8b01-33bda1e18f82 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:53.467182 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bf528-ec40-4b72-ba56-b8777744f29a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:53.502588 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cd64b-c058-4227-bcc9-929bf3313153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:53.503476 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cd64b-c058-4227-bcc9-929bf3313153 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:53.503753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cd64b-c058-4227-bcc9-929bf3313153 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:53.504031 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cd64b-c058-4227-bcc9-929bf3313153 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:53.504594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:53.504771 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cd64b-c058-4227-bcc9-929bf3313153 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:53.505158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cd64b-c058-4227-bcc9-929bf3313153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:53.506605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cd64b-c058-4227-bcc9-929bf3313153 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:53.519912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 254/494] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:56:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:53.519912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088a1f1-53fd-4af4-b3cb-32e19906fd9d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:53.519912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088a1f1-53fd-4af4-b3cb-32e19906fd9d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:53.519912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088a1f1-53fd-4af4-b3cb-32e19906fd9d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:53.522633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 255/495] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:53.523275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088a1f1-53fd-4af4-b3cb-32e19906fd9d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:53.566976 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3532667-c778-440c-8b01-33bda1e18f82 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:53.604730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23921ea8-7500-4a38-b510-0fbf8da65c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:53.605571 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23921ea8-7500-4a38-b510-0fbf8da65c4b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:53.605822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23921ea8-7500-4a38-b510-0fbf8da65c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:53.606095 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23921ea8-7500-4a38-b510-0fbf8da65c4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:53.616331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23921ea8-7500-4a38-b510-0fbf8da65c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:53.617868 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23921ea8-7500-4a38-b510-0fbf8da65c4b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:53.626255 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088a1f1-53fd-4af4-b3cb-32e19906fd9d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:53.635382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-23921ea8-7500-4a38-b510-0fbf8da65c4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:53.635382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:53.635382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:53.635382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:53.635382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:53.635382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:53.635382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:53.635382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:53.635382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:53.635382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:53.635382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:53.635382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:53.635382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:56:53.635382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:56:53.635382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:56:53.636556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:56:53.636556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:53.636556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:53.636556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:53.636556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:53.636556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:53.636556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:53.636556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:53.636556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:53.636556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:53.636556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:53.636556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:53.636556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:53.636556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:53.636556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:53.636556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:53.636556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:53.637442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:56:53.637442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:56:53.637442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:53.637442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:53.637442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 241/496] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:53.637718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23921ea8-7500-4a38-b510-0fbf8da65c4b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:53.661470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4551a52-6b61-4593-87ad-856f4dc4cc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:53.662260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4551a52-6b61-4593-87ad-856f4dc4cc2d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:53.662538 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4551a52-6b61-4593-87ad-856f4dc4cc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:53.662813 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4551a52-6b61-4593-87ad-856f4dc4cc2d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:53.670699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4551a52-6b61-4593-87ad-856f4dc4cc2d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:53.672242 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4551a52-6b61-4593-87ad-856f4dc4cc2d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:53.687275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a4551a52-6b61-4593-87ad-856f4dc4cc2d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:56:53.687275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:53.687275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:53.687275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:53.687275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:53.687275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:53.687275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:53.687275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:53.687275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:53.687275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:53.687275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:53.687275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:53.687275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:56:53.687275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:56:53.687275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:56:53.687275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:53.688294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:53.689203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:53.689203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:53.689203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:56:53.689203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:56:53.689203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:56:53.689203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:56:53.689203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:56:53.689203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:56:53.689203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:56:53.689203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:53.689203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 256/497] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jun 27 10:56:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:53.689924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99852369-1a9e-4221-9da1-3293ed165947 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:53.690201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99852369-1a9e-4221-9da1-3293ed165947 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:53.690477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99852369-1a9e-4221-9da1-3293ed165947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:53.695538 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:53.708314 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-99852369-1a9e-4221-9da1-3293ed165947 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:53.709525 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-99852369-1a9e-4221-9da1-3293ed165947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:53.732467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:53.738598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23921ea8-7500-4a38-b510-0fbf8da65c4b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:53.771698 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e31889-97d6-4463-a080-85a7c4a0944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:53.772480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e31889-97d6-4463-a080-85a7c4a0944f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:53.772761 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e31889-97d6-4463-a080-85a7c4a0944f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:53.773037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e31889-97d6-4463-a080-85a7c4a0944f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:53.773975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 257/498] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:53.775853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65e95d-19f4-497c-9620-e498c9fcef35 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:53.776370 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65e95d-19f4-497c-9620-e498c9fcef35 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:53.776370 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65e95d-19f4-497c-9620-e498c9fcef35 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:53.781789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 258/499] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:53.781789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65e95d-19f4-497c-9620-e498c9fcef35 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:53.785514 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e31889-97d6-4463-a080-85a7c4a0944f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:53.786986 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e31889-97d6-4463-a080-85a7c4a0944f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:53.804391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-32e31889-97d6-4463-a080-85a7c4a0944f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:53.804391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:53.804391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:53.804391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:53.804391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:53.804391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:53.804391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:53.804391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:53.804391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:53.804391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:53.804391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:53.804391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:53.804391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:56:53.804391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:56:53.804391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:56:53.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:56:53.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:53.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:53.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:53.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:53.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:53.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:53.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:53.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:53.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:53.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:53.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:53.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:53.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:53.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:53.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:53.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:53.806410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:56:53.806410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:56:53.806410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:53.806410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:53.806410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 242/500] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:53.806665 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e31889-97d6-4463-a080-85a7c4a0944f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:53.892425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65e95d-19f4-497c-9620-e498c9fcef35 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:53.903816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e31889-97d6-4463-a080-85a7c4a0944f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:53.921164 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:53.926295 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22626ea8-1b35-47cc-a853-a1547ffde852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:53.926943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22626ea8-1b35-47cc-a853-a1547ffde852 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:53.927219 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22626ea8-1b35-47cc-a853-a1547ffde852 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:53.927493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22626ea8-1b35-47cc-a853-a1547ffde852 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:53.928193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22626ea8-1b35-47cc-a853-a1547ffde852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:53.928490 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22626ea8-1b35-47cc-a853-a1547ffde852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:53.929879 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22626ea8-1b35-47cc-a853-a1547ffde852 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:53.937500 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0791f19-d4fa-4f8b-810c-89d96098eefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:53.938152 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0791f19-d4fa-4f8b-810c-89d96098eefa None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:53.938435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0791f19-d4fa-4f8b-810c-89d96098eefa None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:53.938712 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0791f19-d4fa-4f8b-810c-89d96098eefa None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:53.939547 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0791f19-d4fa-4f8b-810c-89d96098eefa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:53.939876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0791f19-d4fa-4f8b-810c-89d96098eefa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:53.940867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 259/501] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:53.941277 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0791f19-d4fa-4f8b-810c-89d96098eefa None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:53.942077 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3125a-547c-4317-8833-2b2c17add7a7 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:53.942365 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3125a-547c-4317-8833-2b2c17add7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:53.942638 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3125a-547c-4317-8833-2b2c17add7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:53.959468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ffd3125a-547c-4317-8833-2b2c17add7a7 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:53.960659 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ffd3125a-547c-4317-8833-2b2c17add7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:53.980516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 243/502] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jun 27 10:56:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:53.981351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0791f19-d4fa-4f8b-810c-89d96098eefa None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:53.991056 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:54.026477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 260/503] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:54.027303 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3125a-547c-4317-8833-2b2c17add7a7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:54.092220 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0791f19-d4fa-4f8b-810c-89d96098eefa None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:54.122428 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3125a-547c-4317-8833-2b2c17add7a7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:54.124944 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6c29d-5a4f-4df3-838c-ceb6ec406302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:54.125747 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6c29d-5a4f-4df3-838c-ceb6ec406302 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:54.126029 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6c29d-5a4f-4df3-838c-ceb6ec406302 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:54.126302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6c29d-5a4f-4df3-838c-ceb6ec406302 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:54.136822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6c29d-5a4f-4df3-838c-ceb6ec406302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:54.144423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a6b6c29d-5a4f-4df3-838c-ceb6ec406302 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:56:54.144423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:54.144423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:54.144423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:54.144423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:54.144423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:54.144423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:54.144423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:54.144423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:54.144423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:54.144423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:54.144423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:54.144423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:54.144423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:54.144423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:54.144423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:54.145473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:54.145473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:54.145473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:54.145473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:54.145473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:54.145473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:54.145473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:54.145473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:54.145473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:54.145473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:54.145473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:54.145473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:54.145473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:54.145473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:54.145473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:54.145473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:54.146351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:54.146351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:54.146351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:54.146351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:54.146351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:54.146351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:54.146351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:54.146351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:54.146351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:54.146351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:54.146351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:56:54.146351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:54.146351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 244/504] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:56:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:54.147229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6c29d-5a4f-4df3-838c-ceb6ec406302 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:54.147587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:54.162091 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9cf12-76cf-478a-bac8-e44edd3bf211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:54.162742 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9cf12-76cf-478a-bac8-e44edd3bf211 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:54.163020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9cf12-76cf-478a-bac8-e44edd3bf211 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:54.163290 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9cf12-76cf-478a-bac8-e44edd3bf211 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:54.163995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9cf12-76cf-478a-bac8-e44edd3bf211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:54.164292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9cf12-76cf-478a-bac8-e44edd3bf211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:54.165662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9cf12-76cf-478a-bac8-e44edd3bf211 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:54.176755 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 261/505] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:54.177565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9cf12-76cf-478a-bac8-e44edd3bf211 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:54.215577 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:54.249217 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6c29d-5a4f-4df3-838c-ceb6ec406302 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:54.275953 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9cf12-76cf-478a-bac8-e44edd3bf211 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:54.281721 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95826c7e-7345-4270-8d97-29a822c62ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:54.282514 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95826c7e-7345-4270-8d97-29a822c62ddc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:54.282795 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95826c7e-7345-4270-8d97-29a822c62ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:54.283069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95826c7e-7345-4270-8d97-29a822c62ddc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:54.291468 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95826c7e-7345-4270-8d97-29a822c62ddc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:54.292931 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95826c7e-7345-4270-8d97-29a822c62ddc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:54.308321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-95826c7e-7345-4270-8d97-29a822c62ddc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 10:56:54.308321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:54.308321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:54.308321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:54.308321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:54.308321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:54.308321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:54.308321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:54.308321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:54.308321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:54.308321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:54.308321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:54.308321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:56:54.308321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:56:54.308321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:56:54.308321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:54.309433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:54.310731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:54.310731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:54.310731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:56:54.310731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:56:54.310731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:56:54.310731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:56:54.310731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:56:54.310731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:56:54.310731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 10:56:54.310731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:54.311262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f5e78-6c30-4923-8366-b4b9090ecb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:54.311262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f5e78-6c30-4923-8366-b4b9090ecb3d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:54.311262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f5e78-6c30-4923-8366-b4b9090ecb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:54.311775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 245/506] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:54.311843 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f5e78-6c30-4923-8366-b4b9090ecb3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:54.311907 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95826c7e-7345-4270-8d97-29a822c62ddc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:54.357988 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:54.376805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f5e78-6c30-4923-8366-b4b9090ecb3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:54.378373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f5e78-6c30-4923-8366-b4b9090ecb3d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:54.416298 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95826c7e-7345-4270-8d97-29a822c62ddc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:54.440388 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:54.448970 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7092e-2bde-40bb-9a6d-71b99bf8c31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:54.449843 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7092e-2bde-40bb-9a6d-71b99bf8c31d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:54.450120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7092e-2bde-40bb-9a6d-71b99bf8c31d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:54.450391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7092e-2bde-40bb-9a6d-71b99bf8c31d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:54.460684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7092e-2bde-40bb-9a6d-71b99bf8c31d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:54.462173 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7092e-2bde-40bb-9a6d-71b99bf8c31d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:54.473637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 262/507] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:54.474461 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f5e78-6c30-4923-8366-b4b9090ecb3d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:54.479305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-eee7092e-2bde-40bb-9a6d-71b99bf8c31d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:54.479305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:54.479305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:54.479305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:54.479305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:54.479305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:54.479305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:54.479305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:54.479305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:54.479305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:54.479305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:54.479305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:54.479305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:56:54.479305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:56:54.479305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:56:54.480255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:56:54.480255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:54.480255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:54.480255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:54.480255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:54.480255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:54.480255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:54.480255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:54.480255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:54.480255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:54.480255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:54.480255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:54.480255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:54.480255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:54.480255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:54.480255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:54.480255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:54.481301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:56:54.481301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:56:54.481301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:54.481301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:54.481301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 246/508] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:54.481301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7092e-2bde-40bb-9a6d-71b99bf8c31d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:54.554673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:54.573497 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f5e78-6c30-4923-8366-b4b9090ecb3d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:54.581868 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7092e-2bde-40bb-9a6d-71b99bf8c31d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:54.607064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04050e-2ab6-4498-8b11-3911dafc6d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:54.607720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04050e-2ab6-4498-8b11-3911dafc6d12 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:54.607996 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04050e-2ab6-4498-8b11-3911dafc6d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:54.608269 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04050e-2ab6-4498-8b11-3911dafc6d12 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:54.608997 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04050e-2ab6-4498-8b11-3911dafc6d12 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:54.609296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04050e-2ab6-4498-8b11-3911dafc6d12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:54.610697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04050e-2ab6-4498-8b11-3911dafc6d12 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:54.614911 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a914be-fd97-488c-961d-33fd0050190f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:54.615693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a914be-fd97-488c-961d-33fd0050190f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:54.615981 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a914be-fd97-488c-961d-33fd0050190f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:54.616255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a914be-fd97-488c-961d-33fd0050190f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:54.619017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 263/509] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:56:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:54.619776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04050e-2ab6-4498-8b11-3911dafc6d12 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:54.628641 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a914be-fd97-488c-961d-33fd0050190f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:54.630135 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a914be-fd97-488c-961d-33fd0050190f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:54.644274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-70a914be-fd97-488c-961d-33fd0050190f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 27 10:56:54.644274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:54.644274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:54.644274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:54.644274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:54.644274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:54.644274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:54.644274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:54.644274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:54.644274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:54.644274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:54.644274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:54.644274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:56:54.644274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:56:54.644274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:56:54.644274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:54.645129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:54.646042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:54.646042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:54.646042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:56:54.646042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:56:54.646042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:56:54.646042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:56:54.646042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:56:54.646042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:56:54.646042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 27 10:56:54.646042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:54.649507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 247/510] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:56:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:54.650297 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a914be-fd97-488c-961d-33fd0050190f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:54.688374 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:54.723412 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04050e-2ab6-4498-8b11-3911dafc6d12 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:54.748649 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a914be-fd97-488c-961d-33fd0050190f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:54.756296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cd3b1-7d90-46c3-8f05-b65d7b71b063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:54.756954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cd3b1-7d90-46c3-8f05-b65d7b71b063 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:54.757238 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cd3b1-7d90-46c3-8f05-b65d7b71b063 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:54.757546 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cd3b1-7d90-46c3-8f05-b65d7b71b063 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:54.758375 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cd3b1-7d90-46c3-8f05-b65d7b71b063 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:54.758682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cd3b1-7d90-46c3-8f05-b65d7b71b063 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:54.760112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cd3b1-7d90-46c3-8f05-b65d7b71b063 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:54.781345 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61c4ec-799f-4501-b36d-85c451db7c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:54.782154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61c4ec-799f-4501-b36d-85c451db7c0a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:54.782440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61c4ec-799f-4501-b36d-85c451db7c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:54.782721 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61c4ec-799f-4501-b36d-85c451db7c0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:54.793659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61c4ec-799f-4501-b36d-85c451db7c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:54.795114 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61c4ec-799f-4501-b36d-85c451db7c0a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:54.797276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 264/511] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jun 27 10:56:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:54.798198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cd3b1-7d90-46c3-8f05-b65d7b71b063 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:54.800773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:54.819470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-2e61c4ec-799f-4501-b36d-85c451db7c0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:54.819470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:54.819470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:54.819470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:54.819470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:54.819470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:54.819470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:54.819470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:54.819470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:54.819470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:54.819470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:54.819470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:54.819470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:56:54.819470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:56:54.819470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:56:54.820483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:56:54.820483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:54.820483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:54.820483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:54.820483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:54.820483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:54.820483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:54.820483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:54.820483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:54.820483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:54.820483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:54.820483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:54.820483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:54.820483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:54.820483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:54.820483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:54.820483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:54.821414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:56:54.821414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:56:54.821414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:54.821414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:54.821414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 248/512] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:54.821742 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61c4ec-799f-4501-b36d-85c451db7c0a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:54.898378 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cd3b1-7d90-46c3-8f05-b65d7b71b063 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:54.909491 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:54.920156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61c4ec-799f-4501-b36d-85c451db7c0a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:54.932251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9ea40-47e2-41fd-a7fb-2a3221ebca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:54.933067 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9ea40-47e2-41fd-a7fb-2a3221ebca73 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:54.933525 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9ea40-47e2-41fd-a7fb-2a3221ebca73 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:54.933797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9ea40-47e2-41fd-a7fb-2a3221ebca73 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:54.934508 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9ea40-47e2-41fd-a7fb-2a3221ebca73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:54.934807 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9ea40-47e2-41fd-a7fb-2a3221ebca73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:54.936163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9ea40-47e2-41fd-a7fb-2a3221ebca73 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:54.946953 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 265/513] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:54.947712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9ea40-47e2-41fd-a7fb-2a3221ebca73 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:54.952962 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9365ae-5405-450f-ab82-40aa9cb9a71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:54.953792 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9365ae-5405-450f-ab82-40aa9cb9a71e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:54.953992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9365ae-5405-450f-ab82-40aa9cb9a71e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:54.954272 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9365ae-5405-450f-ab82-40aa9cb9a71e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:54.966321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9365ae-5405-450f-ab82-40aa9cb9a71e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:54.967776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9365ae-5405-450f-ab82-40aa9cb9a71e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:54.984906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ec9365ae-5405-450f-ab82-40aa9cb9a71e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:54.984906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:54.984906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:54.984906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:54.984906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:54.984906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:54.984906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:54.984906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:54.984906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:54.984906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:54.984906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:54.984906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:54.984906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:56:54.984906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:56:54.984906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:56:54.985757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:56:54.985757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:54.985757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:54.985757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:54.985757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:54.985757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:54.985757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:54.985757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:54.985757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:54.985757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:54.985757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:54.985757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:54.985757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:54.985757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:54.985757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:54.985757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:54.985757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:54.986598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:56:54.986598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:56:54.986598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:54.986598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:54.986598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 249/514] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:54.986851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9365ae-5405-450f-ab82-40aa9cb9a71e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:55.008979 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:55.049834 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9ea40-47e2-41fd-a7fb-2a3221ebca73 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:55.082707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbde274-00de-4c8f-ad3f-0ed133c12f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:55.083298 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbde274-00de-4c8f-ad3f-0ed133c12f0c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:55.083576 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbde274-00de-4c8f-ad3f-0ed133c12f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:55.083852 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbde274-00de-4c8f-ad3f-0ed133c12f0c None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:55.084677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbde274-00de-4c8f-ad3f-0ed133c12f0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:55.084981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbde274-00de-4c8f-ad3f-0ed133c12f0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:55.085709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9365ae-5405-450f-ab82-40aa9cb9a71e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:55.086967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbde274-00de-4c8f-ad3f-0ed133c12f0c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:55.105014 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 266/515] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jun 27 10:56:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:55.105830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbde274-00de-4c8f-ad3f-0ed133c12f0c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:55.119088 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee23bfa-e43f-4475-b0aa-c9bcc174b583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:55.119720 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee23bfa-e43f-4475-b0aa-c9bcc174b583 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:55.120001 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee23bfa-e43f-4475-b0aa-c9bcc174b583 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:55.120276 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee23bfa-e43f-4475-b0aa-c9bcc174b583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:55.131902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:55.186729 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee23bfa-e43f-4475-b0aa-c9bcc174b583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:55.188160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee23bfa-e43f-4475-b0aa-c9bcc174b583 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:55.206190 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbde274-00de-4c8f-ad3f-0ed133c12f0c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:55.226739 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:55.241178 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee506df-f333-4f7d-9069-d21cfb31e24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:55.241862 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee506df-f333-4f7d-9069-d21cfb31e24f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:55.242146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee506df-f333-4f7d-9069-d21cfb31e24f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:55.242427 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee506df-f333-4f7d-9069-d21cfb31e24f None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:55.243137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee506df-f333-4f7d-9069-d21cfb31e24f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:55.243438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee506df-f333-4f7d-9069-d21cfb31e24f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:55.244801 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee506df-f333-4f7d-9069-d21cfb31e24f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:55.255587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 267/516] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:55.256343 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee506df-f333-4f7d-9069-d21cfb31e24f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:55.287036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 250/517] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:55.287868 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee23bfa-e43f-4475-b0aa-c9bcc174b583 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:55.331113 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:55.355851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee506df-f333-4f7d-9069-d21cfb31e24f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:55.387318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee23bfa-e43f-4475-b0aa-c9bcc174b583 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:55.388584 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a06f3b-e534-4196-9fe5-27bdf948c4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:55.389245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a06f3b-e534-4196-9fe5-27bdf948c4b8 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:55.389550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a06f3b-e534-4196-9fe5-27bdf948c4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:55.389830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a06f3b-e534-4196-9fe5-27bdf948c4b8 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:55.390516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a06f3b-e534-4196-9fe5-27bdf948c4b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:55.391918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a06f3b-e534-4196-9fe5-27bdf948c4b8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:55.411134 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 268/518] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:56:55 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:56:55.412092 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a06f3b-e534-4196-9fe5-27bdf948c4b8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:55.426079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df80e5-b8b0-418e-8860-07997f9bdb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:55.426760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df80e5-b8b0-418e-8860-07997f9bdb5d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:55.427040 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df80e5-b8b0-418e-8860-07997f9bdb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:55.427340 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df80e5-b8b0-418e-8860-07997f9bdb5d None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:55.428086 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df80e5-b8b0-418e-8860-07997f9bdb5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:55.428391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df80e5-b8b0-418e-8860-07997f9bdb5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:55.429835 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df80e5-b8b0-418e-8860-07997f9bdb5d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:55.442725 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 251/519] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:55.443658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df80e5-b8b0-418e-8860-07997f9bdb5d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:55.460344 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:55.537170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a06f3b-e534-4196-9fe5-27bdf948c4b8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:55.559332 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df80e5-b8b0-418e-8860-07997f9bdb5d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:55.560906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:55.573428 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b7984-819b-471b-a1eb-bb1c8e8bd06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:55.574047 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b7984-819b-471b-a1eb-bb1c8e8bd06c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:55.574323 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b7984-819b-471b-a1eb-bb1c8e8bd06c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:55.574598 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b7984-819b-471b-a1eb-bb1c8e8bd06c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:55.602280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd463760-1ec8-49b5-aa67-b74b36a178bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:55.603103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd463760-1ec8-49b5-aa67-b74b36a178bf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:55.603388 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd463760-1ec8-49b5-aa67-b74b36a178bf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:55.603663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd463760-1ec8-49b5-aa67-b74b36a178bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:55.611935 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd463760-1ec8-49b5-aa67-b74b36a178bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:55.613349 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd463760-1ec8-49b5-aa67-b74b36a178bf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:55.630539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-cd463760-1ec8-49b5-aa67-b74b36a178bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:56:55.630539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:55.630539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:55.630539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:55.630539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:55.630539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:55.630539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:55.630539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:55.630539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:55.630539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:55.630539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:55.630539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:55.630539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:56:55.630539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:56:55.630539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:56:55.631459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:56:55.631459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:55.631459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:55.631459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:55.631459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:55.631459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:55.631459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:55.631459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:55.631459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:55.631459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:55.631459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:55.631459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:55.631459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:55.631459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:55.631459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:55.631459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:55.631459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:55.632292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:56:55.632292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:56:55.632292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:56:55.632292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:56:55.632292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:56:55.632292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:56:55.632292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:56:55.632292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:55.632292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 252/520] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:56:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:55.632742 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd463760-1ec8-49b5-aa67-b74b36a178bf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:55.656390 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b7984-819b-471b-a1eb-bb1c8e8bd06c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:55.658409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b7984-819b-471b-a1eb-bb1c8e8bd06c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:55.693773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:55.741256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd463760-1ec8-49b5-aa67-b74b36a178bf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:55.766172 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 269/521] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:55.767016 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b7984-819b-471b-a1eb-bb1c8e8bd06c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:55.782908 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4971386-ffde-4dce-a56f-6b0e35dc802d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:55.784005 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4971386-ffde-4dce-a56f-6b0e35dc802d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:55.784480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4971386-ffde-4dce-a56f-6b0e35dc802d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:55.784967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4971386-ffde-4dce-a56f-6b0e35dc802d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:55.795615 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4971386-ffde-4dce-a56f-6b0e35dc802d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:55.797081 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4971386-ffde-4dce-a56f-6b0e35dc802d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:55.816194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b4971386-ffde-4dce-a56f-6b0e35dc802d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:55.816194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:55.816194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:55.816194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:55.816194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:55.816194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:55.816194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:55.816194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:55.816194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:55.816194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:55.816194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:55.816194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:55.816194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:56:55.816194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:56:55.816194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:56:55.817037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:56:55.817037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:55.817037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:55.817037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:55.817037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:55.817037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:55.817037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:55.817037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:55.817037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:55.817037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:55.817037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:55.817037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:55.817037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:55.817037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:55.817037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:55.817037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:55.817037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:55.817959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:56:55.817959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:56:55.817959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:55.817959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:55.817959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 253/522] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:55.818594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4971386-ffde-4dce-a56f-6b0e35dc802d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:55.835124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:55.878408 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b7984-819b-471b-a1eb-bb1c8e8bd06c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:55.916310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629504d-2606-4d3a-bd43-dfab85255565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:55.917255 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629504d-2606-4d3a-bd43-dfab85255565 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:55.917872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629504d-2606-4d3a-bd43-dfab85255565 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:55.918151 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629504d-2606-4d3a-bd43-dfab85255565 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:55.920940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:55.924092 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4971386-ffde-4dce-a56f-6b0e35dc802d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:55.926041 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629504d-2606-4d3a-bd43-dfab85255565 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:55.927857 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629504d-2606-4d3a-bd43-dfab85255565 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:55.943551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-8629504d-2606-4d3a-bd43-dfab85255565 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 10:56:55.943551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:55.943551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:55.943551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:55.943551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:55.943551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:55.943551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:55.943551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:55.943551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:55.943551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:55.943551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:55.943551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:55.943551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:56:55.943551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:56:55.943551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:56:55.943551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:55.944617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:55.945700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:55.945700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:55.945700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:56:55.945700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:56:55.945700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:56:55.945700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:56:55.945700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:56:55.945700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:56:55.945700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 10:56:55.945700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:55.945700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 270/523] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:56:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:55.945700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629504d-2606-4d3a-bd43-dfab85255565 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:55.972479 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42fc6f-842b-4f3e-9d92-e176d40dedf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:55.973135 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42fc6f-842b-4f3e-9d92-e176d40dedf8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:55.973446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42fc6f-842b-4f3e-9d92-e176d40dedf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:55.973726 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42fc6f-842b-4f3e-9d92-e176d40dedf8 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:55.974505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42fc6f-842b-4f3e-9d92-e176d40dedf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:55.974810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42fc6f-842b-4f3e-9d92-e176d40dedf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:55.976233 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42fc6f-842b-4f3e-9d92-e176d40dedf8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:56.000087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 254/524] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:56:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:56.000087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42fc6f-842b-4f3e-9d92-e176d40dedf8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:56.055089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629504d-2606-4d3a-bd43-dfab85255565 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:56.074709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:56.092486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1a127-6704-46db-a304-a7c8dcd5ced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:56.093459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1a127-6704-46db-a304-a7c8dcd5ced9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:56.093741 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1a127-6704-46db-a304-a7c8dcd5ced9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:56.094013 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1a127-6704-46db-a304-a7c8dcd5ced9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:56.101787 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42fc6f-842b-4f3e-9d92-e176d40dedf8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:56.104419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1a127-6704-46db-a304-a7c8dcd5ced9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:56.106257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1a127-6704-46db-a304-a7c8dcd5ced9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:56.124637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-00c1a127-6704-46db-a304-a7c8dcd5ced9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:56.124637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:56.124637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:56.124637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:56.124637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:56.124637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:56.124637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:56.124637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:56.124637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:56.124637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:56.124637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:56.124637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:56.124637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:56:56.124637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:56:56.124637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:56:56.125609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:56:56.125609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:56.125609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:56.125609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:56.125609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:56.125609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:56.125609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:56.125609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:56.125609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:56.125609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:56.125609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:56.125609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:56.125609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:56.125609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:56.125609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:56.125609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:56.125609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:56.126432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:56:56.126432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:56:56.126432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:56.126432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:56.126432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 271/525] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:56.126781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1a127-6704-46db-a304-a7c8dcd5ced9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:56.140958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a5cd6-8a8c-48ad-82cb-35f8e4882ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:56.141571 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a5cd6-8a8c-48ad-82cb-35f8e4882ecd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:56.141878 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a5cd6-8a8c-48ad-82cb-35f8e4882ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:56.142127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a5cd6-8a8c-48ad-82cb-35f8e4882ecd None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:56.142844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a5cd6-8a8c-48ad-82cb-35f8e4882ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:56.143150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a5cd6-8a8c-48ad-82cb-35f8e4882ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:56.144535 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a5cd6-8a8c-48ad-82cb-35f8e4882ecd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:56.161473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 255/526] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:56.161473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a5cd6-8a8c-48ad-82cb-35f8e4882ecd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:56.177185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:56.229289 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1a127-6704-46db-a304-a7c8dcd5ced9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:56.262443 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dfc09-75d4-42ab-94e6-5a5ac45b028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:56.263105 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dfc09-75d4-42ab-94e6-5a5ac45b028d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:56.263385 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dfc09-75d4-42ab-94e6-5a5ac45b028d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:56.263658 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dfc09-75d4-42ab-94e6-5a5ac45b028d None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:56.264485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1dfc09-75d4-42ab-94e6-5a5ac45b028d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:56.264793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1dfc09-75d4-42ab-94e6-5a5ac45b028d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:56.266247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1dfc09-75d4-42ab-94e6-5a5ac45b028d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:56.280304 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a5cd6-8a8c-48ad-82cb-35f8e4882ecd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:56.283133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 272/527] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Jun 27 10:56:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:56.283834 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dfc09-75d4-42ab-94e6-5a5ac45b028d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:56.320888 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2a240-623c-4c15-84bd-f31dc1b0ecff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:56.321565 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2a240-623c-4c15-84bd-f31dc1b0ecff None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:56.321834 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2a240-623c-4c15-84bd-f31dc1b0ecff None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:56.322112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2a240-623c-4c15-84bd-f31dc1b0ecff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:56.322943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2a240-623c-4c15-84bd-f31dc1b0ecff None admin] RBAC: Adding query filter params (role.id=e053e0425eb744e2a3e3316222e208f3, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=ed08c367a3d34207a51914ff77a93898) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:56.323256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2a240-623c-4c15-84bd-f31dc1b0ecff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:56.324762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2a240-623c-4c15-84bd-f31dc1b0ecff None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:56.326542 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:56.341424 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 256/528] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:56 2022] GET /identity/v3/role_assignments?user.id=ed08c367a3d34207a51914ff77a93898&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=e053e0425eb744e2a3e3316222e208f3 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:56.341424 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2a240-623c-4c15-84bd-f31dc1b0ecff None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:56.406453 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dfc09-75d4-42ab-94e6-5a5ac45b028d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:56.415952 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:56.446520 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6b9a7-f679-48e0-8431-21078951f91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:56.447301 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6b9a7-f679-48e0-8431-21078951f91e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:56.447651 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6b9a7-f679-48e0-8431-21078951f91e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:56.447997 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6b9a7-f679-48e0-8431-21078951f91e None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:56.448802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6b9a7-f679-48e0-8431-21078951f91e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:56.449178 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6b9a7-f679-48e0-8431-21078951f91e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:56.450748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6b9a7-f679-48e0-8431-21078951f91e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:56.463985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 273/529] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:56.469087 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6b9a7-f679-48e0-8431-21078951f91e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:56.490023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2a240-623c-4c15-84bd-f31dc1b0ecff None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:56.538898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df2280-09f7-4cc2-b84e-a54e28568a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:56.540378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df2280-09f7-4cc2-b84e-a54e28568a7d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:56.541448 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df2280-09f7-4cc2-b84e-a54e28568a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:56.541814 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df2280-09f7-4cc2-b84e-a54e28568a7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:56.552347 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df2280-09f7-4cc2-b84e-a54e28568a7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:56.554550 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df2280-09f7-4cc2-b84e-a54e28568a7d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:56.573538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-43df2280-09f7-4cc2-b84e-a54e28568a7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:56:56.573538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:56.573538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:56.573538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:56.573538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:56.573538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:56.573538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:56.573538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:56.573538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:56.573538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:56.573538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:56.573538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:56.573538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:56:56.573538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:56:56.573538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:56:56.574437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:56:56.574437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:56.574437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:56.574437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:56.574437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:56.574437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:56.574437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:56.574437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:56.574437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:56.574437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:56.574437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:56.574437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:56.574437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:56.574437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:56.574437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:56.574437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:56.574437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:56.575265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:56:56.575265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:56:56.575265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:56:56.575265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:56:56.575265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:56:56.575265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:56:56.575265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:56:56.575265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:56.575265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 257/530] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:56:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:56.576203 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df2280-09f7-4cc2-b84e-a54e28568a7d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:56.598061 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6b9a7-f679-48e0-8431-21078951f91e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:56.633769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e0ac1-8a90-4674-bb55-f4bd7de3e39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:56.634417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e0ac1-8a90-4674-bb55-f4bd7de3e39e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:56.634699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e0ac1-8a90-4674-bb55-f4bd7de3e39e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:56.634976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e0ac1-8a90-4674-bb55-f4bd7de3e39e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:56.662877 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:56.672643 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:56.720489 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e0ac1-8a90-4674-bb55-f4bd7de3e39e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:56.722217 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df2280-09f7-4cc2-b84e-a54e28568a7d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:56.724240 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e0ac1-8a90-4674-bb55-f4bd7de3e39e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:56.785733 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e1b88-69fa-4e23-bbd5-e97fc35dd63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:56.786146 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e1b88-69fa-4e23-bbd5-e97fc35dd63c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:56.786436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e1b88-69fa-4e23-bbd5-e97fc35dd63c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:56.786824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e1b88-69fa-4e23-bbd5-e97fc35dd63c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:56.801038 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e1b88-69fa-4e23-bbd5-e97fc35dd63c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:56.802691 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e1b88-69fa-4e23-bbd5-e97fc35dd63c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:56.825018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-1c6e1b88-69fa-4e23-bbd5-e97fc35dd63c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:56:56.825018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:56.825018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:56.825018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:56.825018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:56.825018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:56.825018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:56.825018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:56.825018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:56.825018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:56.825018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:56.825018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:56.825018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:56:56.825018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:56:56.825018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:56:56.825951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:56:56.825951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:56.825951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:56.825951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:56.825951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:56.825951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:56.825951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:56.825951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:56.825951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:56.825951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:56.825951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:56.825951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:56.825951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:56.825951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:56.825951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:56.825951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:56.825951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:56.826788 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:56:56.826788 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:56:56.826788 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:56:56.826788 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:56:56.826788 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:56:56.826788 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:56:56.826788 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:56:56.826788 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:56.829506 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 258/531] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:56:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:56.830515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e1b88-69fa-4e23-bbd5-e97fc35dd63c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:56.916399 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 274/532] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:56.917224 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e0ac1-8a90-4674-bb55-f4bd7de3e39e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:57.033049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:57.039698 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e1b88-69fa-4e23-bbd5-e97fc35dd63c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:57.060157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:57.078915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b525d6e-9590-4951-b092-054cc97b936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:57.079934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b525d6e-9590-4951-b092-054cc97b936c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:57.080431 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b525d6e-9590-4951-b092-054cc97b936c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:57.080904 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b525d6e-9590-4951-b092-054cc97b936c None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:57.081953 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b525d6e-9590-4951-b092-054cc97b936c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:57.082486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b525d6e-9590-4951-b092-054cc97b936c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:57.084220 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b525d6e-9590-4951-b092-054cc97b936c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:57.092175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e0ac1-8a90-4674-bb55-f4bd7de3e39e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:57.101493 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 259/533] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:56:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:57.102744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b525d6e-9590-4951-b092-054cc97b936c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:57.178209 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f8521-de4d-400e-a9ef-5e2347ffc394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:57.178811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f8521-de4d-400e-a9ef-5e2347ffc394 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:57.179072 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f8521-de4d-400e-a9ef-5e2347ffc394 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:57.179346 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f8521-de4d-400e-a9ef-5e2347ffc394 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:57.182970 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f8521-de4d-400e-a9ef-5e2347ffc394 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:57.182970 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f8521-de4d-400e-a9ef-5e2347ffc394 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:57.182970 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f8521-de4d-400e-a9ef-5e2347ffc394 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:57.232553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b525d6e-9590-4951-b092-054cc97b936c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:57.244378 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 275/534] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:56:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:57.245115 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f8521-de4d-400e-a9ef-5e2347ffc394 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:57.282691 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52409fda-024a-45ce-a025-feb545c06fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:57.283851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52409fda-024a-45ce-a025-feb545c06fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:57.286468 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52409fda-024a-45ce-a025-feb545c06fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:57.286977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52409fda-024a-45ce-a025-feb545c06fb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:57.310126 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52409fda-024a-45ce-a025-feb545c06fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:57.312578 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52409fda-024a-45ce-a025-feb545c06fb7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:57.332949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-52409fda-024a-45ce-a025-feb545c06fb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:57.332949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:57.332949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:57.332949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:57.332949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:57.332949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:57.332949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:57.332949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:57.332949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:57.332949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:57.332949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:57.332949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:57.332949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:56:57.332949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:56:57.332949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:56:57.334309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:56:57.334309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:57.334309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:57.334309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:57.334309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:57.334309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:57.334309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:57.334309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:57.334309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:57.334309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:57.334309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:57.334309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:57.334309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:57.334309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:57.334309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:57.334309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:57.334309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:57.335143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:56:57.335143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:56:57.335143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:57.335143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:57.337794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 260/535] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:57.338933 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52409fda-024a-45ce-a025-feb545c06fb7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:57.372072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:57.377291 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f8521-de4d-400e-a9ef-5e2347ffc394 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:57.406365 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:57.415915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2798b7a-81ed-4cd4-b4fe-13c8c5b8ec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:57.417381 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2798b7a-81ed-4cd4-b4fe-13c8c5b8ec63 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:57.417858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2798b7a-81ed-4cd4-b4fe-13c8c5b8ec63 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:57.418403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2798b7a-81ed-4cd4-b4fe-13c8c5b8ec63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:57.419523 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2798b7a-81ed-4cd4-b4fe-13c8c5b8ec63 None admin] RBAC: Adding query filter params (role.id=e053e0425eb744e2a3e3316222e208f3, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=521f3fcc63524d2d82b4a05a0dc062f0) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:57.420360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2798b7a-81ed-4cd4-b4fe-13c8c5b8ec63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:57.421828 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2798b7a-81ed-4cd4-b4fe-13c8c5b8ec63 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:57.431850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 276/536] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:57 2022] GET /identity/v3/role_assignments?user.id=521f3fcc63524d2d82b4a05a0dc062f0&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=e053e0425eb744e2a3e3316222e208f3 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:57.431850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2798b7a-81ed-4cd4-b4fe-13c8c5b8ec63 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:57.480899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52409fda-024a-45ce-a025-feb545c06fb7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:57.530945 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4fe74-e1d1-43fd-a8bd-b95f16ab52b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:57.532169 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4fe74-e1d1-43fd-a8bd-b95f16ab52b6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:57.532727 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4fe74-e1d1-43fd-a8bd-b95f16ab52b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:57.533010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4fe74-e1d1-43fd-a8bd-b95f16ab52b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:57.534160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4fe74-e1d1-43fd-a8bd-b95f16ab52b6 None admin] RBAC: Adding query filter params (role.id=e053e0425eb744e2a3e3316222e208f3, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=49b6436fdd7a4977a2e02c0e1b8be2c7) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:57.534895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4fe74-e1d1-43fd-a8bd-b95f16ab52b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:57.536874 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4fe74-e1d1-43fd-a8bd-b95f16ab52b6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:57.540995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2798b7a-81ed-4cd4-b4fe-13c8c5b8ec63 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:57.545703 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 261/537] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:57 2022] GET /identity/v3/role_assignments?user.id=49b6436fdd7a4977a2e02c0e1b8be2c7&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=e053e0425eb744e2a3e3316222e208f3 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:57.546903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3e230-93c7-44b4-9f16-da9b3398fbaa None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:57.547189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3e230-93c7-44b4-9f16-da9b3398fbaa None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:57.547462 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3e230-93c7-44b4-9f16-da9b3398fbaa None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:57.549403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 262/538] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:57.563020 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b453b6-6a5a-409d-8a16-9f358ecc0704 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:57.563331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b453b6-6a5a-409d-8a16-9f358ecc0704 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:57.563584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b453b6-6a5a-409d-8a16-9f358ecc0704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:57.593467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f7b453b6-6a5a-409d-8a16-9f358ecc0704 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:57.594712 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f7b453b6-6a5a-409d-8a16-9f358ecc0704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:57.618915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79cf9c-2245-46ac-8f62-f97ac0935ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:57.619621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79cf9c-2245-46ac-8f62-f97ac0935ace None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:57.619903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79cf9c-2245-46ac-8f62-f97ac0935ace None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:57.620173 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79cf9c-2245-46ac-8f62-f97ac0935ace None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:57.620897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79cf9c-2245-46ac-8f62-f97ac0935ace None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:57.621203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79cf9c-2245-46ac-8f62-f97ac0935ace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:57.622642 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79cf9c-2245-46ac-8f62-f97ac0935ace None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:57.641331 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 277/539] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:57.646326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79cf9c-2245-46ac-8f62-f97ac0935ace None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:57.700762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 263/540] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:57.707425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:57.728155 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b453b6-6a5a-409d-8a16-9f358ecc0704 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:57.756982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:57.760553 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79cf9c-2245-46ac-8f62-f97ac0935ace None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:57.799443 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44558a24-5b20-4c1f-b6fe-80d722583ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:57.800332 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44558a24-5b20-4c1f-b6fe-80d722583ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:57.800686 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44558a24-5b20-4c1f-b6fe-80d722583ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:57.801032 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44558a24-5b20-4c1f-b6fe-80d722583ce8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:57.809241 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44558a24-5b20-4c1f-b6fe-80d722583ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:57.810821 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44558a24-5b20-4c1f-b6fe-80d722583ce8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:57.826076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-44558a24-5b20-4c1f-b6fe-80d722583ce8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:56:57.826076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:57.826076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:57.826076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:57.826076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:57.826076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:57.826076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:57.826076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:57.826076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:57.826076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:57.826076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:57.826076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:57.826076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:56:57.826076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:56:57.826076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:56:57.826967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:56:57.826967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:57.826967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:57.826967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:57.826967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:57.826967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:57.826967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:57.826967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:57.826967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:57.826967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:57.826967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:57.826967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:57.826967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:57.826967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:57.826967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:57.826967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:57.826967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:57.827837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:56:57.827837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:56:57.827837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:56:57.827837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:56:57.827837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:56:57.827837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:56:57.827837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:56:57.827837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:57.827837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 278/541] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:56:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:57.832866 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44558a24-5b20-4c1f-b6fe-80d722583ce8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:57.844858 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b453b6-6a5a-409d-8a16-9f358ecc0704 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:57.882471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80f2d7-5a4e-4582-823c-87758f094de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:57.883720 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80f2d7-5a4e-4582-823c-87758f094de5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:57.884179 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80f2d7-5a4e-4582-823c-87758f094de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:57.884702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80f2d7-5a4e-4582-823c-87758f094de5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:57.896313 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80f2d7-5a4e-4582-823c-87758f094de5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:57.905302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8b80f2d7-5a4e-4582-823c-87758f094de5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:56:57.905302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:57.905302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:57.905302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:57.905302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:57.905302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:57.905302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:57.905302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:57.905302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:57.905302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:57.905302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:57.905302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:57.905302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:57.905302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:57.905302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:57.905302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:57.906205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:57.906205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:57.906205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:57.906205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:57.906205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:57.906205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:57.906205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:57.906205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:57.906205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:57.906205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:57.906205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:57.906205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:57.906205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:57.906205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:57.906205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:57.906205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:57.906990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:57.906990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:57.906990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:57.906990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:57.906990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:57.906990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:57.906990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:57.906990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:57.906990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:57.906990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:57.906990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:56:57.906990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:57.909848 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 264/542] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:56:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:57.916285 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80f2d7-5a4e-4582-823c-87758f094de5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:57.944316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44558a24-5b20-4c1f-b6fe-80d722583ce8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:57.956271 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:57.982854 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cce7a-8dd7-4121-90bb-419913393e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:57.983620 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cce7a-8dd7-4121-90bb-419913393e56 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:57.983971 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cce7a-8dd7-4121-90bb-419913393e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:57.984317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cce7a-8dd7-4121-90bb-419913393e56 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:57.985328 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cce7a-8dd7-4121-90bb-419913393e56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:57.985727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cce7a-8dd7-4121-90bb-419913393e56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:57.987392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cce7a-8dd7-4121-90bb-419913393e56 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:58.001383 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 279/543] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:56:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:56:58.010324 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cce7a-8dd7-4121-90bb-419913393e56 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:58.016737 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:58.061741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80f2d7-5a4e-4582-823c-87758f094de5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:58.136085 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4e17a-7731-4cd7-9235-ecd14dfacc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:58.138622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4e17a-7731-4cd7-9235-ecd14dfacc51 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:58.139123 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4e17a-7731-4cd7-9235-ecd14dfacc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:58.141049 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4e17a-7731-4cd7-9235-ecd14dfacc51 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:58.142046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4e17a-7731-4cd7-9235-ecd14dfacc51 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:58.149832 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4e17a-7731-4cd7-9235-ecd14dfacc51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:58.151267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4e17a-7731-4cd7-9235-ecd14dfacc51 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:58.160234 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 265/544] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:56:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:58.166139 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4e17a-7731-4cd7-9235-ecd14dfacc51 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:58.207152 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cce7a-8dd7-4121-90bb-419913393e56 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:58.283071 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae10b7-4bd4-4671-b8e0-39978cb3de0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:58.283724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae10b7-4bd4-4671-b8e0-39978cb3de0b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:58.284005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae10b7-4bd4-4671-b8e0-39978cb3de0b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:58.284278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae10b7-4bd4-4671-b8e0-39978cb3de0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:58.285105 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae10b7-4bd4-4671-b8e0-39978cb3de0b None admin] RBAC: Adding query filter params (role.id=e053e0425eb744e2a3e3316222e208f3, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=cb2d4050a05f4517ab165c74f9e6cae6) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:58.285434 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae10b7-4bd4-4671-b8e0-39978cb3de0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:58.286858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae10b7-4bd4-4671-b8e0-39978cb3de0b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:58.292470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4e17a-7731-4cd7-9235-ecd14dfacc51 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:58.302614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 280/545] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:56:58 2022] GET /identity/v3/role_assignments?user.id=cb2d4050a05f4517ab165c74f9e6cae6&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=e053e0425eb744e2a3e3316222e208f3 => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:58.331893 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbfb57-8e0a-4cdb-8476-11e42a3e16b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:58.332708 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbfb57-8e0a-4cdb-8476-11e42a3e16b4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:58.332994 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbfb57-8e0a-4cdb-8476-11e42a3e16b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:58.333563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbfb57-8e0a-4cdb-8476-11e42a3e16b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:58.350232 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbfb57-8e0a-4cdb-8476-11e42a3e16b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:58.351751 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbfb57-8e0a-4cdb-8476-11e42a3e16b4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:58.360889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:58.372606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e1cbfb57-8e0a-4cdb-8476-11e42a3e16b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:58.372606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:58.372606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:58.372606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:58.372606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:58.372606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:58.372606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:58.372606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:58.372606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:58.372606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:58.372606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:58.372606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:58.372606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:56:58.372606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:56:58.372606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:56:58.373520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:56:58.373520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:58.373520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:58.373520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:58.373520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:58.373520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:58.373520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:58.373520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:58.373520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:58.373520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:58.373520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:58.373520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:58.373520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:58.373520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:58.373520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:58.373520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:58.373520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:58.374353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:56:58.374353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:56:58.374353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:58.374353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:58.377716 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 266/546] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:58.382250 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae10b7-4bd4-4671-b8e0-39978cb3de0b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:58.441886 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:58.513654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae10b7-4bd4-4671-b8e0-39978cb3de0b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:58.550396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e70d2f-2c3b-4209-a1e7-41cd13be4b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:58.551059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e70d2f-2c3b-4209-a1e7-41cd13be4b15 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:58.551341 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e70d2f-2c3b-4209-a1e7-41cd13be4b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:58.551610 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e70d2f-2c3b-4209-a1e7-41cd13be4b15 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:58.552328 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e70d2f-2c3b-4209-a1e7-41cd13be4b15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:58.552627 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e70d2f-2c3b-4209-a1e7-41cd13be4b15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:58.554018 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e70d2f-2c3b-4209-a1e7-41cd13be4b15 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:58.567642 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb8d42-46c2-4cc9-95d7-4a56cbd248d5 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:58.567958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb8d42-46c2-4cc9-95d7-4a56cbd248d5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:58.568206 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb8d42-46c2-4cc9-95d7-4a56cbd248d5 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:58.569908 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 267/547] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:56:58.570766 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 281/548] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:58.580077 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e70d2f-2c3b-4209-a1e7-41cd13be4b15 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:58.580532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ae13c-fde4-4495-af97-c407f2e1ce32 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:58.580726 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ae13c-fde4-4495-af97-c407f2e1ce32 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:58.581000 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ae13c-fde4-4495-af97-c407f2e1ce32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:58.611732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e30ae13c-fde4-4495-af97-c407f2e1ce32 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:58.612915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e30ae13c-fde4-4495-af97-c407f2e1ce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:56:58.688268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:58.693033 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 268/549] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:56:58.698350 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e70d2f-2c3b-4209-a1e7-41cd13be4b15 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:58.730518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ae13c-fde4-4495-af97-c407f2e1ce32 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:58.743539 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb89163-c7e0-4abc-942e-b846e24fcca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:58.744343 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb89163-c7e0-4abc-942e-b846e24fcca4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:58.744618 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb89163-c7e0-4abc-942e-b846e24fcca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:58.744885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb89163-c7e0-4abc-942e-b846e24fcca4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:58.757016 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb89163-c7e0-4abc-942e-b846e24fcca4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:58.759094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb89163-c7e0-4abc-942e-b846e24fcca4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:58.796621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-1cb89163-c7e0-4abc-942e-b846e24fcca4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 10:56:58.796621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:58.796621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:58.796621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:58.796621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:58.796621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:58.796621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:58.796621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:58.796621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:58.796621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:58.796621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:58.796621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:58.796621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:56:58.796621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:56:58.796621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:56:58.796621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:58.798527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:58.799835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:58.799835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:58.799835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:56:58.799835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:56:58.799835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:56:58.799835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:56:58.799835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:56:58.799835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:56:58.799835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 10:56:58.799835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:58.799835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 282/550] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:56:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:58.803488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb89163-c7e0-4abc-942e-b846e24fcca4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:58.870883 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ae13c-fde4-4495-af97-c407f2e1ce32 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:58.903989 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:58.909018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00598cba-ec2d-4c4a-b1a4-74277227d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:58.910159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00598cba-ec2d-4c4a-b1a4-74277227d4ad None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:58.910451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00598cba-ec2d-4c4a-b1a4-74277227d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:58.910728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00598cba-ec2d-4c4a-b1a4-74277227d4ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:58.924008 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00598cba-ec2d-4c4a-b1a4-74277227d4ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:56:58.936339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-00598cba-ec2d-4c4a-b1a4-74277227d4ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:56:58.936339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:58.936339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:58.936339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:58.936339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:58.936339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:58.936339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:58.936339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:58.936339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:58.936339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:58.936339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:58.936339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:58.936339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:56:58.936339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:56:58.936339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:56:58.936339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:56:58.937540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:56:58.937540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:56:58.937540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:56:58.937540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:56:58.937540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:58.937540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:58.937540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:58.937540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:58.937540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:58.937540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:58.937540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:58.937540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:58.937540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:58.937540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:58.937540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:58.937540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:58.938552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:58.938552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:58.938552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:58.938552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:58.938552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:56:58.938552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:56:58.938552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:56:58.938552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:56:58.938552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:56:58.938552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:56:58.938552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:56:58.938552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:58.938552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 269/551] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:56:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:58.942179 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00598cba-ec2d-4c4a-b1a4-74277227d4ad None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:59.059263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00598cba-ec2d-4c4a-b1a4-74277227d4ad None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:59.069593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb89163-c7e0-4abc-942e-b846e24fcca4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:59.097583 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9872964-df3a-473d-a67d-f8112b475756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:59.098391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9872964-df3a-473d-a67d-f8112b475756 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:59.098739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9872964-df3a-473d-a67d-f8112b475756 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:59.099079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9872964-df3a-473d-a67d-f8112b475756 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:59.103309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9872964-df3a-473d-a67d-f8112b475756 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:59.103309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9872964-df3a-473d-a67d-f8112b475756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:59.103309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9872964-df3a-473d-a67d-f8112b475756 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:59.111738 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 270/552] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:56:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:59.117322 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9872964-df3a-473d-a67d-f8112b475756 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:59.135401 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26ceb6-ec74-4feb-93fa-bbfb2edb5917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:59.136631 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26ceb6-ec74-4feb-93fa-bbfb2edb5917 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:59.137056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26ceb6-ec74-4feb-93fa-bbfb2edb5917 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:59.137496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26ceb6-ec74-4feb-93fa-bbfb2edb5917 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:59.145386 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26ceb6-ec74-4feb-93fa-bbfb2edb5917 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:59.146044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26ceb6-ec74-4feb-93fa-bbfb2edb5917 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:59.147630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26ceb6-ec74-4feb-93fa-bbfb2edb5917 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:59.174884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:59.186646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 283/553] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Jun 27 10:56:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:59.194311 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26ceb6-ec74-4feb-93fa-bbfb2edb5917 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:59.228573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:59.231702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9872964-df3a-473d-a67d-f8112b475756 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:59.275579 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664e11c-d355-43ce-a08f-c297baf18eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:59.276850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664e11c-d355-43ce-a08f-c297baf18eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:59.278114 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664e11c-d355-43ce-a08f-c297baf18eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:59.280446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664e11c-d355-43ce-a08f-c297baf18eb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:59.301558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664e11c-d355-43ce-a08f-c297baf18eb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:59.303483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664e11c-d355-43ce-a08f-c297baf18eb7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:59.333132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c664e11c-d355-43ce-a08f-c297baf18eb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:59.333132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:59.333132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:59.333132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:59.333132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:59.333132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:59.333132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:59.333132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:59.333132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:59.333132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:59.333132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:59.333132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:59.333132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:56:59.333132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:56:59.333132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:56:59.334458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:56:59.334458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:59.334458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:59.334458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:59.334458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:59.334458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:59.334458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:59.334458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:59.334458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:59.334458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:59.334458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:59.334458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:59.334458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:59.334458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:59.334458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:59.334458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:59.334458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:59.335334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:56:59.335334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:56:59.335334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:59.335334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:59.338190 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 271/554] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:56:59.346244 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664e11c-d355-43ce-a08f-c297baf18eb7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:59.416931 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26ceb6-ec74-4feb-93fa-bbfb2edb5917 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:59.487384 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1de0a-4e7d-4b86-883e-8ff08e11be57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:59.488161 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1de0a-4e7d-4b86-883e-8ff08e11be57 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:59.488327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1de0a-4e7d-4b86-883e-8ff08e11be57 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:59.488570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1de0a-4e7d-4b86-883e-8ff08e11be57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:59.512450 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664e11c-d355-43ce-a08f-c297baf18eb7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:59.523260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:59.575268 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ea854-345b-469b-bcb2-0a6bad182ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:59.575939 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ea854-345b-469b-bcb2-0a6bad182ecc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:59.576226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ea854-345b-469b-bcb2-0a6bad182ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:59.576503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ea854-345b-469b-bcb2-0a6bad182ecc None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:59.577237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ea854-345b-469b-bcb2-0a6bad182ecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:56:59.577560 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ea854-345b-469b-bcb2-0a6bad182ecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:59.578944 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ea854-345b-469b-bcb2-0a6bad182ecc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:59.604416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1de0a-4e7d-4b86-883e-8ff08e11be57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:59.605875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1de0a-4e7d-4b86-883e-8ff08e11be57 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:59.606900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 272/555] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:56:59.612349 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ea854-345b-469b-bcb2-0a6bad182ecc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:59.620727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:59.714464 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 284/556] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:56:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:56:59.722588 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1de0a-4e7d-4b86-883e-8ff08e11be57 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:59.830147 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ea854-345b-469b-bcb2-0a6bad182ecc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:59.852253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1de0a-4e7d-4b86-883e-8ff08e11be57 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:56:59.866465 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:59.885537 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356b903-b7db-4c02-ba77-686c4a7cf2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:59.886585 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356b903-b7db-4c02-ba77-686c4a7cf2be None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:59.887087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356b903-b7db-4c02-ba77-686c4a7cf2be None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:59.887221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356b903-b7db-4c02-ba77-686c4a7cf2be None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:59.892542 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd48d4-8776-41fa-a74b-85ee7fb18f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:56:59.893574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd48d4-8776-41fa-a74b-85ee7fb18f10 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:59.894054 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd48d4-8776-41fa-a74b-85ee7fb18f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:59.894522 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd48d4-8776-41fa-a74b-85ee7fb18f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:59.894712 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356b903-b7db-4c02-ba77-686c4a7cf2be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:59.896343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356b903-b7db-4c02-ba77-686c4a7cf2be None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:59.906595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd48d4-8776-41fa-a74b-85ee7fb18f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:56:59.908276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd48d4-8776-41fa-a74b-85ee7fb18f10 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:56:59.911446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8356b903-b7db-4c02-ba77-686c4a7cf2be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:56:59.911446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:59.911446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:59.911446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:59.911446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:59.911446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:59.911446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:59.911446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:59.911446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:59.911446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:59.911446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:59.911446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:59.911446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:56:59.911446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:56:59.911446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:56:59.911446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:59.912821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:59.914334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:59.914334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:59.914334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:56:59.914334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:56:59.914334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:56:59.914334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:56:59.914334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:56:59.914334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:56:59.914334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:56:59.914334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:56:59.914334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 273/557] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jun 27 10:56:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:59.914334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73b1da-c2dd-420d-93c3-c8cf7b39e947 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:59.915036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73b1da-c2dd-420d-93c3-c8cf7b39e947 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:59.915036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73b1da-c2dd-420d-93c3-c8cf7b39e947 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:59.920229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 274/558] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:56:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:56:59.921203 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73b1da-c2dd-420d-93c3-c8cf7b39e947 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:56:59.932556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-18bd48d4-8776-41fa-a74b-85ee7fb18f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:59.932556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:56:59.932556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:56:59.932556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:56:59.932556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:56:59.932556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:56:59.932556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:56:59.932556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:56:59.932556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:56:59.932556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:56:59.932556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:56:59.932556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:56:59.932556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:56:59.932556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:56:59.932556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:56:59.933473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:56:59.933473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:56:59.933473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:56:59.933473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:56:59.933473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:56:59.933473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:56:59.933473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:56:59.933473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:56:59.933473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:56:59.933473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:56:59.933473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:56:59.933473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:56:59.933473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:56:59.933473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:56:59.933473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:56:59.933473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:56:59.933473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:56:59.934460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:56:59.934460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:56:59.934460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:56:59.934460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:56:59.937046 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 285/559] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:56:59.938538 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47ece5-5425-4f75-a161-6d09680941a1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:56:59.939143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47ece5-5425-4f75-a161-6d09680941a1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:56:59.939718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47ece5-5425-4f75-a161-6d09680941a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:56:59.946388 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:56:59.960174 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5b47ece5-5425-4f75-a161-6d09680941a1 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:56:59.962342 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5b47ece5-5425-4f75-a161-6d09680941a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:00.026009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73b1da-c2dd-420d-93c3-c8cf7b39e947 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:00.035880 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 286/560] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:57:00.037066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47ece5-5425-4f75-a161-6d09680941a1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:00.083913 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cd8c9-eafd-4562-92da-9058c3e8696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:00.084487 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cd8c9-eafd-4562-92da-9058c3e8696f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:00.084769 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cd8c9-eafd-4562-92da-9058c3e8696f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:00.085042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cd8c9-eafd-4562-92da-9058c3e8696f None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:00.085936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cd8c9-eafd-4562-92da-9058c3e8696f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:00.086240 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cd8c9-eafd-4562-92da-9058c3e8696f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:00.087701 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cd8c9-eafd-4562-92da-9058c3e8696f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:00.106547 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 275/561] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jun 27 10:56:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:00.107416 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cd8c9-eafd-4562-92da-9058c3e8696f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:00.139934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:00.147622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47ece5-5425-4f75-a161-6d09680941a1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:00.187622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25458c-c95d-48c4-a607-7a97c573ed6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:00.188299 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25458c-c95d-48c4-a607-7a97c573ed6c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:00.188580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25458c-c95d-48c4-a607-7a97c573ed6c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:00.188855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25458c-c95d-48c4-a607-7a97c573ed6c None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:00.190039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25458c-c95d-48c4-a607-7a97c573ed6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:00.190686 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25458c-c95d-48c4-a607-7a97c573ed6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:00.192382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25458c-c95d-48c4-a607-7a97c573ed6c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:00.193074 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:00.210957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 287/562] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:00.211890 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25458c-c95d-48c4-a607-7a97c573ed6c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:00.218146 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cd8c9-eafd-4562-92da-9058c3e8696f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:00.253982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6816af-6148-4994-9220-a7d21bed176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:00.254785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6816af-6148-4994-9220-a7d21bed176f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:00.255103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6816af-6148-4994-9220-a7d21bed176f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:00.255406 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6816af-6148-4994-9220-a7d21bed176f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:00.269008 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6816af-6148-4994-9220-a7d21bed176f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:00.276709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ae6816af-6148-4994-9220-a7d21bed176f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:00.276709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:00.276709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:00.276709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:00.276709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:00.276709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:00.276709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:00.276709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:00.276709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:00.276709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:00.276709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:00.276709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:00.276709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:00.276709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:00.276709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:00.276709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:00.277675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:00.277675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:00.277675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:00.277675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:00.277675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:00.277675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:00.277675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:00.277675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:00.277675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:00.277675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:00.277675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:00.277675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:00.277675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:00.277675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:00.277675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:00.277675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:00.278840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:00.278840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:00.278840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:00.278840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:00.278840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:00.278840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:00.278840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:00.278840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:00.278840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:00.278840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:00.278840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:00.278840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:00.278840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 276/563] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:57:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:00.279990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8eeb8b-61f3-49b6-b040-90eba6310656 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:00.279990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8eeb8b-61f3-49b6-b040-90eba6310656 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:00.279990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8eeb8b-61f3-49b6-b040-90eba6310656 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:00.285215 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 277/564] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:00.286079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8eeb8b-61f3-49b6-b040-90eba6310656 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:00.324634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25458c-c95d-48c4-a607-7a97c573ed6c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:00.358218 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a86ef-10e0-4468-ac3d-863816d5271b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:00.359278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a86ef-10e0-4468-ac3d-863816d5271b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:00.359606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a86ef-10e0-4468-ac3d-863816d5271b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:00.359889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a86ef-10e0-4468-ac3d-863816d5271b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:00.371679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a86ef-10e0-4468-ac3d-863816d5271b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:00.373136 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a86ef-10e0-4468-ac3d-863816d5271b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:00.391438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f23a86ef-10e0-4468-ac3d-863816d5271b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:00.391438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:00.391438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:00.391438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:00.391438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:00.391438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:00.391438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:00.391438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:00.391438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:00.391438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:00.391438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:00.391438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:00.391438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:00.391438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:00.391438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:00.392326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:00.392326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:00.392326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:00.392326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:00.392326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:00.392326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:00.392326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:00.392326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:00.392326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:00.392326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:00.392326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:00.392326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:00.392326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:00.392326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:00.392326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:00.392326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:00.392326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:00.393197 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:00.393197 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:00.393197 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:00.393197 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:00.393197 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 288/565] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:00.393509 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a86ef-10e0-4468-ac3d-863816d5271b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:00.400524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8eeb8b-61f3-49b6-b040-90eba6310656 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:00.404180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:00.435979 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9803a-4604-4ff8-a918-d568317702d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:00.437085 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9803a-4604-4ff8-a918-d568317702d0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:00.437412 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9803a-4604-4ff8-a918-d568317702d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:00.437716 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9803a-4604-4ff8-a918-d568317702d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:00.444317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9803a-4604-4ff8-a918-d568317702d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:00.445843 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9803a-4604-4ff8-a918-d568317702d0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:00.448531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:00.461923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-27e9803a-4604-4ff8-a918-d568317702d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:00.461923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:00.461923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:00.461923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:00.461923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:00.461923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:00.461923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:00.461923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:00.461923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:00.461923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:00.461923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:00.461923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:00.461923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:00.461923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:00.461923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:00.462847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:00.462847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:00.462847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:00.462847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:00.462847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:00.462847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:00.462847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:00.462847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:00.462847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:00.462847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:00.462847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:00.462847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:00.462847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:00.462847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:00.462847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:00.462847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:00.462847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:00.463764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:00.463764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:00.463764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:00.463764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:00.463764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:00.463764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:00.463764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:00.463764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:00.463764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 278/566] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:00.464840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4e47f-dcb4-4f1a-b4a2-ed24167e381e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:00.464840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4e47f-dcb4-4f1a-b4a2-ed24167e381e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:00.465007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4e47f-dcb4-4f1a-b4a2-ed24167e381e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:00.482008 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-aad4e47f-dcb4-4f1a-b4a2-ed24167e381e None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:00.483194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-aad4e47f-dcb4-4f1a-b4a2-ed24167e381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:00.510044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a86ef-10e0-4468-ac3d-863816d5271b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:00.545968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86055e62-8b9f-469e-ba50-b61061840ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:00.546636 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86055e62-8b9f-469e-ba50-b61061840ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:00.546921 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86055e62-8b9f-469e-ba50-b61061840ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:00.547198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86055e62-8b9f-469e-ba50-b61061840ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:00.547939 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86055e62-8b9f-469e-ba50-b61061840ff9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:00.548307 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86055e62-8b9f-469e-ba50-b61061840ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:00.549632 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86055e62-8b9f-469e-ba50-b61061840ff9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:00.553424 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 279/567] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:57:00.553424 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4e47f-dcb4-4f1a-b4a2-ed24167e381e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:00.569500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 289/568] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:57:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:00.570624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86055e62-8b9f-469e-ba50-b61061840ff9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:00.641900 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:00.662157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4e47f-dcb4-4f1a-b4a2-ed24167e381e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:00.674820 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86055e62-8b9f-469e-ba50-b61061840ff9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:00.691287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:00.697453 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d1b95-b134-45ba-a4c7-5e8696148455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:00.698127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d1b95-b134-45ba-a4c7-5e8696148455 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:00.698448 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d1b95-b134-45ba-a4c7-5e8696148455 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:00.698760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d1b95-b134-45ba-a4c7-5e8696148455 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:00.699519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d1b95-b134-45ba-a4c7-5e8696148455 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:00.699849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d1b95-b134-45ba-a4c7-5e8696148455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:00.701214 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d1b95-b134-45ba-a4c7-5e8696148455 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:00.708010 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d334c0b-63cb-44c8-a1a5-0470c2d16f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:00.708687 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d334c0b-63cb-44c8-a1a5-0470c2d16f00 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:00.708969 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d334c0b-63cb-44c8-a1a5-0470c2d16f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:00.709250 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d334c0b-63cb-44c8-a1a5-0470c2d16f00 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:00.710058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d334c0b-63cb-44c8-a1a5-0470c2d16f00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:00.710368 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d334c0b-63cb-44c8-a1a5-0470c2d16f00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:00.711856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d334c0b-63cb-44c8-a1a5-0470c2d16f00 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:00.712342 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 280/569] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:00.713153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d1b95-b134-45ba-a4c7-5e8696148455 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:00.728069 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 290/570] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:00.728966 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d334c0b-63cb-44c8-a1a5-0470c2d16f00 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:00.823887 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d334c0b-63cb-44c8-a1a5-0470c2d16f00 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:00.827861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d1b95-b134-45ba-a4c7-5e8696148455 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:00.849234 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:00.857459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f299344-71bd-4b64-8a7a-64bcccb2b7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:00.858238 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f299344-71bd-4b64-8a7a-64bcccb2b7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:00.858513 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f299344-71bd-4b64-8a7a-64bcccb2b7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:00.858781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f299344-71bd-4b64-8a7a-64bcccb2b7e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:00.861912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abfead-f049-4eb9-8bc0-57f6915e744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:00.862704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abfead-f049-4eb9-8bc0-57f6915e744f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:00.863022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abfead-f049-4eb9-8bc0-57f6915e744f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:00.863329 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abfead-f049-4eb9-8bc0-57f6915e744f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:00.868601 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f299344-71bd-4b64-8a7a-64bcccb2b7e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:00.874491 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abfead-f049-4eb9-8bc0-57f6915e744f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:00.875953 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abfead-f049-4eb9-8bc0-57f6915e744f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:00.876199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9f299344-71bd-4b64-8a7a-64bcccb2b7e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:00.876199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:00.876199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:00.876199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:00.876199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:00.876199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:00.876199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:00.876199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:00.876199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:00.876199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:00.876199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:00.876199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:00.876199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:00.876199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:00.876199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:00.876199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:00.877244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:00.877244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:00.877244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:00.877244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:00.877244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:00.877244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:00.877244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:00.877244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:00.877244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:00.877244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:00.877244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:00.877244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:00.877244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:00.877244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:00.877244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:00.877244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:00.878292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:00.878292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:00.878292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:00.878292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:00.878292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:00.878292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:00.878292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:00.878292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:00.878292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:00.878292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:00.878292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:00.878292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:00.878292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 291/571] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:57:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:00.879181 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5bd4e-9dc6-42da-82ab-2635ec58a4cc None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:00.879181 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5bd4e-9dc6-42da-82ab-2635ec58a4cc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:00.879181 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5bd4e-9dc6-42da-82ab-2635ec58a4cc None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:00.880551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 292/572] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:00.881167 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5bd4e-9dc6-42da-82ab-2635ec58a4cc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:00.896912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c7abfead-f049-4eb9-8bc0-57f6915e744f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:00.896912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:00.896912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:00.896912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:00.896912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:00.896912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:00.896912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:00.896912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:00.896912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:00.896912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:00.896912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:00.896912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:00.896912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:00.896912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:00.896912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:00.897972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:00.897972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:00.897972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:00.897972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:00.897972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:00.897972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:00.897972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:00.897972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:00.897972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:00.897972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:00.897972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:00.897972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:00.897972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:00.897972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:00.897972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:00.897972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:00.897972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:00.899400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:00.899400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:00.899400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:00.899400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:00.899400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 281/573] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:00.899400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abfead-f049-4eb9-8bc0-57f6915e744f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:00.942196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:00.984518 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5bd4e-9dc6-42da-82ab-2635ec58a4cc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:00.998368 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abfead-f049-4eb9-8bc0-57f6915e744f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:01.016737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca213c1-da6c-4e19-b4bb-09cf0cd94fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:01.017554 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca213c1-da6c-4e19-b4bb-09cf0cd94fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:01.017929 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca213c1-da6c-4e19-b4bb-09cf0cd94fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:01.018205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca213c1-da6c-4e19-b4bb-09cf0cd94fe8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:01.025461 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca213c1-da6c-4e19-b4bb-09cf0cd94fe8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:01.026902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca213c1-da6c-4e19-b4bb-09cf0cd94fe8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:01.031961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ba4f8-a29e-4c9d-b797-dba2cc6e212a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:01.032624 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ba4f8-a29e-4c9d-b797-dba2cc6e212a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:01.032941 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ba4f8-a29e-4c9d-b797-dba2cc6e212a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:01.033246 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ba4f8-a29e-4c9d-b797-dba2cc6e212a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:01.034133 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ba4f8-a29e-4c9d-b797-dba2cc6e212a None admin] RBAC: Adding query filter params (role.id=e053e0425eb744e2a3e3316222e208f3, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=189af68908944b5e9a7cb35fde0e1bd3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:01.034457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ba4f8-a29e-4c9d-b797-dba2cc6e212a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:01.035887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ba4f8-a29e-4c9d-b797-dba2cc6e212a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:01.041549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9ca213c1-da6c-4e19-b4bb-09cf0cd94fe8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:01.041549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:01.041549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:01.041549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:01.041549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:01.041549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:01.041549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:01.041549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:01.041549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:01.041549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:01.041549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:01.041549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:01.041549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:01.041549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:01.041549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:01.042425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:01.042425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:01.042425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:01.042425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:01.042425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:01.042425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:01.042425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:01.042425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:01.042425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:01.042425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:01.042425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:01.042425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:01.042425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:01.042425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:01.042425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:01.042425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:01.042425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:01.043320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:01.043320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:01.043320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:01.043320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:01.043320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:01.043320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:01.043320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:01.043320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:01.043748 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 282/574] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:57:00 2022] GET /identity/v3/role_assignments?user.id=189af68908944b5e9a7cb35fde0e1bd3&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=e053e0425eb744e2a3e3316222e208f3 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:01.043831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 293/575] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:01.043901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ba4f8-a29e-4c9d-b797-dba2cc6e212a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:01.044578 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3231d02-6845-4408-ae59-aef8018a8c7e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:01.044578 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3231d02-6845-4408-ae59-aef8018a8c7e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:01.044882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3231d02-6845-4408-ae59-aef8018a8c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:01.061819 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b3231d02-6845-4408-ae59-aef8018a8c7e None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:01.063047 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b3231d02-6845-4408-ae59-aef8018a8c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:01.116021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:01.142627 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 294/576] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:57:01.150744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3231d02-6845-4408-ae59-aef8018a8c7e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:01.163039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ba4f8-a29e-4c9d-b797-dba2cc6e212a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:01.172208 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:01.210833 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4316283-a310-4a16-95f8-b26a9b76e910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:01.212087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4316283-a310-4a16-95f8-b26a9b76e910 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:01.212409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4316283-a310-4a16-95f8-b26a9b76e910 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:01.212777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4316283-a310-4a16-95f8-b26a9b76e910 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:01.213589 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4316283-a310-4a16-95f8-b26a9b76e910 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:01.213921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4316283-a310-4a16-95f8-b26a9b76e910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:01.215281 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4316283-a310-4a16-95f8-b26a9b76e910 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:01.223689 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 283/577] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:57:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:01.228841 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4316283-a310-4a16-95f8-b26a9b76e910 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:01.265966 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3231d02-6845-4408-ae59-aef8018a8c7e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:01.304732 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7e5d1-6419-4753-943d-5e98169162d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:01.305453 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7e5d1-6419-4753-943d-5e98169162d4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:01.305739 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7e5d1-6419-4753-943d-5e98169162d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:01.306017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7e5d1-6419-4753-943d-5e98169162d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:01.306736 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7e5d1-6419-4753-943d-5e98169162d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:01.307568 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7e5d1-6419-4753-943d-5e98169162d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:01.309030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7e5d1-6419-4753-943d-5e98169162d4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:01.321544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 295/578] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:01.322478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7e5d1-6419-4753-943d-5e98169162d4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:01.339778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4316283-a310-4a16-95f8-b26a9b76e910 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:01.364179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:01.376533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6993259-b6d3-4f50-aac3-cca1d3b906dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:01.377208 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6993259-b6d3-4f50-aac3-cca1d3b906dc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:01.377566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6993259-b6d3-4f50-aac3-cca1d3b906dc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:01.377881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6993259-b6d3-4f50-aac3-cca1d3b906dc None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:01.378698 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6993259-b6d3-4f50-aac3-cca1d3b906dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:01.379039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6993259-b6d3-4f50-aac3-cca1d3b906dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:01.380505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6993259-b6d3-4f50-aac3-cca1d3b906dc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:01.397958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 284/579] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:01.397958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6993259-b6d3-4f50-aac3-cca1d3b906dc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:01.422197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:01.439186 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7e5d1-6419-4753-943d-5e98169162d4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:01.473865 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96afd3-a837-489f-86ab-3a3e2cf106bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:01.474659 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96afd3-a837-489f-86ab-3a3e2cf106bf None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:01.474942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96afd3-a837-489f-86ab-3a3e2cf106bf None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:01.475219 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96afd3-a837-489f-86ab-3a3e2cf106bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:01.485688 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96afd3-a837-489f-86ab-3a3e2cf106bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:01.493711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-3e96afd3-a837-489f-86ab-3a3e2cf106bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:01.493711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:01.493711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:01.493711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:01.493711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:01.493711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:01.493711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:01.493711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:01.493711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:01.493711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:01.493711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:01.493711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:01.493711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:01.493711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:01.493711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:01.493711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:01.494652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:01.494652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:01.494652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:01.494652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:01.494652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:01.494652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:01.494652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:01.494652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:01.494652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:01.494652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:01.494652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:01.494652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:01.494652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:01.494652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:01.494652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:01.494652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:01.495468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:01.495468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:01.495468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:01.495468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:01.495468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:01.495468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:01.495468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:01.495468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:01.495468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:01.495468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:01.495468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:01.495468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:01.495468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 296/580] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:57:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:01.496159 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96afd3-a837-489f-86ab-3a3e2cf106bf None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:01.505040 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6993259-b6d3-4f50-aac3-cca1d3b906dc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:01.542518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa42d5-a40b-4450-8a94-81cf9242ab0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:01.543305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa42d5-a40b-4450-8a94-81cf9242ab0d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:01.543588 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa42d5-a40b-4450-8a94-81cf9242ab0d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:01.543861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa42d5-a40b-4450-8a94-81cf9242ab0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:01.554419 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa42d5-a40b-4450-8a94-81cf9242ab0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:01.556464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa42d5-a40b-4450-8a94-81cf9242ab0d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:01.575396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-30aa42d5-a40b-4450-8a94-81cf9242ab0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:01.575396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:01.575396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:01.575396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:01.575396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:01.575396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:01.575396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:01.575396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:01.575396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:01.575396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:01.575396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:01.575396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:01.575396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:01.575396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:01.575396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:01.576293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:01.576293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:01.576293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:01.576293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:01.576293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:01.576293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:01.576293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:01.576293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:01.576293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:01.576293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:01.576293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:01.576293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:01.576293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:01.576293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:01.576293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:01.576293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:01.576293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:01.577265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:01.577265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:01.577265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:01.577265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:01.577265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 285/581] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:01.578147 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa42d5-a40b-4450-8a94-81cf9242ab0d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:01.623470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:01.628943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96afd3-a837-489f-86ab-3a3e2cf106bf None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:01.667764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:01.671121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13fce1-903b-4871-a257-e7c16b004e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:01.672494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13fce1-903b-4871-a257-e7c16b004e08 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:01.672903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13fce1-903b-4871-a257-e7c16b004e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:01.673179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13fce1-903b-4871-a257-e7c16b004e08 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:01.681911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13fce1-903b-4871-a257-e7c16b004e08 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:01.683336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13fce1-903b-4871-a257-e7c16b004e08 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:01.687525 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa42d5-a40b-4450-8a94-81cf9242ab0d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:01.698679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-bd13fce1-903b-4871-a257-e7c16b004e08 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 10:57:01.698679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:01.698679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:01.698679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:01.698679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:01.698679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:01.698679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:01.698679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:01.698679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:01.698679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:01.698679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:01.698679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:01.698679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:01.698679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:01.698679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:01.698679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:01.699625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:01.700565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:01.700565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:01.700565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:01.700565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:01.700565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:01.700565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:01.700565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:01.700565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:01.700565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 10:57:01.700565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:01.700565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 297/582] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:57:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:01.701144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13fce1-903b-4871-a257-e7c16b004e08 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:01.728663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e69cb-6248-4270-a1d3-73c17d3a1ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:01.729581 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e69cb-6248-4270-a1d3-73c17d3a1ce1 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:01.729862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e69cb-6248-4270-a1d3-73c17d3a1ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:01.730136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e69cb-6248-4270-a1d3-73c17d3a1ce1 None admin] PATH_INFO: `/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/ed08c367a3d34207a51914ff77a93898/roles/e053e0425eb744e2a3e3316222e208f3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:01.748341 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e69cb-6248-4270-a1d3-73c17d3a1ce1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6543a66af8ba48c391ce686f6d82276b, user_id=ed08c367a3d34207a51914ff77a93898, role_id=e053e0425eb744e2a3e3316222e208f3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:01.749868 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e69cb-6248-4270-a1d3-73c17d3a1ce1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:01.762256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 286/583] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:57:01 2022] PUT /identity/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/ed08c367a3d34207a51914ff77a93898/roles/e053e0425eb744e2a3e3316222e208f3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:57:01.763045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e69cb-6248-4270-a1d3-73c17d3a1ce1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:01.860673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13fce1-903b-4871-a257-e7c16b004e08 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:01.891790 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e69cb-6248-4270-a1d3-73c17d3a1ce1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:01.900144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f58d1b-96c7-429a-b92d-802bed2ce98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:01.900971 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f58d1b-96c7-429a-b92d-802bed2ce98e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:01.901346 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f58d1b-96c7-429a-b92d-802bed2ce98e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:01.901745 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f58d1b-96c7-429a-b92d-802bed2ce98e None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:01.902621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f58d1b-96c7-429a-b92d-802bed2ce98e None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:01.903021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f58d1b-96c7-429a-b92d-802bed2ce98e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:01.904505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f58d1b-96c7-429a-b92d-802bed2ce98e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:01.915475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 298/584] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:57:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:01.916458 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f58d1b-96c7-429a-b92d-802bed2ce98e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:01.934791 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:01.941940 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018e59b-f352-4755-8cf5-55bedebd8385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:01.942514 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:01.942629 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018e59b-f352-4755-8cf5-55bedebd8385 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:01.942881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018e59b-f352-4755-8cf5-55bedebd8385 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:01.943155 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018e59b-f352-4755-8cf5-55bedebd8385 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:01.943888 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018e59b-f352-4755-8cf5-55bedebd8385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:01.944199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018e59b-f352-4755-8cf5-55bedebd8385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:01.946190 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018e59b-f352-4755-8cf5-55bedebd8385 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:01.960950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 287/585] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:01.966505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018e59b-f352-4755-8cf5-55bedebd8385 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:02.038398 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f58d1b-96c7-429a-b92d-802bed2ce98e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:02.083980 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b62c4-a6ea-42a3-8a3a-cfc39c008f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:02.084647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b62c4-a6ea-42a3-8a3a-cfc39c008f17 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:02.084882 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018e59b-f352-4755-8cf5-55bedebd8385 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:02.084988 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b62c4-a6ea-42a3-8a3a-cfc39c008f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:02.085181 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b62c4-a6ea-42a3-8a3a-cfc39c008f17 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:02.086045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b62c4-a6ea-42a3-8a3a-cfc39c008f17 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:02.087192 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b62c4-a6ea-42a3-8a3a-cfc39c008f17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:02.089514 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b62c4-a6ea-42a3-8a3a-cfc39c008f17 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:02.113144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 299/586] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jun 27 10:57:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:02.114498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b62c4-a6ea-42a3-8a3a-cfc39c008f17 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:02.123841 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf9719-14c5-473e-b60b-4ed1df98bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:02.123841 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf9719-14c5-473e-b60b-4ed1df98bc58 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:02.123841 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf9719-14c5-473e-b60b-4ed1df98bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:02.125882 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf9719-14c5-473e-b60b-4ed1df98bc58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:02.138613 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf9719-14c5-473e-b60b-4ed1df98bc58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:02.140778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf9719-14c5-473e-b60b-4ed1df98bc58 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:02.164558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-1ecf9719-14c5-473e-b60b-4ed1df98bc58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:02.164558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:02.164558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:02.164558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:02.164558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:02.164558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:02.164558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:02.164558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:02.164558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:02.164558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:02.164558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:02.164558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:02.164558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:02.164558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:02.164558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:02.165775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:02.165775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:02.165775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:02.165775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:02.165775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:02.165775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:02.165775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:02.165775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:02.165775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:02.165775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:02.165775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:02.165775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:02.165775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:02.165775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:02.165775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:02.165775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:02.165775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:02.166886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:02.166886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:02.166886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:02.166886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:02.166886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 288/587] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:02.167263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf9719-14c5-473e-b60b-4ed1df98bc58 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:02.212456 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:02.231537 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:02.236861 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b62c4-a6ea-42a3-8a3a-cfc39c008f17 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:02.278018 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a463f-0279-4ca9-9784-c0fcb4b0b11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:02.278992 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a463f-0279-4ca9-9784-c0fcb4b0b11e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:02.279724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a463f-0279-4ca9-9784-c0fcb4b0b11e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:02.279724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a463f-0279-4ca9-9784-c0fcb4b0b11e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:02.287320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a463f-0279-4ca9-9784-c0fcb4b0b11e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:02.288857 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a463f-0279-4ca9-9784-c0fcb4b0b11e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:02.307702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf9719-14c5-473e-b60b-4ed1df98bc58 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:02.307867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-af6a463f-0279-4ca9-9784-c0fcb4b0b11e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 27 10:57:02.307867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:02.307867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:02.307867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:02.307867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:02.307867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:02.307867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:02.307867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:02.307867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:02.307867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:02.307867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:02.307867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:02.307867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:02.307867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:02.307867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:02.307867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:02.308963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:02.310170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:02.310170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:02.310170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:02.310170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:02.310170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:02.310170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:02.310170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:02.310170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:02.310170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 27 10:57:02.310170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:02.316211 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 300/588] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:57:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:02.316211 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a463f-0279-4ca9-9784-c0fcb4b0b11e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:02.359572 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36663282-8683-4ca9-8e2b-4f75888afd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:02.360593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36663282-8683-4ca9-8e2b-4f75888afd98 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:02.361626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36663282-8683-4ca9-8e2b-4f75888afd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:02.362051 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36663282-8683-4ca9-8e2b-4f75888afd98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:02.376565 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36663282-8683-4ca9-8e2b-4f75888afd98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:02.378169 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36663282-8683-4ca9-8e2b-4f75888afd98 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:02.396062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-36663282-8683-4ca9-8e2b-4f75888afd98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:02.396062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:02.396062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:02.396062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:02.396062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:02.396062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:02.396062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:02.396062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:02.396062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:02.396062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:02.396062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:02.396062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:02.396062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:02.396062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:02.396062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:02.397075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:02.397075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:02.397075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:02.397075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:02.397075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:02.397075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:02.397075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:02.397075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:02.397075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:02.397075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:02.397075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:02.397075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:02.397075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:02.397075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:02.397075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:02.397075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:02.397075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:02.398079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:02.398079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:02.398079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:02.398079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:02.398301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 289/589] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:02.399385 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36663282-8683-4ca9-8e2b-4f75888afd98 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:02.433247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a463f-0279-4ca9-9784-c0fcb4b0b11e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:02.470792 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb54b2-91b8-4c29-b016-33a50e158f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:02.471944 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb54b2-91b8-4c29-b016-33a50e158f50 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:02.472399 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb54b2-91b8-4c29-b016-33a50e158f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:02.472847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb54b2-91b8-4c29-b016-33a50e158f50 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:02.473759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb54b2-91b8-4c29-b016-33a50e158f50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:02.474262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb54b2-91b8-4c29-b016-33a50e158f50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:02.475905 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb54b2-91b8-4c29-b016-33a50e158f50 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:02.483113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:02.489345 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 301/590] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:02.490777 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb54b2-91b8-4c29-b016-33a50e158f50 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:02.496655 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:02.502922 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36663282-8683-4ca9-8e2b-4f75888afd98 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:02.538550 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8d8ae-a443-4f97-a1f4-a0467128858f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:02.539625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8d8ae-a443-4f97-a1f4-a0467128858f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:02.539625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8d8ae-a443-4f97-a1f4-a0467128858f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:02.539989 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8d8ae-a443-4f97-a1f4-a0467128858f None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:02.540899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8d8ae-a443-4f97-a1f4-a0467128858f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:02.541277 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8d8ae-a443-4f97-a1f4-a0467128858f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:02.542829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8d8ae-a443-4f97-a1f4-a0467128858f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:02.566698 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 290/591] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jun 27 10:57:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:02.567386 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8d8ae-a443-4f97-a1f4-a0467128858f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:02.603668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb54b2-91b8-4c29-b016-33a50e158f50 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:02.641167 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a4433-7729-4827-87ab-bd33a4891d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:02.642579 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a4433-7729-4827-87ab-bd33a4891d50 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:02.643033 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a4433-7729-4827-87ab-bd33a4891d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:02.643478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a4433-7729-4827-87ab-bd33a4891d50 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:02.644428 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a4433-7729-4827-87ab-bd33a4891d50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:02.644899 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a4433-7729-4827-87ab-bd33a4891d50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:02.646552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a4433-7729-4827-87ab-bd33a4891d50 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:02.660050 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 302/592] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:02.661196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a4433-7729-4827-87ab-bd33a4891d50 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:02.669642 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8d8ae-a443-4f97-a1f4-a0467128858f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:02.704546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f382c-3177-4192-ad3f-b10d83300894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:02.705627 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f382c-3177-4192-ad3f-b10d83300894 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:02.705627 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f382c-3177-4192-ad3f-b10d83300894 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:02.705917 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f382c-3177-4192-ad3f-b10d83300894 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:02.713301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f382c-3177-4192-ad3f-b10d83300894 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:02.714781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f382c-3177-4192-ad3f-b10d83300894 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:02.725697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:02.729876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-319f382c-3177-4192-ad3f-b10d83300894 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 10:57:02.729876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:02.729876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:02.729876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:02.729876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:02.729876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:02.729876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:02.729876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:02.729876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:02.729876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:02.729876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:02.729876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:02.729876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:02.729876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:02.729876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:02.729876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:02.730799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:02.731709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:02.731709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:02.731709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:02.731709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:02.731709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:02.731709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:02.731709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:02.731709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:02.731709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 10:57:02.731709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:02.731709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 291/593] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:57:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:02.732292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f382c-3177-4192-ad3f-b10d83300894 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:02.748318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:02.776781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a4433-7729-4827-87ab-bd33a4891d50 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:02.814348 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27074da8-d2b4-4532-b3a0-33bd7fe3b5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:02.815471 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27074da8-d2b4-4532-b3a0-33bd7fe3b5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:02.816023 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27074da8-d2b4-4532-b3a0-33bd7fe3b5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:02.816537 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27074da8-d2b4-4532-b3a0-33bd7fe3b5e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:02.827842 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27074da8-d2b4-4532-b3a0-33bd7fe3b5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:02.829728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27074da8-d2b4-4532-b3a0-33bd7fe3b5e7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:02.839987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f382c-3177-4192-ad3f-b10d83300894 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:02.849611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-27074da8-d2b4-4532-b3a0-33bd7fe3b5e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:02.849611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:02.849611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:02.849611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:02.849611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:02.849611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:02.849611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:02.849611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:02.849611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:02.849611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:02.849611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:02.849611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:02.849611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:02.849611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:02.849611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:02.850505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:02.850505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:02.850505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:02.850505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:02.850505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:02.850505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:02.850505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:02.850505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:02.850505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:02.850505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:02.850505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:02.850505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:02.850505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:02.850505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:02.850505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:02.850505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:02.850505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:02.851382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:02.851382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:02.851382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:02.851382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:02.854315 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 303/594] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:02.855365 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27074da8-d2b4-4532-b3a0-33bd7fe3b5e7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:02.881700 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a5e66-e6ae-4a44-90fa-99c5fb85a3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:02.882499 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a5e66-e6ae-4a44-90fa-99c5fb85a3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:02.882785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a5e66-e6ae-4a44-90fa-99c5fb85a3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:02.883431 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a5e66-e6ae-4a44-90fa-99c5fb85a3e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:02.890773 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a5e66-e6ae-4a44-90fa-99c5fb85a3e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:02.892200 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a5e66-e6ae-4a44-90fa-99c5fb85a3e5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:02.907320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a65a5e66-e6ae-4a44-90fa-99c5fb85a3e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:02.907320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:02.907320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:02.907320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:02.907320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:02.907320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:02.907320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:02.907320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:02.907320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:02.907320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:02.907320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:02.907320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:02.907320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:02.907320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:02.907320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:02.908228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:02.908228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:02.908228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:02.908228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:02.908228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:02.908228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:02.908228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:02.908228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:02.908228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:02.908228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:02.908228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:02.908228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:02.908228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:02.908228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:02.908228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:02.908228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:02.908228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:02.909108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:02.909108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:02.909108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:02.909108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:02.909108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:02.909108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:02.909108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:02.909108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:02.909108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 292/595] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:02.909611 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a5e66-e6ae-4a44-90fa-99c5fb85a3e5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:02.970104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27074da8-d2b4-4532-b3a0-33bd7fe3b5e7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:02.982297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:02.989792 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:03.009111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d809e5-db87-4d49-95f8-54994dacc3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:03.010156 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d809e5-db87-4d49-95f8-54994dacc3bb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:03.010632 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d809e5-db87-4d49-95f8-54994dacc3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:03.011348 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d809e5-db87-4d49-95f8-54994dacc3bb None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:03.012399 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d809e5-db87-4d49-95f8-54994dacc3bb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:03.012952 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d809e5-db87-4d49-95f8-54994dacc3bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:03.014669 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d809e5-db87-4d49-95f8-54994dacc3bb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:03.027620 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a5e66-e6ae-4a44-90fa-99c5fb85a3e5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:03.038615 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 304/596] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Jun 27 10:57:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:03.040398 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d809e5-db87-4d49-95f8-54994dacc3bb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:03.069531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c80e3-b8db-446b-ad8e-a57f95c907eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:03.070441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c80e3-b8db-446b-ad8e-a57f95c907eb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:03.070778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c80e3-b8db-446b-ad8e-a57f95c907eb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:03.071060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c80e3-b8db-446b-ad8e-a57f95c907eb None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:03.072207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c80e3-b8db-446b-ad8e-a57f95c907eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:03.072522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c80e3-b8db-446b-ad8e-a57f95c907eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:03.074160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c80e3-b8db-446b-ad8e-a57f95c907eb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:03.094247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 293/597] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:03.094247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c80e3-b8db-446b-ad8e-a57f95c907eb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:03.146509 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d809e5-db87-4d49-95f8-54994dacc3bb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:03.179724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654455f-859a-4354-89f7-103890c2bf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:03.180410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654455f-859a-4354-89f7-103890c2bf34 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:03.180687 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654455f-859a-4354-89f7-103890c2bf34 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:03.180960 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654455f-859a-4354-89f7-103890c2bf34 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:03.181772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654455f-859a-4354-89f7-103890c2bf34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:03.182081 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654455f-859a-4354-89f7-103890c2bf34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:03.183505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654455f-859a-4354-89f7-103890c2bf34 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:03.199466 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 305/598] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:03.199466 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a41e63-6e9d-49af-8272-764db28599f3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:03.199466 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a41e63-6e9d-49af-8272-764db28599f3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:03.199466 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a41e63-6e9d-49af-8272-764db28599f3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:03.202718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 306/599] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:03.203408 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a41e63-6e9d-49af-8272-764db28599f3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:03.212018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c80e3-b8db-446b-ad8e-a57f95c907eb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:03.231837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:03.246168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:03.251829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd85e52-374b-44bd-b4d1-f87217c98ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:03.252620 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd85e52-374b-44bd-b4d1-f87217c98ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:03.252902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd85e52-374b-44bd-b4d1-f87217c98ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:03.253176 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd85e52-374b-44bd-b4d1-f87217c98ff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:03.263546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd85e52-374b-44bd-b4d1-f87217c98ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:03.264985 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd85e52-374b-44bd-b4d1-f87217c98ff8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:03.282507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8fd85e52-374b-44bd-b4d1-f87217c98ff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:03.282507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:03.282507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:03.282507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:03.282507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:03.282507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:03.282507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:03.282507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:03.282507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:03.282507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:03.282507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:03.282507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:03.282507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:03.282507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:03.282507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:03.283564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:03.283564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:03.283564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:03.283564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:03.283564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:03.283564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:03.283564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:03.283564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:03.283564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:03.283564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:03.283564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:03.283564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:03.283564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:03.283564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:03.283564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:03.283564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:03.283564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:03.284516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:03.284516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:03.284516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:03.284516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:03.284516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 294/600] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:03.285003 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd85e52-374b-44bd-b4d1-f87217c98ff8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:03.314977 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a41e63-6e9d-49af-8272-764db28599f3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:03.349203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f35f83-04b8-4488-977c-0830e66d2098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:03.350088 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f35f83-04b8-4488-977c-0830e66d2098 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:03.350424 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f35f83-04b8-4488-977c-0830e66d2098 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:03.350703 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f35f83-04b8-4488-977c-0830e66d2098 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:03.358153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f35f83-04b8-4488-977c-0830e66d2098 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:03.359590 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f35f83-04b8-4488-977c-0830e66d2098 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:03.373574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f3f35f83-04b8-4488-977c-0830e66d2098 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:03.373574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:03.373574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:03.373574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:03.373574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:03.373574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:03.373574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:03.373574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:03.373574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:03.373574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:03.373574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:03.373574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:03.373574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:03.373574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:03.373574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:03.374479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:03.374479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:03.374479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:03.374479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:03.374479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:03.374479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:03.374479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:03.374479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:03.374479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:03.374479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:03.374479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:03.374479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:03.374479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:03.374479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:03.374479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:03.374479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:03.374479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:03.375355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:03.375355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:03.375355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:03.375355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:03.375355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:03.375355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:03.375355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:03.375355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:03.375355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 307/601] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:03.376358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa7ece-1ff2-42ca-b522-1fdd0bba7c4d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:03.376358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa7ece-1ff2-42ca-b522-1fdd0bba7c4d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:03.376514 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa7ece-1ff2-42ca-b522-1fdd0bba7c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:03.392482 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd85e52-374b-44bd-b4d1-f87217c98ff8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:03.394205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b4fa7ece-1ff2-42ca-b522-1fdd0bba7c4d None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:03.395379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b4fa7ece-1ff2-42ca-b522-1fdd0bba7c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:03.427933 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82636b-688f-4260-ae6e-27b74e7dc505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:03.429086 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82636b-688f-4260-ae6e-27b74e7dc505 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:03.429559 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82636b-688f-4260-ae6e-27b74e7dc505 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:03.429834 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82636b-688f-4260-ae6e-27b74e7dc505 None admin] PATH_INFO: `/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/521f3fcc63524d2d82b4a05a0dc062f0/roles/e053e0425eb744e2a3e3316222e208f3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:03.444591 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82636b-688f-4260-ae6e-27b74e7dc505 None admin] RBAC: Authorizing `identity:create_grant(project_id=6543a66af8ba48c391ce686f6d82276b, user_id=521f3fcc63524d2d82b4a05a0dc062f0, role_id=e053e0425eb744e2a3e3316222e208f3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:03.446665 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82636b-688f-4260-ae6e-27b74e7dc505 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:03.460022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 295/602] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:57:03 2022] PUT /identity/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/521f3fcc63524d2d82b4a05a0dc062f0/roles/e053e0425eb744e2a3e3316222e208f3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:57:03.460814 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82636b-688f-4260-ae6e-27b74e7dc505 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:03.462622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 308/603] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:57:03.463696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa7ece-1ff2-42ca-b522-1fdd0bba7c4d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:03.495921 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:03.531543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:03.609320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82636b-688f-4260-ae6e-27b74e7dc505 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:03.616728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa7ece-1ff2-42ca-b522-1fdd0bba7c4d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:03.647134 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318ccac-7ff3-4e9c-a3ae-b9fd1bf3766f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:03.647803 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318ccac-7ff3-4e9c-a3ae-b9fd1bf3766f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:03.648085 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318ccac-7ff3-4e9c-a3ae-b9fd1bf3766f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:03.648367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318ccac-7ff3-4e9c-a3ae-b9fd1bf3766f None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:03.649760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318ccac-7ff3-4e9c-a3ae-b9fd1bf3766f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:03.650090 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318ccac-7ff3-4e9c-a3ae-b9fd1bf3766f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:03.651454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318ccac-7ff3-4e9c-a3ae-b9fd1bf3766f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:03.658336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb55c2-c52f-4c67-9e5f-9911af550ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:03.659532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb55c2-c52f-4c67-9e5f-9911af550ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:03.659822 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb55c2-c52f-4c67-9e5f-9911af550ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:03.660104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb55c2-c52f-4c67-9e5f-9911af550ea6 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:03.661213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb55c2-c52f-4c67-9e5f-9911af550ea6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:03.661213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb55c2-c52f-4c67-9e5f-9911af550ea6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:03.662736 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb55c2-c52f-4c67-9e5f-9911af550ea6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:03.667235 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 296/604] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:03.667897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318ccac-7ff3-4e9c-a3ae-b9fd1bf3766f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:03.675141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 309/605] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:03.675902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb55c2-c52f-4c67-9e5f-9911af550ea6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:03.756023 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:03.777210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:03.779911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb55c2-c52f-4c67-9e5f-9911af550ea6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:03.787215 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318ccac-7ff3-4e9c-a3ae-b9fd1bf3766f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:03.814057 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c3bf7-7f0f-467c-9452-638fa76dddab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:03.814839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3bf7-7f0f-467c-9452-638fa76dddab None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:03.815116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3bf7-7f0f-467c-9452-638fa76dddab None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:03.815384 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3bf7-7f0f-467c-9452-638fa76dddab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:03.826290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8819af3-8072-49ed-bf2f-aaa7b159ed99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:03.827407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8819af3-8072-49ed-bf2f-aaa7b159ed99 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:03.827590 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c3bf7-7f0f-467c-9452-638fa76dddab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:03.828063 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8819af3-8072-49ed-bf2f-aaa7b159ed99 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:03.828556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8819af3-8072-49ed-bf2f-aaa7b159ed99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:03.829053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c3bf7-7f0f-467c-9452-638fa76dddab None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:03.840972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8819af3-8072-49ed-bf2f-aaa7b159ed99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:03.844302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-834c3bf7-7f0f-467c-9452-638fa76dddab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:03.844302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:03.844302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:03.844302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:03.844302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:03.844302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:03.844302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:03.844302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:03.844302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:03.844302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:03.844302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:03.844302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:03.844302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:03.844302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:03.844302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:03.845180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:03.845180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:03.845180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:03.845180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:03.845180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:03.845180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:03.845180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:03.845180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:03.845180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:03.845180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:03.845180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:03.845180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:03.845180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:03.845180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:03.845180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:03.845180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:03.845180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:03.846101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:03.846101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:03.846101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:03.846101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:03.846101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:03.846101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:03.846101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:03.846101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:03.850237 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 310/606] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:03.851067 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c3bf7-7f0f-467c-9452-638fa76dddab None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:03.852901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e8819af3-8072-49ed-bf2f-aaa7b159ed99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:03.852901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:03.852901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:03.852901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:03.852901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:03.852901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:03.852901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:03.852901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:03.852901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:03.852901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:03.852901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:03.852901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:03.852901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:03.852901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:03.852901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:03.852901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:03.853849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:03.853849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:03.853849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:03.853849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:03.853849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:03.853849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:03.853849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:03.853849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:03.853849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:03.853849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:03.853849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:03.853849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:03.853849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:03.853849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:03.853849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:03.853849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:03.854695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:03.854695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:03.854695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:03.854695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:03.854695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:03.854695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:03.854695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:03.854695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:03.854695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:03.854695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:03.854695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:03.854695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:03.862398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 297/607] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:57:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:03.863726 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8819af3-8072-49ed-bf2f-aaa7b159ed99 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:03.958041 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c3bf7-7f0f-467c-9452-638fa76dddab None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:03.975451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8819af3-8072-49ed-bf2f-aaa7b159ed99 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:03.994681 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42e6ad-1fce-4187-9450-26098b8833f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:03.995915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42e6ad-1fce-4187-9450-26098b8833f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:03.996395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42e6ad-1fce-4187-9450-26098b8833f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:03.996841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42e6ad-1fce-4187-9450-26098b8833f8 None admin] PATH_INFO: `/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/49b6436fdd7a4977a2e02c0e1b8be2c7/roles/e053e0425eb744e2a3e3316222e208f3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:04.005812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:04.009656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cffe7-53fe-4da4-9fd1-26ab733995c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:04.010316 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cffe7-53fe-4da4-9fd1-26ab733995c4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:04.010598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cffe7-53fe-4da4-9fd1-26ab733995c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:04.010869 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cffe7-53fe-4da4-9fd1-26ab733995c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:04.011898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cffe7-53fe-4da4-9fd1-26ab733995c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:04.012201 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cffe7-53fe-4da4-9fd1-26ab733995c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:04.013658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cffe7-53fe-4da4-9fd1-26ab733995c4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:04.014402 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42e6ad-1fce-4187-9450-26098b8833f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6543a66af8ba48c391ce686f6d82276b, user_id=49b6436fdd7a4977a2e02c0e1b8be2c7, role_id=e053e0425eb744e2a3e3316222e208f3)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:04.016049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42e6ad-1fce-4187-9450-26098b8833f8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:04.032961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 298/608] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:04.032961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cffe7-53fe-4da4-9fd1-26ab733995c4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:04.040313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 311/609] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:57:03 2022] PUT /identity/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/49b6436fdd7a4977a2e02c0e1b8be2c7/roles/e053e0425eb744e2a3e3316222e208f3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:57:04.040313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bbcd2-6797-4281-b459-32b88f47459f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:04.040313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bbcd2-6797-4281-b459-32b88f47459f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:04.040313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bbcd2-6797-4281-b459-32b88f47459f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:04.041147 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 312/610] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:04.042298 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bbcd2-6797-4281-b459-32b88f47459f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:04.050809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:04.168731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cffe7-53fe-4da4-9fd1-26ab733995c4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:04.178189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bbcd2-6797-4281-b459-32b88f47459f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:04.219443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a51c5-6774-4ac4-bed4-daad50fb3066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:04.220113 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a51c5-6774-4ac4-bed4-daad50fb3066 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:04.220392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a51c5-6774-4ac4-bed4-daad50fb3066 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:04.220668 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a51c5-6774-4ac4-bed4-daad50fb3066 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:04.222088 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a51c5-6774-4ac4-bed4-daad50fb3066 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:04.222088 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a51c5-6774-4ac4-bed4-daad50fb3066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:04.223089 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a51c5-6774-4ac4-bed4-daad50fb3066 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:04.228126 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae2a04-7d52-4fb9-95a2-35382f2a0ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:04.229259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae2a04-7d52-4fb9-95a2-35382f2a0ab2 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:04.229779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae2a04-7d52-4fb9-95a2-35382f2a0ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:04.230267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae2a04-7d52-4fb9-95a2-35382f2a0ab2 None admin] PATH_INFO: `/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/cb2d4050a05f4517ab165c74f9e6cae6/roles/e053e0425eb744e2a3e3316222e208f3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:04.231518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 299/611] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:57:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:04.232727 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8e9d-63f3-4146-b1fd-25065587c0bf None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:04.233015 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8e9d-63f3-4146-b1fd-25065587c0bf None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:04.233290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8e9d-63f3-4146-b1fd-25065587c0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:04.250144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae2a04-7d52-4fb9-95a2-35382f2a0ab2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6543a66af8ba48c391ce686f6d82276b, user_id=cb2d4050a05f4517ab165c74f9e6cae6, role_id=e053e0425eb744e2a3e3316222e208f3)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:04.251761 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d48c8e9d-63f3-4146-b1fd-25065587c0bf None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:04.252326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae2a04-7d52-4fb9-95a2-35382f2a0ab2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:04.252939 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d48c8e9d-63f3-4146-b1fd-25065587c0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:04.268387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 313/612] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:57:04 2022] PUT /identity/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/cb2d4050a05f4517ab165c74f9e6cae6/roles/e053e0425eb744e2a3e3316222e208f3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:57:04.273793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae2a04-7d52-4fb9-95a2-35382f2a0ab2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:04.340530 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 300/613] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:57:04.361404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:04.379161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c8e9d-63f3-4146-b1fd-25065587c0bf None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:04.388918 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:04.462768 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae2a04-7d52-4fb9-95a2-35382f2a0ab2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:04.504604 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4562c-5cfc-4c9f-9bf7-b1e35b69ec8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:04.506126 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4562c-5cfc-4c9f-9bf7-b1e35b69ec8a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:04.506425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4562c-5cfc-4c9f-9bf7-b1e35b69ec8a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:04.506700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4562c-5cfc-4c9f-9bf7-b1e35b69ec8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:04.517698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4562c-5cfc-4c9f-9bf7-b1e35b69ec8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:04.519140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4562c-5cfc-4c9f-9bf7-b1e35b69ec8a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:04.530626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c8e9d-63f3-4146-b1fd-25065587c0bf None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:04.537808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f2f4562c-5cfc-4c9f-9bf7-b1e35b69ec8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:04.537808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:04.537808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:04.537808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:04.537808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:04.537808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:04.537808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:04.537808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:04.537808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:04.537808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:04.537808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:04.537808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:04.537808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:04.537808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:04.537808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:04.538723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:04.538723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:04.538723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:04.538723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:04.538723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:04.538723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:04.538723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:04.538723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:04.538723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:04.538723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:04.538723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:04.538723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:04.538723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:04.538723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:04.538723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:04.538723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:04.538723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:04.539793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:04.539793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:04.539793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:04.539793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:04.539793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 314/614] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:04.545758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4562c-5cfc-4c9f-9bf7-b1e35b69ec8a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:04.608870 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb438f-7efc-4e17-8f73-4130499e64e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:04.609620 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb438f-7efc-4e17-8f73-4130499e64e6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:04.609900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb438f-7efc-4e17-8f73-4130499e64e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:04.610172 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb438f-7efc-4e17-8f73-4130499e64e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:04.629412 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb438f-7efc-4e17-8f73-4130499e64e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:04.643006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-72bb438f-7efc-4e17-8f73-4130499e64e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:04.643006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:04.643006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:04.643006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:04.643006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:04.643006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:04.643006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:04.643006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:04.643006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:04.643006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:04.643006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:04.643006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:04.643006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:04.643006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:04.643006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:04.643006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:04.643991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:04.643991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:04.643991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:04.643991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:04.643991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:04.643991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:04.643991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:04.643991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:04.643991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:04.643991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:04.643991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:04.643991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:04.643991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:04.643991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:04.643991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:04.643991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:04.644817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:04.644817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:04.644817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:04.644817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:04.644817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:04.644817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:04.644817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:04.644817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:04.644817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:04.644817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:04.644817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:04.644817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:04.655599 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 301/615] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:57:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:04.661575 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb438f-7efc-4e17-8f73-4130499e64e6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:04.669794 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:04.675727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4562c-5cfc-4c9f-9bf7-b1e35b69ec8a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:04.732860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:04.747333 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde060e-e72e-4233-9820-a45dda73d1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:04.748000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde060e-e72e-4233-9820-a45dda73d1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:04.748307 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde060e-e72e-4233-9820-a45dda73d1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:04.748576 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde060e-e72e-4233-9820-a45dda73d1f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:04.749298 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde060e-e72e-4233-9820-a45dda73d1f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:04.749632 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde060e-e72e-4233-9820-a45dda73d1f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:04.751047 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde060e-e72e-4233-9820-a45dda73d1f7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:04.776615 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 315/616] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:04.782357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde060e-e72e-4233-9820-a45dda73d1f7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:04.815856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb438f-7efc-4e17-8f73-4130499e64e6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:04.879786 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f281986-a0a8-4157-8d52-d2087d51e692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:04.880430 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f281986-a0a8-4157-8d52-d2087d51e692 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:04.880719 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f281986-a0a8-4157-8d52-d2087d51e692 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:04.880997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f281986-a0a8-4157-8d52-d2087d51e692 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:04.881785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f281986-a0a8-4157-8d52-d2087d51e692 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:04.882091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f281986-a0a8-4157-8d52-d2087d51e692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:04.884141 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f281986-a0a8-4157-8d52-d2087d51e692 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:04.903999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 302/617] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:57:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:04.908439 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f281986-a0a8-4157-8d52-d2087d51e692 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:04.959095 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde060e-e72e-4233-9820-a45dda73d1f7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:05.020842 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ccb83-f4a9-4c28-9f70-802f78d36b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:05.023316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ccb83-f4a9-4c28-9f70-802f78d36b43 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:05.023600 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ccb83-f4a9-4c28-9f70-802f78d36b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:05.023875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ccb83-f4a9-4c28-9f70-802f78d36b43 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:05.041859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ccb83-f4a9-4c28-9f70-802f78d36b43 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:05.043302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ccb83-f4a9-4c28-9f70-802f78d36b43 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:05.070494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-4b4ccb83-f4a9-4c28-9f70-802f78d36b43 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 10:57:05.070494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:05.070494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:05.070494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:05.070494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:05.070494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:05.070494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:05.070494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:05.070494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:05.070494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:05.070494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:05.070494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:05.070494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:05.070494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:05.070494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:05.070494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:05.071535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:05.072493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:05.072493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:05.072493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:05.072493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:05.072493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:05.072493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:05.072493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:05.072493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:05.072493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 10:57:05.072493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:05.078404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 316/618] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:57:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:05.086394 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ccb83-f4a9-4c28-9f70-802f78d36b43 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:05.103504 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f281986-a0a8-4157-8d52-d2087d51e692 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:05.119444 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:05.135122 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:05.147631 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ed52b-00fe-48d8-bde9-e8d10f4e6c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:05.148624 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ed52b-00fe-48d8-bde9-e8d10f4e6c3b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:05.149076 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ed52b-00fe-48d8-bde9-e8d10f4e6c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:05.149701 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ed52b-00fe-48d8-bde9-e8d10f4e6c3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:05.167673 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ed52b-00fe-48d8-bde9-e8d10f4e6c3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:05.170406 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ed52b-00fe-48d8-bde9-e8d10f4e6c3b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:05.203693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-701ed52b-00fe-48d8-bde9-e8d10f4e6c3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:05.203693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:05.203693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:05.203693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:05.203693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:05.203693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:05.203693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:05.203693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:05.203693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:05.203693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:05.203693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:05.203693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:05.203693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:05.203693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:05.203693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:05.204724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:05.204724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:05.204724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:05.204724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:05.204724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:05.204724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:05.204724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:05.204724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:05.204724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:05.204724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:05.204724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:05.204724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:05.204724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:05.204724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:05.204724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:05.204724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:05.204724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:05.205846 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:05.205846 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:05.205846 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:05.205846 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:05.207768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 303/619] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:05.214866 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ed52b-00fe-48d8-bde9-e8d10f4e6c3b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:05.268186 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ccb83-f4a9-4c28-9f70-802f78d36b43 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:05.311467 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafab596-8777-4b4f-9553-b22a65956211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:05.313765 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafab596-8777-4b4f-9553-b22a65956211 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:05.314144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafab596-8777-4b4f-9553-b22a65956211 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:05.314526 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafab596-8777-4b4f-9553-b22a65956211 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:05.316418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafab596-8777-4b4f-9553-b22a65956211 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:05.318182 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafab596-8777-4b4f-9553-b22a65956211 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:05.319723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafab596-8777-4b4f-9553-b22a65956211 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:05.345257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 317/620] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Jun 27 10:57:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:05.350702 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafab596-8777-4b4f-9553-b22a65956211 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:05.423690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ed52b-00fe-48d8-bde9-e8d10f4e6c3b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:05.472053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629dc4b-72f0-4d15-bbba-ac929cf686f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:05.472721 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629dc4b-72f0-4d15-bbba-ac929cf686f9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:05.473009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629dc4b-72f0-4d15-bbba-ac929cf686f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:05.473286 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629dc4b-72f0-4d15-bbba-ac929cf686f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:05.474043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629dc4b-72f0-4d15-bbba-ac929cf686f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:05.474352 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629dc4b-72f0-4d15-bbba-ac929cf686f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:05.475725 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629dc4b-72f0-4d15-bbba-ac929cf686f9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:05.482149 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:05.501513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 304/621] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:05.503660 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629dc4b-72f0-4d15-bbba-ac929cf686f9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:05.518434 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafab596-8777-4b4f-9553-b22a65956211 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:05.549972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:05.614471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629dc4b-72f0-4d15-bbba-ac929cf686f9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:05.622079 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae8b07-8b3c-4637-8a5c-6576830dc3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:05.622892 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8b07-8b3c-4637-8a5c-6576830dc3bc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:05.623177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8b07-8b3c-4637-8a5c-6576830dc3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:05.623464 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8b07-8b3c-4637-8a5c-6576830dc3bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:05.643296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae8b07-8b3c-4637-8a5c-6576830dc3bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:05.644737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae8b07-8b3c-4637-8a5c-6576830dc3bc None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:05.660376 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56544be-7684-4ece-b31c-227baecd32a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:05.661173 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56544be-7684-4ece-b31c-227baecd32a8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:05.661486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56544be-7684-4ece-b31c-227baecd32a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:05.661764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56544be-7684-4ece-b31c-227baecd32a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:05.670976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9cae8b07-8b3c-4637-8a5c-6576830dc3bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:05.670976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:05.670976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:05.670976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:05.670976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:05.670976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:05.670976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:05.670976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:05.670976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:05.670976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:05.670976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:05.670976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:05.670976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:05.670976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:05.670976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:05.672340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:05.672340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:05.672340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:05.672340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:05.672340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:05.672340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:05.672340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:05.672340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:05.672340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:05.672340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:05.672340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:05.672340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:05.672340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:05.672340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:05.672340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:05.672340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:05.672340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:05.673782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:05.673782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:05.673782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:05.673782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:05.673782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 318/622] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:05.679302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae8b07-8b3c-4637-8a5c-6576830dc3bc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:05.680687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56544be-7684-4ece-b31c-227baecd32a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:05.682180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56544be-7684-4ece-b31c-227baecd32a8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:05.707966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a56544be-7684-4ece-b31c-227baecd32a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:57:05.707966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:05.707966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:05.707966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:05.707966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:05.707966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:05.707966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:05.707966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:05.707966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:05.707966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:05.707966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:05.707966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:05.707966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:05.707966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:05.707966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:05.707966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:05.709166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:05.710407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:05.710407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:05.710407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:05.710407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:05.710407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:05.710407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:05.710407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:05.710407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:05.710407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:57:05.710407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:05.711097 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 305/623] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jun 27 10:57:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:05.717054 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56544be-7684-4ece-b31c-227baecd32a8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:05.832008 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae8b07-8b3c-4637-8a5c-6576830dc3bc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:05.855354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:05.858632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:05.864980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56544be-7684-4ece-b31c-227baecd32a8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:05.871834 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec470d0-473d-4634-a499-8a860f98969c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:05.872484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec470d0-473d-4634-a499-8a860f98969c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:05.872760 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec470d0-473d-4634-a499-8a860f98969c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:05.873031 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec470d0-473d-4634-a499-8a860f98969c None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:05.873797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec470d0-473d-4634-a499-8a860f98969c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:05.874096 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec470d0-473d-4634-a499-8a860f98969c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:05.875748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec470d0-473d-4634-a499-8a860f98969c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:05.893313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 319/624] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:05.894928 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de2f2e-80f8-405b-bc89-4eedca2c360e None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:05.895182 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de2f2e-80f8-405b-bc89-4eedca2c360e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:05.895463 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de2f2e-80f8-405b-bc89-4eedca2c360e None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:05.897042 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 320/625] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:05.897751 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de2f2e-80f8-405b-bc89-4eedca2c360e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:05.911477 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aada87a-4a33-461f-85c4-fec735c097d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:05.912566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aada87a-4a33-461f-85c4-fec735c097d0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:05.913078 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aada87a-4a33-461f-85c4-fec735c097d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:05.913597 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aada87a-4a33-461f-85c4-fec735c097d0 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:05.914732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aada87a-4a33-461f-85c4-fec735c097d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:05.915271 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aada87a-4a33-461f-85c4-fec735c097d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:05.917503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aada87a-4a33-461f-85c4-fec735c097d0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:05.939767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 306/626] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jun 27 10:57:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:05.941062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a94551-925b-470d-9cbc-aa971740f6e0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:05.941352 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a94551-925b-470d-9cbc-aa971740f6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:05.941686 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a94551-925b-470d-9cbc-aa971740f6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:05.959987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-92a94551-925b-470d-9cbc-aa971740f6e0 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:05.961244 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-92a94551-925b-470d-9cbc-aa971740f6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:06.037450 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 307/627] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:57:06.038376 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de2f2e-80f8-405b-bc89-4eedca2c360e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:06.039497 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a94551-925b-470d-9cbc-aa971740f6e0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:06.095562 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f8bad-70c1-4c5e-9d22-f4a13bd54015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:06.097090 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f8bad-70c1-4c5e-9d22-f4a13bd54015 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:06.097972 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f8bad-70c1-4c5e-9d22-f4a13bd54015 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:06.098450 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f8bad-70c1-4c5e-9d22-f4a13bd54015 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:06.108808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f8bad-70c1-4c5e-9d22-f4a13bd54015 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:06.111487 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f8bad-70c1-4c5e-9d22-f4a13bd54015 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:06.131478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-c55f8bad-70c1-4c5e-9d22-f4a13bd54015 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:06.131478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:06.131478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:06.131478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:06.131478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:06.131478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:06.131478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:06.131478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:06.131478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:06.131478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:06.131478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:06.131478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:06.131478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:06.131478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:06.131478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:06.132485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:06.132485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:06.132485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:06.132485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:06.132485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:06.132485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:06.132485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:06.132485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:06.132485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:06.132485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:06.132485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:06.132485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:06.132485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:06.132485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:06.132485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:06.132485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:06.132485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:06.133981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:06.133981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:06.133981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:06.133981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:06.133981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:06.133981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:06.133981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:06.133981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:06.135679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 321/628] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:06.140801 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f8bad-70c1-4c5e-9d22-f4a13bd54015 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:06.146995 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:06.162150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a94551-925b-470d-9cbc-aa971740f6e0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:06.198380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:06.205825 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada5400-78ce-49dd-a96f-8a7b28e72e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:06.206541 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada5400-78ce-49dd-a96f-8a7b28e72e94 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:06.206892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada5400-78ce-49dd-a96f-8a7b28e72e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:06.207226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada5400-78ce-49dd-a96f-8a7b28e72e94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:06.262428 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f8bad-70c1-4c5e-9d22-f4a13bd54015 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:06.278164 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada5400-78ce-49dd-a96f-8a7b28e72e94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:06.279727 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada5400-78ce-49dd-a96f-8a7b28e72e94 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:06.298542 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6afb2-60ef-4ecc-b756-9b43e1bfe0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:06.299545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6afb2-60ef-4ecc-b756-9b43e1bfe0ce None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:06.300012 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6afb2-60ef-4ecc-b756-9b43e1bfe0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:06.300461 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6afb2-60ef-4ecc-b756-9b43e1bfe0ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:06.312139 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6afb2-60ef-4ecc-b756-9b43e1bfe0ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:06.320459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-afc6afb2-60ef-4ecc-b756-9b43e1bfe0ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:06.320459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:06.320459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:06.320459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:06.320459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:06.320459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:06.320459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:06.320459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:06.320459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:06.320459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:06.320459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:06.320459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:06.320459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:06.320459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:06.320459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:06.320459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:06.322195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:06.322195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:06.322195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:06.322195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:06.322195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:06.322195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:06.322195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:06.322195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:06.322195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:06.322195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:06.322195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:06.322195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:06.322195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:06.322195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:06.322195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:06.322195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:06.323229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:06.323229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:06.323229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:06.323229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:06.323229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:06.323229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:06.323229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:06.323229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:06.323229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:06.323229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:06.323229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:06.323229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:06.325703 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 322/629] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:57:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:06.326743 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6afb2-60ef-4ecc-b756-9b43e1bfe0ce None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:06.379796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:06.394365 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 308/630] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:57:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:57:06.395328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada5400-78ce-49dd-a96f-8a7b28e72e94 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:06.432982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:06.437922 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6afb2-60ef-4ecc-b756-9b43e1bfe0ce None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:06.472504 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24112582-f0b2-401f-b89f-ee9554b04f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:06.473176 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24112582-f0b2-401f-b89f-ee9554b04f05 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:06.473778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24112582-f0b2-401f-b89f-ee9554b04f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:06.473778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24112582-f0b2-401f-b89f-ee9554b04f05 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:06.474517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24112582-f0b2-401f-b89f-ee9554b04f05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:06.474823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24112582-f0b2-401f-b89f-ee9554b04f05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:06.476237 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24112582-f0b2-401f-b89f-ee9554b04f05 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:06.489598 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 323/631] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:06.490222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24112582-f0b2-401f-b89f-ee9554b04f05 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:06.514441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada5400-78ce-49dd-a96f-8a7b28e72e94 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:06.550978 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296306b-10c1-4507-b7b5-2c510c9b64d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:06.551646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296306b-10c1-4507-b7b5-2c510c9b64d8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:06.551927 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296306b-10c1-4507-b7b5-2c510c9b64d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:06.552256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296306b-10c1-4507-b7b5-2c510c9b64d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:06.553003 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296306b-10c1-4507-b7b5-2c510c9b64d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:06.553346 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296306b-10c1-4507-b7b5-2c510c9b64d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:06.554771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296306b-10c1-4507-b7b5-2c510c9b64d8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:06.563359 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 309/632] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:57:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:06.564617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417c9e6-88db-4db4-9fe2-f8f91d7ff10f None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:06.564904 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417c9e6-88db-4db4-9fe2-f8f91d7ff10f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:06.565179 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417c9e6-88db-4db4-9fe2-f8f91d7ff10f None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:06.566553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 310/633] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:06.567094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417c9e6-88db-4db4-9fe2-f8f91d7ff10f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:06.591875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24112582-f0b2-401f-b89f-ee9554b04f05 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:06.615766 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:06.626647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7d858-9e96-4940-8dfb-9f131f4f1d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:06.627438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7d858-9e96-4940-8dfb-9f131f4f1d90 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:06.627713 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7d858-9e96-4940-8dfb-9f131f4f1d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:06.627981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7d858-9e96-4940-8dfb-9f131f4f1d90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:06.638706 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7d858-9e96-4940-8dfb-9f131f4f1d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:06.640134 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7d858-9e96-4940-8dfb-9f131f4f1d90 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:06.656909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a4d7d858-9e96-4940-8dfb-9f131f4f1d90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:06.656909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:06.656909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:06.656909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:06.656909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:06.656909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:06.656909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:06.656909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:06.656909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:06.656909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:06.656909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:06.656909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:06.656909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:06.656909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:06.656909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:06.657882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:06.657882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:06.657882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:06.657882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:06.657882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:06.657882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:06.657882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:06.657882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:06.657882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:06.657882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:06.657882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:06.657882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:06.657882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:06.657882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:06.657882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:06.657882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:06.657882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:06.658818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:06.658818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:06.658818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:06.658818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:06.658818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 324/634] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:06.659286 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011f3cd-aa8e-4e84-a7fd-fadc5a0698c5 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:06.659565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011f3cd-aa8e-4e84-a7fd-fadc5a0698c5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:06.659866 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011f3cd-aa8e-4e84-a7fd-fadc5a0698c5 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:06.661060 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 325/635] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:06.661754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011f3cd-aa8e-4e84-a7fd-fadc5a0698c5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:06.671736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417c9e6-88db-4db4-9fe2-f8f91d7ff10f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:06.675956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:06.705408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef70e9-3922-44dd-b8ef-73fec44f3886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:06.706291 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef70e9-3922-44dd-b8ef-73fec44f3886 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:06.706574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef70e9-3922-44dd-b8ef-73fec44f3886 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:06.706847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef70e9-3922-44dd-b8ef-73fec44f3886 None admin] PATH_INFO: `/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/189af68908944b5e9a7cb35fde0e1bd3/roles/e053e0425eb744e2a3e3316222e208f3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:06.720876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef70e9-3922-44dd-b8ef-73fec44f3886 None admin] RBAC: Authorizing `identity:create_grant(project_id=6543a66af8ba48c391ce686f6d82276b, user_id=189af68908944b5e9a7cb35fde0e1bd3, role_id=e053e0425eb744e2a3e3316222e208f3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:06.722330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef70e9-3922-44dd-b8ef-73fec44f3886 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:06.734736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 311/636] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:57:06 2022] PUT /identity/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/189af68908944b5e9a7cb35fde0e1bd3/roles/e053e0425eb744e2a3e3316222e208f3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:57:06.735860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb7db-5cf2-437e-a680-2edd4013b377 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:06.736143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb7db-5cf2-437e-a680-2edd4013b377 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:06.736416 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb7db-5cf2-437e-a680-2edd4013b377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:06.764588 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-af9cb7db-5cf2-437e-a680-2edd4013b377 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:06.766009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-af9cb7db-5cf2-437e-a680-2edd4013b377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:06.766561 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011f3cd-aa8e-4e84-a7fd-fadc5a0698c5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:06.807221 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca38c3e-1acd-4979-abc4-0f0810efcd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:06.808023 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca38c3e-1acd-4979-abc4-0f0810efcd97 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:06.808306 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca38c3e-1acd-4979-abc4-0f0810efcd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:06.808580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca38c3e-1acd-4979-abc4-0f0810efcd97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:06.821142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca38c3e-1acd-4979-abc4-0f0810efcd97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:06.822843 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca38c3e-1acd-4979-abc4-0f0810efcd97 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:06.842682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-4ca38c3e-1acd-4979-abc4-0f0810efcd97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:06.842682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:06.842682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:06.842682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:06.842682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:06.842682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:06.842682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:06.842682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:06.842682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:06.842682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:06.842682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:06.842682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:06.842682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:06.842682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:06.842682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:06.843778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:06.843778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:06.843778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:06.843778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:06.843778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:06.843778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:06.843778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:06.843778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:06.843778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:06.843778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:06.843778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:06.843778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:06.843778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:06.843778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:06.843778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:06.843778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:06.843778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:06.844667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:06.844667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:06.844667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:06.844667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:06.844667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 326/637] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:06.845445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca38c3e-1acd-4979-abc4-0f0810efcd97 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:06.861730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 312/638] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:57:06.861730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd05fd-b7ec-45f2-9aac-33ff595a1168 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:06.861730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd05fd-b7ec-45f2-9aac-33ff595a1168 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:06.861730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd05fd-b7ec-45f2-9aac-33ff595a1168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:06.883957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-95dd05fd-b7ec-45f2-9aac-33ff595a1168 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:06.885146 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-95dd05fd-b7ec-45f2-9aac-33ff595a1168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:06.912801 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:06.918908 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:06.959659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 313/639] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:57:06.960320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd05fd-b7ec-45f2-9aac-33ff595a1168 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:06.963592 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca38c3e-1acd-4979-abc4-0f0810efcd97 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:07.001917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f6929-fc0d-4b90-a211-4f085b80e1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:07.002490 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6929-fc0d-4b90-a211-4f085b80e1ed None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:07.002772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6929-fc0d-4b90-a211-4f085b80e1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:07.003046 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6929-fc0d-4b90-a211-4f085b80e1ed None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:07.003757 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f6929-fc0d-4b90-a211-4f085b80e1ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:07.004058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f6929-fc0d-4b90-a211-4f085b80e1ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:07.005445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f6929-fc0d-4b90-a211-4f085b80e1ed None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:07.021012 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 327/640] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:07.021012 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f6929-fc0d-4b90-a211-4f085b80e1ed None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:07.079532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd05fd-b7ec-45f2-9aac-33ff595a1168 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:07.118959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571223fc-a14c-466c-8a47-21b524b790f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:07.119737 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571223fc-a14c-466c-8a47-21b524b790f4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:07.120023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571223fc-a14c-466c-8a47-21b524b790f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:07.120305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571223fc-a14c-466c-8a47-21b524b790f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:07.120804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f6929-fc0d-4b90-a211-4f085b80e1ed None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:07.121031 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571223fc-a14c-466c-8a47-21b524b790f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:07.121337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571223fc-a14c-466c-8a47-21b524b790f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:07.122905 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571223fc-a14c-466c-8a47-21b524b790f4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:07.141511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 314/641] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:07.142635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571223fc-a14c-466c-8a47-21b524b790f4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:07.147181 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:07.159438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80e8b9-f884-4bc4-8915-660de442cdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:07.159964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80e8b9-f884-4bc4-8915-660de442cdbc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:07.160245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80e8b9-f884-4bc4-8915-660de442cdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:07.160543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80e8b9-f884-4bc4-8915-660de442cdbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:07.167357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:07.172052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80e8b9-f884-4bc4-8915-660de442cdbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:07.181957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-ef80e8b9-f884-4bc4-8915-660de442cdbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:07.181957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:07.181957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:07.181957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:07.181957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:07.181957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:07.181957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:07.181957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:07.181957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:07.181957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:07.181957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:07.181957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:07.181957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:07.181957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:07.181957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:07.181957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:07.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:07.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:07.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:07.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:07.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:07.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:07.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:07.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:07.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:07.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:07.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:07.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:07.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:07.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:07.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:07.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:07.183773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:07.183773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:07.183773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:07.183773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:07.183773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:07.183773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:07.183773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:07.183773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:07.183773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:07.183773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:07.183773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:07.183773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:07.183773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 328/642] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:57:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:07.183773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80e8b9-f884-4bc4-8915-660de442cdbc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:07.257153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571223fc-a14c-466c-8a47-21b524b790f4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:07.291517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faebeda-97a8-41e9-8954-89082c7a7bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:07.292310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faebeda-97a8-41e9-8954-89082c7a7bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:07.292594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faebeda-97a8-41e9-8954-89082c7a7bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:07.292869 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faebeda-97a8-41e9-8954-89082c7a7bf7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:07.294112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80e8b9-f884-4bc4-8915-660de442cdbc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:07.302920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faebeda-97a8-41e9-8954-89082c7a7bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:07.310646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-0faebeda-97a8-41e9-8954-89082c7a7bf7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:07.310646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:07.310646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:07.310646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:07.310646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:07.310646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:07.310646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:07.310646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:07.310646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:07.310646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:07.310646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:07.310646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:07.310646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:07.310646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:07.310646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:07.310646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:07.311617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:07.311617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:07.311617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:07.311617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:07.311617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:07.311617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:07.311617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:07.311617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:07.311617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:07.311617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:07.311617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:07.311617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:07.311617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:07.311617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:07.311617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:07.311617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:07.312454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:07.312454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:07.312454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:07.312454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:07.312454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:07.312454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:07.312454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:07.312454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:07.312454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:07.312454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:07.312454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:07.312454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:07.312454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 315/643] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:57:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:07.313148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faebeda-97a8-41e9-8954-89082c7a7bf7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:07.334197 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9e9f8-c020-46b8-8258-9cc6bb07006b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:07.334984 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9e9f8-c020-46b8-8258-9cc6bb07006b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:07.335378 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9e9f8-c020-46b8-8258-9cc6bb07006b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:07.335654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9e9f8-c020-46b8-8258-9cc6bb07006b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:07.343573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9e9f8-c020-46b8-8258-9cc6bb07006b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:07.345250 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9e9f8-c020-46b8-8258-9cc6bb07006b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:07.360317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-cef9e9f8-c020-46b8-8258-9cc6bb07006b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:07.360317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:07.360317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:07.360317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:07.360317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:07.360317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:07.360317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:07.360317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:07.360317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:07.360317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:07.360317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:07.360317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:07.360317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:07.360317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:07.360317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:07.361277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:07.361277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:07.361277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:07.361277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:07.361277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:07.361277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:07.361277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:07.361277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:07.361277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:07.361277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:07.361277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:07.361277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:07.361277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:07.361277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:07.361277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:07.361277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:07.361277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:07.362313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:07.362313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:07.362313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:07.362313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:07.362313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:07.362313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:07.362313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:07.362313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:07.362313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 329/644] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:07.362313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9e9f8-c020-46b8-8258-9cc6bb07006b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:07.401279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:07.412533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:07.424043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faebeda-97a8-41e9-8954-89082c7a7bf7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:07.460438 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257044b-dea4-4603-83e9-857d6f8aed20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:07.461805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257044b-dea4-4603-83e9-857d6f8aed20 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:07.462095 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257044b-dea4-4603-83e9-857d6f8aed20 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:07.462371 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257044b-dea4-4603-83e9-857d6f8aed20 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:07.466324 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9e9f8-c020-46b8-8258-9cc6bb07006b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:07.470415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257044b-dea4-4603-83e9-857d6f8aed20 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:07.471959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257044b-dea4-4603-83e9-857d6f8aed20 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:07.487007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-4257044b-dea4-4603-83e9-857d6f8aed20 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 10:57:07.487007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:07.487007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:07.487007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:07.487007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:07.487007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:07.487007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:07.487007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:07.487007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:07.487007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:07.487007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:07.487007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:07.487007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:07.487007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:07.487007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:07.487007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:07.487967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:07.488954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:07.488954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:07.488954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:07.488954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:07.488954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:07.488954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:07.488954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:07.488954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:07.488954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 10:57:07.488954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:07.488954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 316/645] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:57:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:07.488954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257044b-dea4-4603-83e9-857d6f8aed20 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:07.508927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5f8d9-9b5d-49ea-b2e9-7b34da61c625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:07.509830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5f8d9-9b5d-49ea-b2e9-7b34da61c625 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:07.510114 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5f8d9-9b5d-49ea-b2e9-7b34da61c625 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:07.510388 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5f8d9-9b5d-49ea-b2e9-7b34da61c625 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:07.511397 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5f8d9-9b5d-49ea-b2e9-7b34da61c625 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:07.511699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5f8d9-9b5d-49ea-b2e9-7b34da61c625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:07.513517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5f8d9-9b5d-49ea-b2e9-7b34da61c625 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:07.522172 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 330/646] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:57:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:07.522950 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5f8d9-9b5d-49ea-b2e9-7b34da61c625 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:07.600364 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257044b-dea4-4603-83e9-857d6f8aed20 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:07.624584 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5f8d9-9b5d-49ea-b2e9-7b34da61c625 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:07.631348 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:07.636666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5fcb7-445b-4516-8b14-a713f3250abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:07.637334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5fcb7-445b-4516-8b14-a713f3250abb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:07.637646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5fcb7-445b-4516-8b14-a713f3250abb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:07.637924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5fcb7-445b-4516-8b14-a713f3250abb None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:07.638683 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5fcb7-445b-4516-8b14-a713f3250abb None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:07.638977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5fcb7-445b-4516-8b14-a713f3250abb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:07.640339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5fcb7-445b-4516-8b14-a713f3250abb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:07.648287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 317/647] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:57:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:07.649098 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5fcb7-445b-4516-8b14-a713f3250abb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:07.651608 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:07.668260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddd613-a74f-461c-ac51-1106f6780af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:07.669070 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddd613-a74f-461c-ac51-1106f6780af9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:07.669662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddd613-a74f-461c-ac51-1106f6780af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:07.669942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddd613-a74f-461c-ac51-1106f6780af9 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:07.670732 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddd613-a74f-461c-ac51-1106f6780af9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:07.671113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddd613-a74f-461c-ac51-1106f6780af9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:07.672957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddd613-a74f-461c-ac51-1106f6780af9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:07.693734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 331/648] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:07.693734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddd613-a74f-461c-ac51-1106f6780af9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:07.751282 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5fcb7-445b-4516-8b14-a713f3250abb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:07.789708 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23640f-8c8d-4912-b0c5-205a5a310e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:07.790379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23640f-8c8d-4912-b0c5-205a5a310e5c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:07.790668 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23640f-8c8d-4912-b0c5-205a5a310e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:07.790952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23640f-8c8d-4912-b0c5-205a5a310e5c None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:07.791792 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23640f-8c8d-4912-b0c5-205a5a310e5c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:07.792102 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23640f-8c8d-4912-b0c5-205a5a310e5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:07.793557 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23640f-8c8d-4912-b0c5-205a5a310e5c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:07.798926 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddd613-a74f-461c-ac51-1106f6780af9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:07.816694 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 318/649] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jun 27 10:57:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:07.816694 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23640f-8c8d-4912-b0c5-205a5a310e5c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:07.842286 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2414df1-df58-424b-b0ac-fc16005fc874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:07.843079 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2414df1-df58-424b-b0ac-fc16005fc874 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:07.843360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2414df1-df58-424b-b0ac-fc16005fc874 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:07.843635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2414df1-df58-424b-b0ac-fc16005fc874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:07.854067 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2414df1-df58-424b-b0ac-fc16005fc874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:07.855480 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2414df1-df58-424b-b0ac-fc16005fc874 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:07.873482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-c2414df1-df58-424b-b0ac-fc16005fc874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:07.873482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:07.873482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:07.873482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:07.873482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:07.873482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:07.873482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:07.873482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:07.873482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:07.873482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:07.873482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:07.873482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:07.873482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:07.873482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:07.873482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:07.874425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:07.874425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:07.874425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:07.874425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:07.874425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:07.874425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:07.874425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:07.874425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:07.874425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:07.874425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:07.874425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:07.874425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:07.874425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:07.874425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:07.874425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:07.874425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:07.874425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:07.875353 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:07.875353 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:07.875353 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:07.875353 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:07.875353 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 332/650] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:07.875642 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2414df1-df58-424b-b0ac-fc16005fc874 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:07.891690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:07.897784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:07.940951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23640f-8c8d-4912-b0c5-205a5a310e5c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:07.977241 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d31c01-90ec-4f6f-b472-443411b052c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:07.978210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d31c01-90ec-4f6f-b472-443411b052c5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:07.978573 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d31c01-90ec-4f6f-b472-443411b052c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:07.978850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d31c01-90ec-4f6f-b472-443411b052c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:07.983899 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2414df1-df58-424b-b0ac-fc16005fc874 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:07.989133 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d31c01-90ec-4f6f-b472-443411b052c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:07.990604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d31c01-90ec-4f6f-b472-443411b052c5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:08.009853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-54d31c01-90ec-4f6f-b472-443411b052c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:08.009853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:08.009853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:08.009853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:08.009853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:08.009853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:08.009853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:08.009853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:08.009853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:08.009853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:08.009853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:08.009853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:08.009853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:08.009853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:08.009853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:08.010808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:08.010808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:08.010808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:08.010808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:08.010808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:08.010808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:08.010808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:08.010808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:08.010808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:08.010808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:08.010808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:08.010808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:08.010808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:08.010808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:08.010808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:08.010808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:08.010808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:08.011997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:08.011997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:08.011997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:08.011997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:08.011997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 319/651] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:08.012306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d31c01-90ec-4f6f-b472-443411b052c5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:08.021603 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a60cb-3abb-42d5-ab04-49a431a1e750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:08.022257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a60cb-3abb-42d5-ab04-49a431a1e750 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:08.022539 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a60cb-3abb-42d5-ab04-49a431a1e750 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:08.022816 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a60cb-3abb-42d5-ab04-49a431a1e750 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:08.023672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a60cb-3abb-42d5-ab04-49a431a1e750 None admin] RBAC: Adding query filter params (role.id=e053e0425eb744e2a3e3316222e208f3, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=ed08c367a3d34207a51914ff77a93898) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:08.023985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a60cb-3abb-42d5-ab04-49a431a1e750 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:08.025423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a60cb-3abb-42d5-ab04-49a431a1e750 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:08.031909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 333/652] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:57:07 2022] GET /identity/v3/role_assignments?user.id=ed08c367a3d34207a51914ff77a93898&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=e053e0425eb744e2a3e3316222e208f3 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:08.032622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a60cb-3abb-42d5-ab04-49a431a1e750 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:08.129297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:08.150402 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a60cb-3abb-42d5-ab04-49a431a1e750 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:08.169577 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d31c01-90ec-4f6f-b472-443411b052c5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:08.185086 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:08.213244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6808be-8fdd-4b36-919f-4a40d0eab7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:08.214861 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6808be-8fdd-4b36-919f-4a40d0eab7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:08.214861 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6808be-8fdd-4b36-919f-4a40d0eab7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:08.214861 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6808be-8fdd-4b36-919f-4a40d0eab7f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:08.215650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6808be-8fdd-4b36-919f-4a40d0eab7f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:08.216038 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6808be-8fdd-4b36-919f-4a40d0eab7f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:08.217512 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6808be-8fdd-4b36-919f-4a40d0eab7f4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:08.221438 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d56fda-e59b-4436-9f9a-998ae21b59f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:08.222321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d56fda-e59b-4436-9f9a-998ae21b59f2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:08.222788 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d56fda-e59b-4436-9f9a-998ae21b59f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:08.223255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d56fda-e59b-4436-9f9a-998ae21b59f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:08.231192 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 334/653] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:08.231842 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6808be-8fdd-4b36-919f-4a40d0eab7f4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:08.308133 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d56fda-e59b-4436-9f9a-998ae21b59f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:08.310214 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d56fda-e59b-4436-9f9a-998ae21b59f2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:08.353149 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6808be-8fdd-4b36-919f-4a40d0eab7f4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:08.397451 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d8d98-1b6d-45ed-ade0-76bb5760af32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:08.398031 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d8d98-1b6d-45ed-ade0-76bb5760af32 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:08.398469 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d8d98-1b6d-45ed-ade0-76bb5760af32 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:08.399379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d8d98-1b6d-45ed-ade0-76bb5760af32 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:08.400114 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d8d98-1b6d-45ed-ade0-76bb5760af32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:08.400419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d8d98-1b6d-45ed-ade0-76bb5760af32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:08.402978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d8d98-1b6d-45ed-ade0-76bb5760af32 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:08.420043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 335/654] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:08.421011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d8d98-1b6d-45ed-ade0-76bb5760af32 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:08.424566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:08.443905 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 320/655] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:57:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:57:08.445522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d56fda-e59b-4436-9f9a-998ae21b59f2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:08.463093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:08.540987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d8d98-1b6d-45ed-ade0-76bb5760af32 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:08.552387 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d56fda-e59b-4436-9f9a-998ae21b59f2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:08.579911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51fe95-7f10-49d8-a563-81e320e18c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:08.581011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51fe95-7f10-49d8-a563-81e320e18c4f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:08.581527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51fe95-7f10-49d8-a563-81e320e18c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:08.582087 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51fe95-7f10-49d8-a563-81e320e18c4f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:08.588170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374409d-6a1f-47e5-9b29-ac8ec5f7bc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:08.589100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374409d-6a1f-47e5-9b29-ac8ec5f7bc8f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:08.589498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374409d-6a1f-47e5-9b29-ac8ec5f7bc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:08.589835 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374409d-6a1f-47e5-9b29-ac8ec5f7bc8f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:08.592210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51fe95-7f10-49d8-a563-81e320e18c4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:08.593941 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51fe95-7f10-49d8-a563-81e320e18c4f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:08.597402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374409d-6a1f-47e5-9b29-ac8ec5f7bc8f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:08.598851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374409d-6a1f-47e5-9b29-ac8ec5f7bc8f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:08.610474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-2d51fe95-7f10-49d8-a563-81e320e18c4f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 27 10:57:08.610474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:08.610474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:08.610474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:08.610474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:08.610474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:08.610474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:08.610474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:08.610474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:08.610474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:08.610474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:08.610474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:08.610474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:08.610474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:08.610474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:08.610474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:08.611440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:08.612373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:08.612373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:08.612373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:08.612373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:08.612373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:08.612373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:08.612373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:08.612373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:08.612373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 27 10:57:08.612373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:08.614180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-7374409d-6a1f-47e5-9b29-ac8ec5f7bc8f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 10:57:08.614180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:08.614180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:08.614180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:08.614180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:08.614180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:08.614180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:08.614180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:08.614180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:08.614180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:08.614180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:08.614180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:08.614180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:08.614180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:08.614180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:08.614180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:08.615070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:08.616569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:08.616569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:08.616569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:08.616569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:08.616569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:08.616569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:08.616569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:08.616569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:08.616569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 10:57:08.616569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:08.616569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 321/656] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:57:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:08.616569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374409d-6a1f-47e5-9b29-ac8ec5f7bc8f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:08.622730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 336/657] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:57:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:08.623888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51fe95-7f10-49d8-a563-81e320e18c4f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:08.694315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:08.705682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:08.734400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374409d-6a1f-47e5-9b29-ac8ec5f7bc8f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:08.761440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51fe95-7f10-49d8-a563-81e320e18c4f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:08.776580 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c6aa1-735b-4b31-9ec5-7c72ea8ae664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:08.777387 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c6aa1-735b-4b31-9ec5-7c72ea8ae664 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:08.777667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c6aa1-735b-4b31-9ec5-7c72ea8ae664 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:08.777937 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c6aa1-735b-4b31-9ec5-7c72ea8ae664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:08.788491 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c6aa1-735b-4b31-9ec5-7c72ea8ae664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:08.790017 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c6aa1-735b-4b31-9ec5-7c72ea8ae664 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:08.795688 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8e605-6c55-47c8-a1cd-3ac0ea1f44ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:08.796345 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8e605-6c55-47c8-a1cd-3ac0ea1f44ec None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:08.796620 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8e605-6c55-47c8-a1cd-3ac0ea1f44ec None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:08.797140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8e605-6c55-47c8-a1cd-3ac0ea1f44ec None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:08.797735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8e605-6c55-47c8-a1cd-3ac0ea1f44ec None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:08.798045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8e605-6c55-47c8-a1cd-3ac0ea1f44ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:08.799456 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8e605-6c55-47c8-a1cd-3ac0ea1f44ec None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:08.807856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-742c6aa1-735b-4b31-9ec5-7c72ea8ae664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:08.807856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:08.807856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:08.807856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:08.807856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:08.807856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:08.807856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:08.807856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:08.807856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:08.807856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:08.807856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:08.807856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:08.807856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:08.807856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:08.807856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:08.808735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:08.808735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:08.808735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:08.808735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:08.808735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:08.808735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:08.808735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:08.808735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:08.808735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:08.808735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:08.808735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:08.808735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:08.808735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:08.808735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:08.808735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:08.808735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:08.808735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:08.809666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:08.809666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:08.809666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:08.809666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:08.813536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 322/658] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:08.814262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c6aa1-735b-4b31-9ec5-7c72ea8ae664 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:08.826022 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 337/659] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Jun 27 10:57:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:08.826022 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f86458-1ee3-4746-8ab5-0b0b375d5d76 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:08.826022 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f86458-1ee3-4746-8ab5-0b0b375d5d76 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:08.826022 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f86458-1ee3-4746-8ab5-0b0b375d5d76 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:08.826022 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 338/660] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:08.826022 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f86458-1ee3-4746-8ab5-0b0b375d5d76 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:08.920979 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c6aa1-735b-4b31-9ec5-7c72ea8ae664 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:08.927606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f86458-1ee3-4746-8ab5-0b0b375d5d76 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:08.944804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:08.948949 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:08.957392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d918142-2629-48b6-838b-0590267c2859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:08.958067 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d918142-2629-48b6-838b-0590267c2859 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:08.958351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d918142-2629-48b6-838b-0590267c2859 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:08.958632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d918142-2629-48b6-838b-0590267c2859 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:08.959468 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d918142-2629-48b6-838b-0590267c2859 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:08.959829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d918142-2629-48b6-838b-0590267c2859 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:08.961764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d918142-2629-48b6-838b-0590267c2859 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:08.965787 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713783e-1156-41ff-8b4d-3c37cff69b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:08.966441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713783e-1156-41ff-8b4d-3c37cff69b48 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:08.966719 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713783e-1156-41ff-8b4d-3c37cff69b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:08.966991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713783e-1156-41ff-8b4d-3c37cff69b48 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:08.967695 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713783e-1156-41ff-8b4d-3c37cff69b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:08.967996 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713783e-1156-41ff-8b4d-3c37cff69b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:08.969330 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713783e-1156-41ff-8b4d-3c37cff69b48 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:08.979977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 323/661] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jun 27 10:57:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:08.980494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 339/662] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:08.985761 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d918142-2629-48b6-838b-0590267c2859 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:08.986167 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81b53e-6d0b-4ff1-a287-9db3fad33b98 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:08.986362 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81b53e-6d0b-4ff1-a287-9db3fad33b98 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:08.986694 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81b53e-6d0b-4ff1-a287-9db3fad33b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:09.002503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3d81b53e-6d0b-4ff1-a287-9db3fad33b98 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:09.003674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3d81b53e-6d0b-4ff1-a287-9db3fad33b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:09.081416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 340/663] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:57:09.081416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81b53e-6d0b-4ff1-a287-9db3fad33b98 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:09.094239 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d918142-2629-48b6-838b-0590267c2859 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:09.128845 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03177876-0336-4f58-a5ea-40ceade3a942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:09.129509 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03177876-0336-4f58-a5ea-40ceade3a942 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:09.129790 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03177876-0336-4f58-a5ea-40ceade3a942 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:09.130061 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03177876-0336-4f58-a5ea-40ceade3a942 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:09.186970 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:09.195405 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81b53e-6d0b-4ff1-a287-9db3fad33b98 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:09.208957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:09.210266 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03177876-0336-4f58-a5ea-40ceade3a942 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:09.211739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03177876-0336-4f58-a5ea-40ceade3a942 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:09.234387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fda699-6ecf-48ff-9cc9-906efbfaaf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:09.235479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fda699-6ecf-48ff-9cc9-906efbfaaf85 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:09.236050 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fda699-6ecf-48ff-9cc9-906efbfaaf85 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:09.236639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fda699-6ecf-48ff-9cc9-906efbfaaf85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:09.247442 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fda699-6ecf-48ff-9cc9-906efbfaaf85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:09.248988 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fda699-6ecf-48ff-9cc9-906efbfaaf85 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:09.266440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-23fda699-6ecf-48ff-9cc9-906efbfaaf85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:09.266440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:09.266440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:09.266440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:09.266440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:09.266440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:09.266440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:09.266440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:09.266440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:09.266440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:09.266440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:09.266440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:09.266440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:09.266440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:09.266440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:09.267336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:09.267336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:09.267336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:09.267336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:09.267336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:09.267336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:09.267336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:09.267336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:09.267336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:09.267336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:09.267336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:09.267336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:09.267336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:09.267336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:09.267336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:09.267336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:09.267336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:09.268245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:09.268245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:09.268245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:09.268245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:09.268245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:09.268245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:09.268245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:09.268245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:09.268245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 341/664] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:09.268737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fda699-6ecf-48ff-9cc9-906efbfaaf85 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:09.325995 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 324/665] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:57:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:57:09.327200 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03177876-0336-4f58-a5ea-40ceade3a942 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:09.386190 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fda699-6ecf-48ff-9cc9-906efbfaaf85 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:09.420180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17b736-67b0-4b7e-8d76-b8944db12712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:09.420724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17b736-67b0-4b7e-8d76-b8944db12712 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:09.421009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17b736-67b0-4b7e-8d76-b8944db12712 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:09.421293 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17b736-67b0-4b7e-8d76-b8944db12712 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:09.421897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:09.443039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03177876-0336-4f58-a5ea-40ceade3a942 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:09.462493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:09.480918 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135b5ef-4055-4244-8558-1baa95c19daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:09.482212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135b5ef-4055-4244-8558-1baa95c19daf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:09.482950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135b5ef-4055-4244-8558-1baa95c19daf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:09.483874 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135b5ef-4055-4244-8558-1baa95c19daf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:09.493262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17b736-67b0-4b7e-8d76-b8944db12712 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:09.494741 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17b736-67b0-4b7e-8d76-b8944db12712 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:09.496423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135b5ef-4055-4244-8558-1baa95c19daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:09.504148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-1135b5ef-4055-4244-8558-1baa95c19daf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:09.504148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:09.504148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:09.504148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:09.504148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:09.504148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:09.504148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:09.504148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:09.504148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:09.504148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:09.504148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:09.504148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:09.504148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:09.504148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:09.504148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:09.504148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:09.505058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:09.505058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:09.505058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:09.505058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:09.505058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:09.505058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:09.505058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:09.505058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:09.505058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:09.505058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:09.505058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:09.505058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:09.505058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:09.505058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:09.505058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:09.505058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:09.510457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:09.510457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:09.510457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:09.510457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:09.510457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:09.510457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:09.510457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:09.510457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:09.510457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:09.510457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:09.510457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:09.510457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:09.510457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 325/666] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:57:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:09.510457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135b5ef-4055-4244-8558-1baa95c19daf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:09.606735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 342/667] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:57:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:57:09.607862 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17b736-67b0-4b7e-8d76-b8944db12712 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:09.619777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135b5ef-4055-4244-8558-1baa95c19daf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:09.655752 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba6d3e-ca12-4510-b985-e7b085586f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:09.656405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba6d3e-ca12-4510-b985-e7b085586f8e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:09.656687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba6d3e-ca12-4510-b985-e7b085586f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:09.656967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba6d3e-ca12-4510-b985-e7b085586f8e None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:09.657780 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba6d3e-ca12-4510-b985-e7b085586f8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:09.658197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba6d3e-ca12-4510-b985-e7b085586f8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:09.659751 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba6d3e-ca12-4510-b985-e7b085586f8e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:09.678114 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 326/668] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:09.678114 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba6d3e-ca12-4510-b985-e7b085586f8e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:09.678114 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:09.684736 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:09.717952 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17b736-67b0-4b7e-8d76-b8944db12712 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:09.754652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80851a9-b72b-4467-a668-f77cf1ad1f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:09.755431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80851a9-b72b-4467-a668-f77cf1ad1f7a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:09.755709 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80851a9-b72b-4467-a668-f77cf1ad1f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:09.755981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80851a9-b72b-4467-a668-f77cf1ad1f7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:09.766888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80851a9-b72b-4467-a668-f77cf1ad1f7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:09.768317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80851a9-b72b-4467-a668-f77cf1ad1f7a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:09.781856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba6d3e-ca12-4510-b985-e7b085586f8e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:09.785875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-e80851a9-b72b-4467-a668-f77cf1ad1f7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:09.785875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:09.785875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:09.785875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:09.785875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:09.785875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:09.785875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:09.785875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:09.785875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:09.785875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:09.785875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:09.785875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:09.785875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:09.785875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:09.785875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:09.786746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:09.786746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:09.786746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:09.786746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:09.786746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:09.786746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:09.786746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:09.786746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:09.786746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:09.786746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:09.786746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:09.786746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:09.786746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:09.786746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:09.786746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:09.786746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:09.786746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:09.787652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:09.787652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:09.787652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:09.787652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:09.792398 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 343/669] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:09.792690 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80851a9-b72b-4467-a668-f77cf1ad1f7a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:09.818957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7bfb1-4e65-4b76-8c77-831b49df62ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:09.819625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7bfb1-4e65-4b76-8c77-831b49df62ad None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:09.819908 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7bfb1-4e65-4b76-8c77-831b49df62ad None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:09.820183 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7bfb1-4e65-4b76-8c77-831b49df62ad None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:09.820965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7bfb1-4e65-4b76-8c77-831b49df62ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:09.821446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7bfb1-4e65-4b76-8c77-831b49df62ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:09.822666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7bfb1-4e65-4b76-8c77-831b49df62ad None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:09.831752 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 327/670] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:57:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:09.832472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7bfb1-4e65-4b76-8c77-831b49df62ad None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:09.897759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:09.904069 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80851a9-b72b-4467-a668-f77cf1ad1f7a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:09.928869 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:09.939350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7bfb1-4e65-4b76-8c77-831b49df62ad None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:09.943066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf7091-7e15-48f6-a2dc-252234b1f2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:09.943853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf7091-7e15-48f6-a2dc-252234b1f2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:09.944138 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf7091-7e15-48f6-a2dc-252234b1f2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:09.944413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf7091-7e15-48f6-a2dc-252234b1f2e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:09.956430 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf7091-7e15-48f6-a2dc-252234b1f2e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:09.957910 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf7091-7e15-48f6-a2dc-252234b1f2e7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:09.973289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b497c52-05b1-4fb3-a755-39a7412ea8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:09.973945 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b497c52-05b1-4fb3-a755-39a7412ea8cd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:09.974226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b497c52-05b1-4fb3-a755-39a7412ea8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:09.974502 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b497c52-05b1-4fb3-a755-39a7412ea8cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:09.975329 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b497c52-05b1-4fb3-a755-39a7412ea8cd None admin] RBAC: Adding query filter params (role.id=e053e0425eb744e2a3e3316222e208f3, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=521f3fcc63524d2d82b4a05a0dc062f0) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:09.975636 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b497c52-05b1-4fb3-a755-39a7412ea8cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:09.976640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-5dbf7091-7e15-48f6-a2dc-252234b1f2e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:09.976640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:09.976640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:09.976640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:09.976640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:09.976640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:09.976640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:09.976640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:09.976640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:09.976640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:09.976640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:09.976640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:09.976640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:09.976640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:09.976640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:09.978124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:09.978124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:09.978124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:09.978124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:09.978124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:09.978124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:09.978124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:09.978124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:09.978124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:09.978124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:09.978124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:09.978124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:09.978124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:09.978124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:09.978124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:09.978124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:09.978124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:09.979048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:09.979048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:09.979048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:09.979048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:09.979290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b497c52-05b1-4fb3-a755-39a7412ea8cd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:09.979359 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 344/671] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:09.979837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf7091-7e15-48f6-a2dc-252234b1f2e7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:09.997870 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 328/672] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:57:09 2022] GET /identity/v3/role_assignments?user.id=521f3fcc63524d2d82b4a05a0dc062f0&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=e053e0425eb744e2a3e3316222e208f3 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:09.999859 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b497c52-05b1-4fb3-a755-39a7412ea8cd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:10.118157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf7091-7e15-48f6-a2dc-252234b1f2e7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:10.126068 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b497c52-05b1-4fb3-a755-39a7412ea8cd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:10.158474 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:10.171730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c96c4c-dc18-44b2-8251-e0b9cd5638f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:10.172398 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c96c4c-dc18-44b2-8251-e0b9cd5638f6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:10.172680 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c96c4c-dc18-44b2-8251-e0b9cd5638f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:10.172954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c96c4c-dc18-44b2-8251-e0b9cd5638f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:10.173731 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c96c4c-dc18-44b2-8251-e0b9cd5638f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:10.174030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c96c4c-dc18-44b2-8251-e0b9cd5638f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:10.175387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c96c4c-dc18-44b2-8251-e0b9cd5638f6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:10.175507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932031a-ee50-4a18-8ff3-3dbb0ec1ade1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:10.176225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932031a-ee50-4a18-8ff3-3dbb0ec1ade1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:10.176513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932031a-ee50-4a18-8ff3-3dbb0ec1ade1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:10.176791 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932031a-ee50-4a18-8ff3-3dbb0ec1ade1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:10.189130 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932031a-ee50-4a18-8ff3-3dbb0ec1ade1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:10.189951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932031a-ee50-4a18-8ff3-3dbb0ec1ade1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:10.192785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 345/673] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:10.193686 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c96c4c-dc18-44b2-8251-e0b9cd5638f6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:10.214046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b932031a-ee50-4a18-8ff3-3dbb0ec1ade1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:10.214046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:10.214046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:10.214046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:10.214046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:10.214046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:10.214046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:10.214046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:10.214046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:10.214046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:10.214046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:10.214046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:10.214046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:10.214046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:10.214046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:10.214952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:10.214952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:10.214952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:10.214952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:10.214952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:10.214952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:10.214952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:10.214952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:10.214952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:10.214952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:10.214952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:10.214952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:10.214952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:10.214952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:10.214952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:10.214952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:10.214952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:10.215850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:10.215850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:10.215850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:10.215850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:10.215850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 329/674] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:10.216532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932031a-ee50-4a18-8ff3-3dbb0ec1ade1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:10.238751 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:10.309920 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c96c4c-dc18-44b2-8251-e0b9cd5638f6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:10.321981 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932031a-ee50-4a18-8ff3-3dbb0ec1ade1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:10.345705 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55461ab9-b0cb-494d-acbb-d32a0829397d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:10.346361 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55461ab9-b0cb-494d-acbb-d32a0829397d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:10.346643 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55461ab9-b0cb-494d-acbb-d32a0829397d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:10.346941 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55461ab9-b0cb-494d-acbb-d32a0829397d None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:10.347613 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55461ab9-b0cb-494d-acbb-d32a0829397d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:10.347914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55461ab9-b0cb-494d-acbb-d32a0829397d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:10.349420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55461ab9-b0cb-494d-acbb-d32a0829397d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:10.356852 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7c108-2210-415a-bd2e-d7211d16f093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:10.357676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7c108-2210-415a-bd2e-d7211d16f093 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:10.357963 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7c108-2210-415a-bd2e-d7211d16f093 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:10.358237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7c108-2210-415a-bd2e-d7211d16f093 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:10.366043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 346/675] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:10.366043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de48976-2bd0-4acc-8fe3-b4483cbcf010 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:10.366043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de48976-2bd0-4acc-8fe3-b4483cbcf010 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:10.366043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de48976-2bd0-4acc-8fe3-b4483cbcf010 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:10.366043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 347/676] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:10.366043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de48976-2bd0-4acc-8fe3-b4483cbcf010 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:10.369878 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7c108-2210-415a-bd2e-d7211d16f093 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:10.371360 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7c108-2210-415a-bd2e-d7211d16f093 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:10.386811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e4d7c108-2210-415a-bd2e-d7211d16f093 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:10.386811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:10.386811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:10.386811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:10.386811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:10.386811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:10.386811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:10.386811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:10.386811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:10.386811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:10.386811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:10.386811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:10.386811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:10.386811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:10.386811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:10.387714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:10.387714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:10.387714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:10.387714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:10.387714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:10.387714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:10.387714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:10.387714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:10.387714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:10.387714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:10.387714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:10.387714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:10.387714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:10.387714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:10.387714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:10.387714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:10.387714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:10.388618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:10.388618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:10.388618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:10.388618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:10.388618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:10.388618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:10.388618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:10.388618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:10.392634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 330/677] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:10.393494 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7c108-2210-415a-bd2e-d7211d16f093 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:10.436613 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:10.468315 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:10.476584 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de48976-2bd0-4acc-8fe3-b4483cbcf010 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:10.498279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7c108-2210-415a-bd2e-d7211d16f093 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:10.512883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4f8b2-1375-4896-83b2-7de7c4df66fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:10.513574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4f8b2-1375-4896-83b2-7de7c4df66fe None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:10.513859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4f8b2-1375-4896-83b2-7de7c4df66fe None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:10.514136 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4f8b2-1375-4896-83b2-7de7c4df66fe None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:10.514855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4f8b2-1375-4896-83b2-7de7c4df66fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:10.515158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4f8b2-1375-4896-83b2-7de7c4df66fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:10.516517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4f8b2-1375-4896-83b2-7de7c4df66fe None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:10.529447 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 348/678] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:10.531008 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec26a68-0c64-4346-81e8-3390362e8363 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:10.531305 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec26a68-0c64-4346-81e8-3390362e8363 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:10.531585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec26a68-0c64-4346-81e8-3390362e8363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:10.541350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c28b9a-9a4d-48e3-accd-dd32a7d929dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:10.542164 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c28b9a-9a4d-48e3-accd-dd32a7d929dd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:10.542448 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c28b9a-9a4d-48e3-accd-dd32a7d929dd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:10.543139 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c28b9a-9a4d-48e3-accd-dd32a7d929dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:10.547886 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-fec26a68-0c64-4346-81e8-3390362e8363 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:10.549069 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fec26a68-0c64-4346-81e8-3390362e8363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:10.550488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c28b9a-9a4d-48e3-accd-dd32a7d929dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:10.552894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c28b9a-9a4d-48e3-accd-dd32a7d929dd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:10.570321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-50c28b9a-9a4d-48e3-accd-dd32a7d929dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:10.570321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:10.570321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:10.570321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:10.570321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:10.570321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:10.570321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:10.570321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:10.570321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:10.570321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:10.570321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:10.570321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:10.570321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:10.570321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:10.570321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:10.571776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:10.571776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:10.571776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:10.571776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:10.571776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:10.571776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:10.571776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:10.571776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:10.571776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:10.571776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:10.571776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:10.571776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:10.571776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:10.571776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:10.571776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:10.571776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:10.571776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:10.572652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:10.572652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:10.572652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:10.572652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:10.572652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:10.572652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:10.572652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:10.572652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:10.573077 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 331/679] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:10.573750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c28b9a-9a4d-48e3-accd-dd32a7d929dd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:10.623346 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 349/680] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:57:10.624169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec26a68-0c64-4346-81e8-3390362e8363 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:10.687083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:10.690862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c28b9a-9a4d-48e3-accd-dd32a7d929dd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:10.730526 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5666a-124e-4b1c-9e43-43776abc6725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:10.731187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5666a-124e-4b1c-9e43-43776abc6725 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:10.731471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5666a-124e-4b1c-9e43-43776abc6725 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:10.731747 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5666a-124e-4b1c-9e43-43776abc6725 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:10.732537 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5666a-124e-4b1c-9e43-43776abc6725 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:10.732848 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5666a-124e-4b1c-9e43-43776abc6725 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:10.734082 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:10.734536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5666a-124e-4b1c-9e43-43776abc6725 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:10.747178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 332/681] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:10.748032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5666a-124e-4b1c-9e43-43776abc6725 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:10.756178 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec26a68-0c64-4346-81e8-3390362e8363 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:10.800375 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b14172-327d-448b-a98f-a79319f9a18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:10.801540 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b14172-327d-448b-a98f-a79319f9a18b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:10.801971 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b14172-327d-448b-a98f-a79319f9a18b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:10.802391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b14172-327d-448b-a98f-a79319f9a18b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:10.810582 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b14172-327d-448b-a98f-a79319f9a18b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:10.812206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b14172-327d-448b-a98f-a79319f9a18b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:10.828045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-24b14172-327d-448b-a98f-a79319f9a18b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 10:57:10.828045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:10.828045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:10.828045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:10.828045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:10.828045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:10.828045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:10.828045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:10.828045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:10.828045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:10.828045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:10.828045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:10.828045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:10.828045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:10.828045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:10.828045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:10.829146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:10.830242 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:10.830242 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:10.830242 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:10.830242 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:10.830242 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:10.830242 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:10.830242 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:10.830242 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:10.830242 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 10:57:10.830242 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:10.835811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 350/682] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:57:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:10.835811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b14172-327d-448b-a98f-a79319f9a18b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:10.855323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5666a-124e-4b1c-9e43-43776abc6725 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:10.898192 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d836a4-48d8-4eaf-9a02-e4ddf5fc7949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:10.899303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d836a4-48d8-4eaf-9a02-e4ddf5fc7949 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:10.900091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d836a4-48d8-4eaf-9a02-e4ddf5fc7949 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:10.900807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d836a4-48d8-4eaf-9a02-e4ddf5fc7949 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:10.901823 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d836a4-48d8-4eaf-9a02-e4ddf5fc7949 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:10.902390 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d836a4-48d8-4eaf-9a02-e4ddf5fc7949 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:10.904659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d836a4-48d8-4eaf-9a02-e4ddf5fc7949 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:10.921143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 333/683] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:10.922545 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d836a4-48d8-4eaf-9a02-e4ddf5fc7949 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:10.937674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b14172-327d-448b-a98f-a79319f9a18b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:10.947893 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:10.974204 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c54e0f-1a5a-4eb6-b337-0cf7f89bc7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:10.974986 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c54e0f-1a5a-4eb6-b337-0cf7f89bc7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:10.975268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c54e0f-1a5a-4eb6-b337-0cf7f89bc7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:10.975540 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c54e0f-1a5a-4eb6-b337-0cf7f89bc7b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:10.986341 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c54e0f-1a5a-4eb6-b337-0cf7f89bc7b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:10.994438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-c8c54e0f-1a5a-4eb6-b337-0cf7f89bc7b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:57:10.994438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:10.994438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:10.994438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:10.994438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:10.994438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:10.994438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:10.994438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:10.994438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:10.994438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:10.994438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:10.994438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:10.994438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:10.994438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:10.994438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:10.994438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:10.995379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:10.995379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:10.995379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:10.995379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:10.995379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:10.995379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:10.995379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:10.995379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:10.995379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:10.995379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:10.995379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:10.995379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:10.995379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:10.995379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:10.995379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:10.995379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:10.996273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:10.996273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:10.996273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:10.996273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:10.996273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:10.996273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:10.996273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:10.996273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:10.996273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:10.996273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:10.996273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:57:10.996273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:10.996273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 351/684] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:57:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:10.997574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c54e0f-1a5a-4eb6-b337-0cf7f89bc7b4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:11.001009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:11.033737 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d836a4-48d8-4eaf-9a02-e4ddf5fc7949 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:11.067498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4125071-9a86-4fdf-8c70-4305645ad68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:11.068189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4125071-9a86-4fdf-8c70-4305645ad68d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:11.068424 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4125071-9a86-4fdf-8c70-4305645ad68d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:11.068697 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4125071-9a86-4fdf-8c70-4305645ad68d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:11.069554 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4125071-9a86-4fdf-8c70-4305645ad68d None admin] RBAC: Adding query filter params (role.id=e053e0425eb744e2a3e3316222e208f3, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=cb2d4050a05f4517ab165c74f9e6cae6) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:11.069864 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4125071-9a86-4fdf-8c70-4305645ad68d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:11.071312 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4125071-9a86-4fdf-8c70-4305645ad68d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:11.085396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 334/685] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:57:10 2022] GET /identity/v3/role_assignments?user.id=cb2d4050a05f4517ab165c74f9e6cae6&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=e053e0425eb744e2a3e3316222e208f3 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:11.085396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4125071-9a86-4fdf-8c70-4305645ad68d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:11.115220 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c54e0f-1a5a-4eb6-b337-0cf7f89bc7b4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:11.164988 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959424b-d853-4f67-95da-00d571810d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:11.166447 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959424b-d853-4f67-95da-00d571810d51 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:11.166727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959424b-d853-4f67-95da-00d571810d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:11.167012 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959424b-d853-4f67-95da-00d571810d51 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:11.168150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959424b-d853-4f67-95da-00d571810d51 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:11.168458 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959424b-d853-4f67-95da-00d571810d51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:11.171306 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959424b-d853-4f67-95da-00d571810d51 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:11.199269 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 352/686] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Jun 27 10:57:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:11.200149 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959424b-d853-4f67-95da-00d571810d51 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:11.200262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:11.221800 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4125071-9a86-4fdf-8c70-4305645ad68d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:11.274429 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682791a-51c6-4257-ac17-b549fba3ad16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:11.275094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682791a-51c6-4257-ac17-b549fba3ad16 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:11.275375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682791a-51c6-4257-ac17-b549fba3ad16 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:11.275646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682791a-51c6-4257-ac17-b549fba3ad16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:11.276954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682791a-51c6-4257-ac17-b549fba3ad16 None admin] RBAC: Adding query filter params (role.id=e053e0425eb744e2a3e3316222e208f3, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=49b6436fdd7a4977a2e02c0e1b8be2c7) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:11.277274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682791a-51c6-4257-ac17-b549fba3ad16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:11.278840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:11.279154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682791a-51c6-4257-ac17-b549fba3ad16 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:11.293515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 335/687] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:57:11 2022] GET /identity/v3/role_assignments?user.id=49b6436fdd7a4977a2e02c0e1b8be2c7&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=e053e0425eb744e2a3e3316222e208f3 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:11.293515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682791a-51c6-4257-ac17-b549fba3ad16 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:11.335025 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959424b-d853-4f67-95da-00d571810d51 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:11.389955 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e62b92-8b6b-4e89-8544-eff2c9947159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:11.394221 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e62b92-8b6b-4e89-8544-eff2c9947159 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:11.394588 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e62b92-8b6b-4e89-8544-eff2c9947159 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:11.394942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e62b92-8b6b-4e89-8544-eff2c9947159 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:11.396480 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e62b92-8b6b-4e89-8544-eff2c9947159 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:11.396863 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e62b92-8b6b-4e89-8544-eff2c9947159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:11.398416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e62b92-8b6b-4e89-8544-eff2c9947159 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:11.411533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 353/688] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:57:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:11.417150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e62b92-8b6b-4e89-8544-eff2c9947159 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:11.432682 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682791a-51c6-4257-ac17-b549fba3ad16 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:11.489030 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3695b28-ac5b-49a2-9019-181cfbfe5de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:11.489719 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3695b28-ac5b-49a2-9019-181cfbfe5de8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:11.490010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3695b28-ac5b-49a2-9019-181cfbfe5de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:11.490292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3695b28-ac5b-49a2-9019-181cfbfe5de8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:11.510412 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:11.526733 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e62b92-8b6b-4e89-8544-eff2c9947159 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:11.554199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:11.566688 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba1677-14bb-4eaa-954d-ee4fb1d494c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:11.567755 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba1677-14bb-4eaa-954d-ee4fb1d494c7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:11.568234 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba1677-14bb-4eaa-954d-ee4fb1d494c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:11.568450 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3695b28-ac5b-49a2-9019-181cfbfe5de8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:11.568880 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba1677-14bb-4eaa-954d-ee4fb1d494c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:11.569962 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3695b28-ac5b-49a2-9019-181cfbfe5de8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:11.581758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba1677-14bb-4eaa-954d-ee4fb1d494c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:11.583555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba1677-14bb-4eaa-954d-ee4fb1d494c7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:11.604962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-76ba1677-14bb-4eaa-954d-ee4fb1d494c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:11.604962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:11.604962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:11.604962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:11.604962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:11.604962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:11.604962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:11.604962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:11.604962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:11.604962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:11.604962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:11.604962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:11.604962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:11.604962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:11.604962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:11.605933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:11.605933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:11.605933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:11.605933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:11.605933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:11.605933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:11.605933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:11.605933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:11.605933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:11.605933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:11.605933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:11.605933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:11.605933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:11.605933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:11.605933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:11.605933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:11.605933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:11.606810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:11.606810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:11.606810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:11.606810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:11.609267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 354/689] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:11.614942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba1677-14bb-4eaa-954d-ee4fb1d494c7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:11.684649 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 336/690] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:57:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:57:11.685949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3695b28-ac5b-49a2-9019-181cfbfe5de8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:11.734192 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba1677-14bb-4eaa-954d-ee4fb1d494c7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:11.747999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:11.782760 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93dfa1-d33a-4da4-bb6a-d75eb4819737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:11.783536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93dfa1-d33a-4da4-bb6a-d75eb4819737 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:11.783885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93dfa1-d33a-4da4-bb6a-d75eb4819737 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:11.784233 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93dfa1-d33a-4da4-bb6a-d75eb4819737 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:11.785654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93dfa1-d33a-4da4-bb6a-d75eb4819737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:11.785979 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93dfa1-d33a-4da4-bb6a-d75eb4819737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:11.787367 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93dfa1-d33a-4da4-bb6a-d75eb4819737 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:11.802257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 355/691] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:11.808293 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93dfa1-d33a-4da4-bb6a-d75eb4819737 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:11.823252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3695b28-ac5b-49a2-9019-181cfbfe5de8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:11.854856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:11.869719 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f05f5-178e-4401-8ef0-59b73de44715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:11.872519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f05f5-178e-4401-8ef0-59b73de44715 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:11.873217 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f05f5-178e-4401-8ef0-59b73de44715 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:11.874388 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f05f5-178e-4401-8ef0-59b73de44715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:11.889322 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f05f5-178e-4401-8ef0-59b73de44715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:11.891372 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f05f5-178e-4401-8ef0-59b73de44715 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:11.914103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-423f05f5-178e-4401-8ef0-59b73de44715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:11.914103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:11.914103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:11.914103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:11.914103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:11.914103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:11.914103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:11.914103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:11.914103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:11.914103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:11.914103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:11.914103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:11.914103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:11.914103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:11.914103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:11.915047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:11.915047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:11.915047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:11.915047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:11.915047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:11.915047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:11.915047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:11.915047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:11.915047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:11.915047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:11.915047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:11.915047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:11.915047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:11.915047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:11.915047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:11.915047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:11.915047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:11.916471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:11.916471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:11.916471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:11.916471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:11.916471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 337/692] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:11.921050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f05f5-178e-4401-8ef0-59b73de44715 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:11.944486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93dfa1-d33a-4da4-bb6a-d75eb4819737 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:11.999626 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a7c05-bb10-426a-9708-cbc34722b999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:12.000807 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a7c05-bb10-426a-9708-cbc34722b999 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:12.001878 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a7c05-bb10-426a-9708-cbc34722b999 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:12.002517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a7c05-bb10-426a-9708-cbc34722b999 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:12.023495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a7c05-bb10-426a-9708-cbc34722b999 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:12.025894 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a7c05-bb10-426a-9708-cbc34722b999 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:12.043847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-8d6a7c05-bb10-426a-9708-cbc34722b999 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:57:12.043847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:12.043847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:12.043847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:12.043847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:12.043847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:12.043847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:12.043847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:12.043847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:12.043847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:12.043847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:12.043847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:12.043847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:12.043847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:12.043847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:12.043847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:12.044848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:12.045855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:12.045855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:12.045855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:12.045855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:12.045855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:12.045855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:12.045855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:12.045855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:12.045855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:57:12.045855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:12.058410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 356/693] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jun 27 10:57:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:12.063347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a7c05-bb10-426a-9708-cbc34722b999 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:12.069440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:12.073852 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f05f5-178e-4401-8ef0-59b73de44715 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:12.146151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a8e20-b0e6-44e6-ad25-d3f57df9c433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:12.147366 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a8e20-b0e6-44e6-ad25-d3f57df9c433 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:12.148545 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a8e20-b0e6-44e6-ad25-d3f57df9c433 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:12.149187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a8e20-b0e6-44e6-ad25-d3f57df9c433 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:12.151682 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a8e20-b0e6-44e6-ad25-d3f57df9c433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:12.152722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a8e20-b0e6-44e6-ad25-d3f57df9c433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:12.154573 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a8e20-b0e6-44e6-ad25-d3f57df9c433 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:12.179439 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 338/694] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:12.186378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a8e20-b0e6-44e6-ad25-d3f57df9c433 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:12.242806 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:12.248746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a7c05-bb10-426a-9708-cbc34722b999 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:12.312800 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a8e20-b0e6-44e6-ad25-d3f57df9c433 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:12.336879 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2ba09-4103-4dff-8acb-dda7387de988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:12.337574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2ba09-4103-4dff-8acb-dda7387de988 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:12.337855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2ba09-4103-4dff-8acb-dda7387de988 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:12.338126 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2ba09-4103-4dff-8acb-dda7387de988 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:12.338960 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2ba09-4103-4dff-8acb-dda7387de988 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:12.339261 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2ba09-4103-4dff-8acb-dda7387de988 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:12.340678 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2ba09-4103-4dff-8acb-dda7387de988 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:12.349639 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090fe61-9e75-48f7-8c83-08a363a7773a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:12.354010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090fe61-9e75-48f7-8c83-08a363a7773a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:12.354503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090fe61-9e75-48f7-8c83-08a363a7773a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:12.354785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090fe61-9e75-48f7-8c83-08a363a7773a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:12.370746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090fe61-9e75-48f7-8c83-08a363a7773a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:12.373147 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 357/695] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jun 27 10:57:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:12.374556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090fe61-9e75-48f7-8c83-08a363a7773a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:12.378260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2ba09-4103-4dff-8acb-dda7387de988 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:12.394948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9090fe61-9e75-48f7-8c83-08a363a7773a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:12.394948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:12.394948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:12.394948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:12.394948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:12.394948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:12.394948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:12.394948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:12.394948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:12.394948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:12.394948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:12.394948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:12.394948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:12.394948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:12.394948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:12.395898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:12.395898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:12.395898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:12.395898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:12.395898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:12.395898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:12.395898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:12.395898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:12.395898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:12.395898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:12.395898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:12.395898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:12.395898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:12.395898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:12.395898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:12.395898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:12.395898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:12.396808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:12.396808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:12.396808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:12.396808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:12.396808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:12.396808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:12.396808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:12.396808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:12.396808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 339/696] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:12.401350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd98cc-f5f1-4646-875d-0f9085392ff5 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:12.401350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd98cc-f5f1-4646-875d-0f9085392ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:12.401350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd98cc-f5f1-4646-875d-0f9085392ff5 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:12.401350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 340/697] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:12.404806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd98cc-f5f1-4646-875d-0f9085392ff5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:12.430518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:12.487690 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2ba09-4103-4dff-8acb-dda7387de988 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:12.522558 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e82f03-4df2-43ca-9ffa-1bbeeb841acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:12.522976 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd98cc-f5f1-4646-875d-0f9085392ff5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:12.523203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e82f03-4df2-43ca-9ffa-1bbeeb841acb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:12.523505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e82f03-4df2-43ca-9ffa-1bbeeb841acb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:12.523783 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e82f03-4df2-43ca-9ffa-1bbeeb841acb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:12.547865 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:12.562961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30e503-e07c-448c-a4a4-31a5cd65553a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:12.563600 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30e503-e07c-448c-a4a4-31a5cd65553a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:12.563887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30e503-e07c-448c-a4a4-31a5cd65553a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:12.564286 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30e503-e07c-448c-a4a4-31a5cd65553a None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:12.565076 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30e503-e07c-448c-a4a4-31a5cd65553a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:12.565402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30e503-e07c-448c-a4a4-31a5cd65553a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:12.566968 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30e503-e07c-448c-a4a4-31a5cd65553a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:12.581062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 341/698] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:12.582480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97368664-c8d7-48c6-989d-a1a91173d595 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:12.582770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97368664-c8d7-48c6-989d-a1a91173d595 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:12.583050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97368664-c8d7-48c6-989d-a1a91173d595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:12.597240 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e82f03-4df2-43ca-9ffa-1bbeeb841acb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:12.598713 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e82f03-4df2-43ca-9ffa-1bbeeb841acb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:12.600920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-97368664-c8d7-48c6-989d-a1a91173d595 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:12.602926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-97368664-c8d7-48c6-989d-a1a91173d595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:12.685503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 342/699] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:57:12.686533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97368664-c8d7-48c6-989d-a1a91173d595 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:12.698977 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 358/700] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:57:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 10:57:12.704174 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e82f03-4df2-43ca-9ffa-1bbeeb841acb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:12.705242 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:12.762391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:12.808216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e82f03-4df2-43ca-9ffa-1bbeeb841acb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:12.821639 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97368664-c8d7-48c6-989d-a1a91173d595 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:12.843652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c30cdc-74cb-4365-a03c-5caaca2af572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:12.844435 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c30cdc-74cb-4365-a03c-5caaca2af572 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:12.844709 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c30cdc-74cb-4365-a03c-5caaca2af572 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:12.844974 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c30cdc-74cb-4365-a03c-5caaca2af572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:12.855912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c30cdc-74cb-4365-a03c-5caaca2af572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:12.857379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c30cdc-74cb-4365-a03c-5caaca2af572 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:12.861040 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f106c-23d7-4d4d-8a57-15d05738e00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:12.861740 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f106c-23d7-4d4d-8a57-15d05738e00c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:12.862016 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f106c-23d7-4d4d-8a57-15d05738e00c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:12.862295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f106c-23d7-4d4d-8a57-15d05738e00c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:12.863134 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f106c-23d7-4d4d-8a57-15d05738e00c None admin] RBAC: Adding query filter params (role.id=e053e0425eb744e2a3e3316222e208f3, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=189af68908944b5e9a7cb35fde0e1bd3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:12.863444 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f106c-23d7-4d4d-8a57-15d05738e00c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:12.865020 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f106c-23d7-4d4d-8a57-15d05738e00c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:12.872187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 343/701] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:57:12 2022] GET /identity/v3/role_assignments?user.id=189af68908944b5e9a7cb35fde0e1bd3&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=e053e0425eb744e2a3e3316222e208f3 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:12.872992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f106c-23d7-4d4d-8a57-15d05738e00c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:12.884247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-51c30cdc-74cb-4365-a03c-5caaca2af572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:12.884247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:12.884247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:12.884247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:12.884247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:12.884247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:12.884247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:12.884247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:12.884247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:12.884247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:12.884247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:12.884247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:12.884247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:12.884247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:12.884247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:12.886662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:12.886662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:12.886662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:12.886662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:12.886662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:12.886662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:12.886662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:12.886662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:12.886662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:12.886662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:12.886662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:12.886662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:12.886662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:12.886662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:12.886662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:12.886662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:12.886662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:12.888778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:12.888778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:12.888778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:12.888778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:12.888778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 359/702] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:12.897409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c30cdc-74cb-4365-a03c-5caaca2af572 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:12.965034 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:12.997411 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f106c-23d7-4d4d-8a57-15d05738e00c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:13.033737 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee522b3-a533-4fb5-ae57-27b15899e6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:13.034629 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee522b3-a533-4fb5-ae57-27b15899e6dc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:13.034916 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee522b3-a533-4fb5-ae57-27b15899e6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:13.035243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee522b3-a533-4fb5-ae57-27b15899e6dc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:13.036051 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee522b3-a533-4fb5-ae57-27b15899e6dc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:13.037484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee522b3-a533-4fb5-ae57-27b15899e6dc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:13.055225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-fee522b3-a533-4fb5-ae57-27b15899e6dc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 10:57:13.055225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:13.055225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:13.055225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:13.055225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:13.055225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:13.055225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:13.055225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:13.055225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 10:57:13.055225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:13.055225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:13.055225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:13.055225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:13.055225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:13.055225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:13.055225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:13.056317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:13.056317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:13.056317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:13.056317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:13.056317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:13.056317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:13.056317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:13.056317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:13.056317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:13.056317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:13.056317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:13.056317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:13.056317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:13.056317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:13.056317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:13.056317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:13.057154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:13.057154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:13.057154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:13.057154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:13.057154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:13.057154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:13.057154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:13.057154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:13.057154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:13.057154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:13.057154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:13.057154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:13.057154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:13.057154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 10:57:13.057154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:13.061354 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 344/703] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Jun 27 10:57:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:13.063736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee522b3-a533-4fb5-ae57-27b15899e6dc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:13.114178 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c30cdc-74cb-4365-a03c-5caaca2af572 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:13.122329 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:13.151777 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f24489-1625-49bb-b629-bc88ba3b2690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:13.152438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f24489-1625-49bb-b629-bc88ba3b2690 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:13.152718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f24489-1625-49bb-b629-bc88ba3b2690 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:13.152991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f24489-1625-49bb-b629-bc88ba3b2690 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:13.153745 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f24489-1625-49bb-b629-bc88ba3b2690 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:13.154048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f24489-1625-49bb-b629-bc88ba3b2690 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:13.155406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f24489-1625-49bb-b629-bc88ba3b2690 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:13.168938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 360/704] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:13.174423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f24489-1625-49bb-b629-bc88ba3b2690 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:13.184723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee522b3-a533-4fb5-ae57-27b15899e6dc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:13.223036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2d6b9-8698-4ee8-9b39-ec80b17d51ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:13.223704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2d6b9-8698-4ee8-9b39-ec80b17d51ce None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:13.223990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2d6b9-8698-4ee8-9b39-ec80b17d51ce None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:13.224417 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2d6b9-8698-4ee8-9b39-ec80b17d51ce None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:13.225237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2d6b9-8698-4ee8-9b39-ec80b17d51ce None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:13.225619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2d6b9-8698-4ee8-9b39-ec80b17d51ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:13.227542 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2d6b9-8698-4ee8-9b39-ec80b17d51ce None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:13.237916 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 345/705] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jun 27 10:57:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:13.239736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2d6b9-8698-4ee8-9b39-ec80b17d51ce None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:13.245687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:13.282299 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f24489-1625-49bb-b629-bc88ba3b2690 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:13.317007 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184f558-1c8f-493e-9e92-211c87666dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:13.317594 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184f558-1c8f-493e-9e92-211c87666dcf None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:13.317877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184f558-1c8f-493e-9e92-211c87666dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:13.318149 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184f558-1c8f-493e-9e92-211c87666dcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:13.326517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184f558-1c8f-493e-9e92-211c87666dcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:13.327956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184f558-1c8f-493e-9e92-211c87666dcf None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:13.343122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-b184f558-1c8f-493e-9e92-211c87666dcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:13.343122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:13.343122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:13.343122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:13.343122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:13.343122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:13.343122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:13.343122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:13.343122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:13.343122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:13.343122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:13.343122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:13.343122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:13.343122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:13.343122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:13.344058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:13.344058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:13.344058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:13.344058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:13.344058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:13.344058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:13.344058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:13.344058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:13.344058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:13.344058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:13.344058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:13.344058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:13.344058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:13.344058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:13.344058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:13.344058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:13.344058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:13.344946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:13.344946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:13.344946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:13.344946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:13.344946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:13.344946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:13.344946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:13.344946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:13.344946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 361/706] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:13.350315 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184f558-1c8f-493e-9e92-211c87666dcf None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:13.368578 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2d6b9-8698-4ee8-9b39-ec80b17d51ce None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:13.380112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:13.419840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17b961-2057-4950-9b49-a0437d71d5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:13.420517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17b961-2057-4950-9b49-a0437d71d5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:13.420806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17b961-2057-4950-9b49-a0437d71d5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:13.421086 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17b961-2057-4950-9b49-a0437d71d5c5 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:13.421969 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17b961-2057-4950-9b49-a0437d71d5c5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:13.422324 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17b961-2057-4950-9b49-a0437d71d5c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:13.423840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17b961-2057-4950-9b49-a0437d71d5c5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:13.437599 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 346/707] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jun 27 10:57:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:13.532611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184f558-1c8f-493e-9e92-211c87666dcf None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:13.540197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36652b3e-959a-4199-9b2a-ccffcdcbd5f7 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:13.540508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36652b3e-959a-4199-9b2a-ccffcdcbd5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:13.545740 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36652b3e-959a-4199-9b2a-ccffcdcbd5f7 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:13.545740 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 347/708] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:57:13.555733 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9ebb8-a256-41bd-851f-cc0473aa88b5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:13.556034 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9ebb8-a256-41bd-851f-cc0473aa88b5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:13.556293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9ebb8-a256-41bd-851f-cc0473aa88b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:13.576573 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a4b9ebb8-a256-41bd-851f-cc0473aa88b5 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:13.578156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a4b9ebb8-a256-41bd-851f-cc0473aa88b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:13.605921 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd042e-312a-4ad3-8bcb-9bba7fdf85df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:13.607189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd042e-312a-4ad3-8bcb-9bba7fdf85df None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:13.607708 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd042e-312a-4ad3-8bcb-9bba7fdf85df None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:13.608317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd042e-312a-4ad3-8bcb-9bba7fdf85df None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:13.609718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd042e-312a-4ad3-8bcb-9bba7fdf85df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:13.610461 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd042e-312a-4ad3-8bcb-9bba7fdf85df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:13.612597 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd042e-312a-4ad3-8bcb-9bba7fdf85df None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:13.640660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 362/709] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:13.641910 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd042e-312a-4ad3-8bcb-9bba7fdf85df None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:13.664143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:13.682841 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 348/710] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:57:13.705946 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9ebb8-a256-41bd-851f-cc0473aa88b5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:13.738848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:13.755349 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd042e-312a-4ad3-8bcb-9bba7fdf85df None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:13.792998 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ace57-e7c3-423f-89b5-d84426f21049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:13.793693 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ace57-e7c3-423f-89b5-d84426f21049 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:13.794009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ace57-e7c3-423f-89b5-d84426f21049 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:13.794393 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ace57-e7c3-423f-89b5-d84426f21049 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:13.795120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ace57-e7c3-423f-89b5-d84426f21049 None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=ed08c367a3d34207a51914ff77a93898) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:13.795431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ace57-e7c3-423f-89b5-d84426f21049 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:13.796936 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ace57-e7c3-423f-89b5-d84426f21049 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:13.803254 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 363/711] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:57:13 2022] GET /identity/v3/role_assignments?user.id=ed08c367a3d34207a51914ff77a93898&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:13.833174 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9ebb8-a256-41bd-851f-cc0473aa88b5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:13.871704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee435b-1b0f-46c2-bc58-81f3e715ea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:13.872752 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee435b-1b0f-46c2-bc58-81f3e715ea91 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:13.873728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee435b-1b0f-46c2-bc58-81f3e715ea91 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:13.874153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee435b-1b0f-46c2-bc58-81f3e715ea91 None admin] PATH_INFO: `/v3/services/network` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:13.874962 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee435b-1b0f-46c2-bc58-81f3e715ea91 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:13.876553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee435b-1b0f-46c2-bc58-81f3e715ea91 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:13.898319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-11ee435b-1b0f-46c2-bc58-81f3e715ea91 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 10:57:13.898319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:13.898319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:13.898319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:13.898319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:13.898319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:13.898319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:13.898319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:13.898319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 10:57:13.898319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:13.898319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:13.898319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:13.898319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:13.898319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:13.898319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:13.898319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:13.898319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:13.900087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:13.900087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:13.900087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:13.900087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:13.900087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:13.900087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:13.900087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:13.900087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:13.900087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:13.900087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:13.900087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:13.900087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:13.900087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:13.900087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:13.900087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:13.900087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:13.901137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:13.901137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:13.901137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:13.901137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:13.901137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:13.901137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:13.901137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:13.901137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:13.901137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:13.901137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:13.901137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:13.901137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:13.901137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 10:57:13.901137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:13.903876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 349/712] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:13 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:13.909515 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ace57-e7c3-423f-89b5-d84426f21049 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:13.948605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e2522-27f6-44c1-825e-60036f8a9b47 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:13.949161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e2522-27f6-44c1-825e-60036f8a9b47 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:13.949613 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e2522-27f6-44c1-825e-60036f8a9b47 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:13.951625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 350/713] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:13.957015 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dd9d9-563d-40a3-84ca-cec2e9fd08bb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:13.957579 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dd9d9-563d-40a3-84ca-cec2e9fd08bb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:13.958023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dd9d9-563d-40a3-84ca-cec2e9fd08bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:13.994543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1c1dd9d9-563d-40a3-84ca-cec2e9fd08bb None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:13.996072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1c1dd9d9-563d-40a3-84ca-cec2e9fd08bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:14.045440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ace57-e7c3-423f-89b5-d84426f21049 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:14.073564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa67ed7-c9af-478a-8973-baea6c34d929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:14.074455 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa67ed7-c9af-478a-8973-baea6c34d929 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:14.074809 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa67ed7-c9af-478a-8973-baea6c34d929 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:14.075160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa67ed7-c9af-478a-8973-baea6c34d929 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:14.075992 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa67ed7-c9af-478a-8973-baea6c34d929 None admin] RBAC: Adding query filter params (name=network) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:14.076370 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa67ed7-c9af-478a-8973-baea6c34d929 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:14.077901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa67ed7-c9af-478a-8973-baea6c34d929 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:14.083123 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 364/714] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jun 27 10:57:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:14.088869 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa67ed7-c9af-478a-8973-baea6c34d929 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:14.123453 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:14.138763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:14.160793 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 351/715] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:57:14.200789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dd9d9-563d-40a3-84ca-cec2e9fd08bb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:14.253551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa67ed7-c9af-478a-8973-baea6c34d929 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:14.293859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e949ea4-2d47-4f1a-a1a0-ef2c4a07ab96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:14.293859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e949ea4-2d47-4f1a-a1a0-ef2c4a07ab96 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:14.293859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e949ea4-2d47-4f1a-a1a0-ef2c4a07ab96 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:14.293859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e949ea4-2d47-4f1a-a1a0-ef2c4a07ab96 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:14.294295 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e949ea4-2d47-4f1a-a1a0-ef2c4a07ab96 None admin] RBAC: Adding query filter params (type=network) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:14.294573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e949ea4-2d47-4f1a-a1a0-ef2c4a07ab96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:14.296043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e949ea4-2d47-4f1a-a1a0-ef2c4a07ab96 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:14.303693 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 365/716] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jun 27 10:57:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:14.376061 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dd9d9-563d-40a3-84ca-cec2e9fd08bb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:14.433738 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0405cb7-0d9d-4905-9798-d997f75150a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:14.434472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0405cb7-0d9d-4905-9798-d997f75150a2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:14.434755 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0405cb7-0d9d-4905-9798-d997f75150a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:14.435030 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0405cb7-0d9d-4905-9798-d997f75150a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:14.457219 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0405cb7-0d9d-4905-9798-d997f75150a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:14.458733 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0405cb7-0d9d-4905-9798-d997f75150a2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:14.478463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c0405cb7-0d9d-4905-9798-d997f75150a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:14.478463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:14.478463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:14.478463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:14.478463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:14.478463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:14.478463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:14.478463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:14.478463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:14.478463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:14.478463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:14.478463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:14.478463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:14.478463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:14.478463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:14.479435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:14.479435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:14.479435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:14.479435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:14.479435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:14.479435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:14.479435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:14.479435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:14.479435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:14.479435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:14.479435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:14.479435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:14.479435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:14.479435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:14.479435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:14.479435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:14.479435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:14.480371 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:14.480371 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:14.480371 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:14.480371 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:14.480371 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 352/717] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:14.490503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e949ea4-2d47-4f1a-a1a0-ef2c4a07ab96 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:14.592782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:14.603027 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e949ea4-2d47-4f1a-a1a0-ef2c4a07ab96 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:14.637835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afb0c8-8488-474b-b360-224fee092c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:14.638499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afb0c8-8488-474b-b360-224fee092c2b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:14.638781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afb0c8-8488-474b-b360-224fee092c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:14.639060 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afb0c8-8488-474b-b360-224fee092c2b None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:14.639781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afb0c8-8488-474b-b360-224fee092c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:14.640085 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afb0c8-8488-474b-b360-224fee092c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:14.641466 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afb0c8-8488-474b-b360-224fee092c2b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:14.654532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 366/718] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:14.659571 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0405cb7-0d9d-4905-9798-d997f75150a2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:14.733009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:14.814430 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0405cb7-0d9d-4905-9798-d997f75150a2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:14.853712 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f1d88-a346-4063-99ad-352623012e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:14.854733 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f1d88-a346-4063-99ad-352623012e01 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:14.855238 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f1d88-a346-4063-99ad-352623012e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:14.855726 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f1d88-a346-4063-99ad-352623012e01 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:14.856646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f1d88-a346-4063-99ad-352623012e01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:14.858345 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f1d88-a346-4063-99ad-352623012e01 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:14.885035 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 353/719] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:57:14 2022] POST /identity/v3/users => generated 254 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:57:15.857922 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd6ded-0a98-42ec-a365-9c05c837393a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:15.858472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd6ded-0a98-42ec-a365-9c05c837393a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:15.858472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd6ded-0a98-42ec-a365-9c05c837393a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:15.860072 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 367/720] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:15.865492 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036aedee-ee1c-4732-bdf0-a99ae6bc4d30 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:15.865786 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036aedee-ee1c-4732-bdf0-a99ae6bc4d30 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:15.866068 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036aedee-ee1c-4732-bdf0-a99ae6bc4d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:15.885109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-036aedee-ee1c-4732-bdf0-a99ae6bc4d30 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:15.886579 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-036aedee-ee1c-4732-bdf0-a99ae6bc4d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:15.975610 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 354/721] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:57:15.986712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9503c8-c9cd-48dc-a288-95dc230cda3d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:15.987326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9503c8-c9cd-48dc-a288-95dc230cda3d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:15.987797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9503c8-c9cd-48dc-a288-95dc230cda3d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:15.989625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 368/722] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:15.994821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c35b20-3541-4e7b-b2fa-8847ed47d724 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:15.995344 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c35b20-3541-4e7b-b2fa-8847ed47d724 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:15.995834 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c35b20-3541-4e7b-b2fa-8847ed47d724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:16.013170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9503c8-c9cd-48dc-a288-95dc230cda3d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:16.015009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f4c35b20-3541-4e7b-b2fa-8847ed47d724 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:16.015009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f4c35b20-3541-4e7b-b2fa-8847ed47d724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:16.044756 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:16.116223 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 355/723] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 10:57:16.118891 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96640a67-3796-421e-be86-ab4828721ef2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:16.119373 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96640a67-3796-421e-be86-ab4828721ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:16.120129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96640a67-3796-421e-be86-ab4828721ef2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:16.122802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 356/724] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:16.132374 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067f3f0-acc4-4555-b34b-93d912247261 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:16.133416 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067f3f0-acc4-4555-b34b-93d912247261 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:16.133886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067f3f0-acc4-4555-b34b-93d912247261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:16.155622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f067f3f0-acc4-4555-b34b-93d912247261 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:16.157465 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f067f3f0-acc4-4555-b34b-93d912247261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:16.161788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9503c8-c9cd-48dc-a288-95dc230cda3d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:16.215706 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ad8e-5eba-4d35-98c5-a376705114f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:16.216706 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ad8e-5eba-4d35-98c5-a376705114f4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:16.217128 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ad8e-5eba-4d35-98c5-a376705114f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:16.217576 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ad8e-5eba-4d35-98c5-a376705114f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:16.226646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:16.232528 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0ad8e-5eba-4d35-98c5-a376705114f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:16.242883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-61e0ad8e-5eba-4d35-98c5-a376705114f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:57:16.242883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:16.242883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:16.242883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:16.242883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:16.242883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:16.242883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:16.242883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:16.242883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:16.242883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:16.242883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:16.242883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:16.242883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:16.242883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:16.242883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:16.242883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:16.244026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:16.244026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:16.244026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:16.244026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:16.244026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:16.244026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:16.244026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:16.244026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:16.244026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:16.244026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:16.244026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:16.244026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:16.244026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:16.244026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:16.244026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:16.244026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:16.244889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:16.244889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:16.244889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:16.244889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:16.244889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:16.244889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:16.244889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:16.244889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:16.244889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:16.244889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:16.244889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:57:16.244889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:16.247216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 369/725] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:57:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:16.248135 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ad8e-5eba-4d35-98c5-a376705114f4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:16.256059 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 357/726] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:57:16.262662 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067f3f0-acc4-4555-b34b-93d912247261 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:16.378102 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ad8e-5eba-4d35-98c5-a376705114f4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:16.387238 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:16.406488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067f3f0-acc4-4555-b34b-93d912247261 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:16.417271 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafaa621-1313-4245-a8ea-47b5e7516ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:16.418268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafaa621-1313-4245-a8ea-47b5e7516ab0 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:16.418741 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafaa621-1313-4245-a8ea-47b5e7516ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:16.419202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafaa621-1313-4245-a8ea-47b5e7516ab0 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:16.420099 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafaa621-1313-4245-a8ea-47b5e7516ab0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:16.421686 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafaa621-1313-4245-a8ea-47b5e7516ab0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:16.443935 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 370/727] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jun 27 10:57:16 2022] POST /identity/v3/services => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:57:16.446049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafaa621-1313-4245-a8ea-47b5e7516ab0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:16.455134 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e23b87-b5b2-404f-833a-5f893b63ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:16.455826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e23b87-b5b2-404f-833a-5f893b63ef50 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:16.456140 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e23b87-b5b2-404f-833a-5f893b63ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:16.456385 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e23b87-b5b2-404f-833a-5f893b63ef50 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:16.457208 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e23b87-b5b2-404f-833a-5f893b63ef50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:16.457568 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e23b87-b5b2-404f-833a-5f893b63ef50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:16.458967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e23b87-b5b2-404f-833a-5f893b63ef50 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:16.470304 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 358/728] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:57:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:16.481437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e23b87-b5b2-404f-833a-5f893b63ef50 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:16.589798 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:16.649807 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafaa621-1313-4245-a8ea-47b5e7516ab0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:16.671492 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e23b87-b5b2-404f-833a-5f893b63ef50 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:16.699837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e398f8b-80b3-4a97-9a63-d067c56dfea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:16.701414 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e398f8b-80b3-4a97-9a63-d067c56dfea9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:16.701414 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e398f8b-80b3-4a97-9a63-d067c56dfea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:16.701414 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e398f8b-80b3-4a97-9a63-d067c56dfea9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:16.712241 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e398f8b-80b3-4a97-9a63-d067c56dfea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:16.717786 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b92bc-3192-43f4-9eab-abe91777fc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:16.718676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b92bc-3192-43f4-9eab-abe91777fc19 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:16.719038 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b92bc-3192-43f4-9eab-abe91777fc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:16.719391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b92bc-3192-43f4-9eab-abe91777fc19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:16.719754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-4e398f8b-80b3-4a97-9a63-d067c56dfea9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:57:16.719754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:16.719754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:16.719754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:16.719754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:16.719754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:16.719754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:16.719754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:16.719754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:16.719754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:16.719754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:16.719754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:16.719754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:16.719754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:16.719754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:16.719754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:16.720634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:16.720634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:16.720634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:16.720634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:16.720634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:16.720634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:16.720634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:16.720634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:16.720634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:16.720634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:16.720634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:16.720634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:16.720634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:16.720634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:16.720634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:16.720634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:16.721488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:16.721488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:16.721488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:16.721488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:16.721488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:16.721488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:16.721488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:16.721488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:16.721488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:16.721488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:16.721488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:57:16.721488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:16.721488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 371/729] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:57:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:16.722811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538e4ae-5eae-472f-aa7c-b362eba50869 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:16.722811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538e4ae-5eae-472f-aa7c-b362eba50869 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:16.723102 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538e4ae-5eae-472f-aa7c-b362eba50869 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:16.724485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 372/730] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:16.741422 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538e4ae-5eae-472f-aa7c-b362eba50869 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:16.741609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b92bc-3192-43f4-9eab-abe91777fc19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:16.741609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b92bc-3192-43f4-9eab-abe91777fc19 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:16.751394 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:16.768718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ed2b92bc-3192-43f4-9eab-abe91777fc19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:16.768718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:16.768718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:16.768718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:16.768718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:16.768718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:16.768718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:16.768718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:16.768718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:16.768718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:16.768718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:16.768718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:16.768718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:16.768718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:16.768718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:16.769900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:16.769900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:16.769900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:16.769900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:16.769900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:16.769900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:16.769900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:16.769900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:16.769900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:16.769900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:16.769900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:16.769900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:16.769900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:16.769900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:16.769900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:16.769900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:16.769900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:16.770826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:16.770826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:16.770826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:16.770826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:16.770826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 359/731] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:16.777405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c61d7-c7d0-4ccd-b9eb-6def03afe518 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:16.777405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c61d7-c7d0-4ccd-b9eb-6def03afe518 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:16.777405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c61d7-c7d0-4ccd-b9eb-6def03afe518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:16.795039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b03c61d7-c7d0-4ccd-b9eb-6def03afe518 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:16.796877 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b03c61d7-c7d0-4ccd-b9eb-6def03afe518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:16.851879 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538e4ae-5eae-472f-aa7c-b362eba50869 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:16.870937 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:16.891315 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cdfdb-eeab-48ea-b0e5-c0909ad759b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:16.891980 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cdfdb-eeab-48ea-b0e5-c0909ad759b9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:16.892258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cdfdb-eeab-48ea-b0e5-c0909ad759b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:16.892529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cdfdb-eeab-48ea-b0e5-c0909ad759b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:16.893273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cdfdb-eeab-48ea-b0e5-c0909ad759b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:16.893601 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cdfdb-eeab-48ea-b0e5-c0909ad759b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:16.895028 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cdfdb-eeab-48ea-b0e5-c0909ad759b9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:16.896609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 360/732] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 10:57:16.898057 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c61d7-c7d0-4ccd-b9eb-6def03afe518 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:16.917944 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 373/733] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:57:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:16.921978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cdfdb-eeab-48ea-b0e5-c0909ad759b9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:17.028884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c61d7-c7d0-4ccd-b9eb-6def03afe518 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:17.029220 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cdfdb-eeab-48ea-b0e5-c0909ad759b9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:17.067615 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:17.071860 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2f47a-1a91-4525-98c8-d831f14482cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:17.072532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2f47a-1a91-4525-98c8-d831f14482cc None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:17.072808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2f47a-1a91-4525-98c8-d831f14482cc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:17.073076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2f47a-1a91-4525-98c8-d831f14482cc None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:17.073821 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2f47a-1a91-4525-98c8-d831f14482cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:17.075177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2f47a-1a91-4525-98c8-d831f14482cc None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:17.079982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56653e78-4d17-43c6-98bd-1d6859de33e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:17.080694 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56653e78-4d17-43c6-98bd-1d6859de33e0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:17.080983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56653e78-4d17-43c6-98bd-1d6859de33e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:17.081450 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56653e78-4d17-43c6-98bd-1d6859de33e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:17.082170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56653e78-4d17-43c6-98bd-1d6859de33e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:17.084015 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56653e78-4d17-43c6-98bd-1d6859de33e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:17.084015 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56653e78-4d17-43c6-98bd-1d6859de33e0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:17.100964 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 361/734] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:17.102115 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 374/735] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jun 27 10:57:16 2022] POST /identity/v3/services => generated 240 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 10:57:17.103001 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56653e78-4d17-43c6-98bd-1d6859de33e0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:17.104144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2f47a-1a91-4525-98c8-d831f14482cc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:17.169281 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:17.228163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56653e78-4d17-43c6-98bd-1d6859de33e0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:17.277600 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5297e3-5177-4f2b-a98f-1428b69fd0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:17.278535 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5297e3-5177-4f2b-a98f-1428b69fd0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:17.278822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5297e3-5177-4f2b-a98f-1428b69fd0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:17.279096 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5297e3-5177-4f2b-a98f-1428b69fd0b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:17.291454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5297e3-5177-4f2b-a98f-1428b69fd0b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:17.292959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5297e3-5177-4f2b-a98f-1428b69fd0b8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:17.298341 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2f47a-1a91-4525-98c8-d831f14482cc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:17.312115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ea5297e3-5177-4f2b-a98f-1428b69fd0b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:17.312115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:17.312115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:17.312115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:17.312115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:17.312115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:17.312115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:17.312115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:17.312115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:17.312115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:17.312115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:17.312115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:17.312115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:17.312115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:17.312115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:17.313064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:17.313064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:17.313064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:17.313064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:17.313064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:17.313064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:17.313064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:17.313064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:17.313064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:17.313064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:17.313064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:17.313064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:17.313064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:17.313064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:17.313064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:17.313064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:17.313064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:17.313980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:17.313980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:17.313980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:17.313980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:17.313980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 362/736] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:17.322533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5297e3-5177-4f2b-a98f-1428b69fd0b8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:17.368741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:17.373666 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1037451-b890-4aa0-984b-adc0dbd2e335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:17.375693 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1037451-b890-4aa0-984b-adc0dbd2e335 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:17.375987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1037451-b890-4aa0-984b-adc0dbd2e335 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:17.376266 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1037451-b890-4aa0-984b-adc0dbd2e335 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:17.387841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1037451-b890-4aa0-984b-adc0dbd2e335 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:17.389404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1037451-b890-4aa0-984b-adc0dbd2e335 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:17.411543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-e1037451-b890-4aa0-984b-adc0dbd2e335 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 10:57:17.411543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:17.411543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:17.411543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:17.411543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:17.411543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:17.411543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:17.411543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:17.411543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:17.411543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:17.411543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:17.411543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:17.411543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:17.411543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:17.411543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:17.411543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:17.413776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:17.416581 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:17.416581 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:17.416581 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:17.416581 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:17.416581 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:17.416581 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:17.416581 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:17.416581 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:17.416581 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 10:57:17.416581 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:17.421531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 375/737] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:57:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:17.421531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1037451-b890-4aa0-984b-adc0dbd2e335 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:17.446637 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5297e3-5177-4f2b-a98f-1428b69fd0b8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:17.488324 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738c08d-5388-4a02-991f-c7c4bdcec9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:17.489145 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738c08d-5388-4a02-991f-c7c4bdcec9be None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:17.489500 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738c08d-5388-4a02-991f-c7c4bdcec9be None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:17.489783 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738c08d-5388-4a02-991f-c7c4bdcec9be None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:17.490556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738c08d-5388-4a02-991f-c7c4bdcec9be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:17.490869 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738c08d-5388-4a02-991f-c7c4bdcec9be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:17.492282 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738c08d-5388-4a02-991f-c7c4bdcec9be None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:17.507946 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 363/738] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:17.516739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738c08d-5388-4a02-991f-c7c4bdcec9be None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:17.565681 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:17.577261 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1037451-b890-4aa0-984b-adc0dbd2e335 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:17.672054 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:17.673014 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce5ab4-8023-4cc3-a29b-081091bebfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:17.673999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce5ab4-8023-4cc3-a29b-081091bebfb9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:17.674469 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce5ab4-8023-4cc3-a29b-081091bebfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:17.677177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce5ab4-8023-4cc3-a29b-081091bebfb9 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:17.677177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce5ab4-8023-4cc3-a29b-081091bebfb9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:17.677177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce5ab4-8023-4cc3-a29b-081091bebfb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:17.677955 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce5ab4-8023-4cc3-a29b-081091bebfb9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:17.679703 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738c08d-5388-4a02-991f-c7c4bdcec9be None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:17.716999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 376/739] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Jun 27 10:57:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:17.723074 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c2328-8313-4617-972c-f2434913c7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:17.723875 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c2328-8313-4617-972c-f2434913c7df None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:17.724157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c2328-8313-4617-972c-f2434913c7df None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:17.724430 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c2328-8313-4617-972c-f2434913c7df None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:17.730847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce5ab4-8023-4cc3-a29b-081091bebfb9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:17.733016 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c2328-8313-4617-972c-f2434913c7df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:17.734507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c2328-8313-4617-972c-f2434913c7df None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:17.751818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-565c2328-8313-4617-972c-f2434913c7df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:57:17.751818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:17.751818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:17.751818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:17.751818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:17.751818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:17.751818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:17.751818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:17.751818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:17.751818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:17.751818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:17.751818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:17.751818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:17.751818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:17.751818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:17.751818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:17.752816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:17.753794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:17.753794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:17.753794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:17.753794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:17.753794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:17.753794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:17.753794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:17.753794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:17.753794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:57:17.753794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:17.753794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 364/740] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jun 27 10:57:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:17.762566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c2328-8313-4617-972c-f2434913c7df None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:17.851081 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce5ab4-8023-4cc3-a29b-081091bebfb9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:17.886686 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac8d17-eda7-4fca-a832-4060cf9bd891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:17.888109 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac8d17-eda7-4fca-a832-4060cf9bd891 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:17.888613 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac8d17-eda7-4fca-a832-4060cf9bd891 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:17.889098 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac8d17-eda7-4fca-a832-4060cf9bd891 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:17.912986 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:17.915157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c2328-8313-4617-972c-f2434913c7df None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:17.953871 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3291a2c-f1b2-41d2-b59c-023ffa1fa2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:17.954642 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3291a2c-f1b2-41d2-b59c-023ffa1fa2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:17.954926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3291a2c-f1b2-41d2-b59c-023ffa1fa2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:17.955204 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3291a2c-f1b2-41d2-b59c-023ffa1fa2a5 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:17.956055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3291a2c-f1b2-41d2-b59c-023ffa1fa2a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:17.956365 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3291a2c-f1b2-41d2-b59c-023ffa1fa2a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:17.958004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3291a2c-f1b2-41d2-b59c-023ffa1fa2a5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:17.960850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac8d17-eda7-4fca-a832-4060cf9bd891 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:17.962793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac8d17-eda7-4fca-a832-4060cf9bd891 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:17.977962 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 365/741] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jun 27 10:57:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:17.979488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551da53-af57-475a-aaa1-8fb2f2699659 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:17.979811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551da53-af57-475a-aaa1-8fb2f2699659 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:17.980106 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551da53-af57-475a-aaa1-8fb2f2699659 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:17.981342 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 366/742] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:17.986240 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551da53-af57-475a-aaa1-8fb2f2699659 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:18.003186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:18.071408 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 377/743] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:57:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 27 10:57:18.073074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e7777-5378-4fd5-9b8d-77071395a93f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:18.073610 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e7777-5378-4fd5-9b8d-77071395a93f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:18.074228 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e7777-5378-4fd5-9b8d-77071395a93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:18.091776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4b2e7777-5378-4fd5-9b8d-77071395a93f None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:18.093298 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4b2e7777-5378-4fd5-9b8d-77071395a93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:18.102224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551da53-af57-475a-aaa1-8fb2f2699659 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:18.138975 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a094562-e54f-43bd-8403-2387dd8d2fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:18.139880 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a094562-e54f-43bd-8403-2387dd8d2fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:18.140199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a094562-e54f-43bd-8403-2387dd8d2fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:18.140501 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a094562-e54f-43bd-8403-2387dd8d2fe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:18.147986 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:18.152824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a094562-e54f-43bd-8403-2387dd8d2fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:18.154330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a094562-e54f-43bd-8403-2387dd8d2fe5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:18.168532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 378/744] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:18.169714 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e7777-5378-4fd5-9b8d-77071395a93f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:18.183290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-1a094562-e54f-43bd-8403-2387dd8d2fe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:18.183290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:18.183290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:18.183290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:18.183290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:18.183290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:18.183290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:18.183290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:18.183290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:18.183290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:18.183290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:18.183290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:18.183290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:18.183290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:18.183290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:18.184229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:18.184229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:18.184229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:18.184229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:18.184229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:18.184229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:18.184229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:18.184229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:18.184229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:18.184229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:18.184229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:18.184229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:18.184229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:18.184229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:18.184229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:18.184229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:18.184229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:18.185122 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:18.185122 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:18.185122 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:18.185122 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:18.185122 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 367/745] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:18.189905 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a094562-e54f-43bd-8403-2387dd8d2fe5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:18.272187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:18.296284 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e7777-5378-4fd5-9b8d-77071395a93f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:18.311600 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a094562-e54f-43bd-8403-2387dd8d2fe5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:18.344301 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392c22c-fe6d-40fd-aa63-ff3aa903c7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:18.345843 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392c22c-fe6d-40fd-aa63-ff3aa903c7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:18.346344 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392c22c-fe6d-40fd-aa63-ff3aa903c7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:18.346810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392c22c-fe6d-40fd-aa63-ff3aa903c7f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:18.348842 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a41e4f-6a39-48aa-89c2-808580289485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:18.349559 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a41e4f-6a39-48aa-89c2-808580289485 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:18.349882 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a41e4f-6a39-48aa-89c2-808580289485 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:18.350184 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a41e4f-6a39-48aa-89c2-808580289485 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:18.351024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a41e4f-6a39-48aa-89c2-808580289485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:18.351255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a41e4f-6a39-48aa-89c2-808580289485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:18.353180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a41e4f-6a39-48aa-89c2-808580289485 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:18.361235 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392c22c-fe6d-40fd-aa63-ff3aa903c7f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:18.363738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392c22c-fe6d-40fd-aa63-ff3aa903c7f9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:18.365195 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 368/746] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:18.366191 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a41e4f-6a39-48aa-89c2-808580289485 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:18.387524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-7392c22c-fe6d-40fd-aa63-ff3aa903c7f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:18.387524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:18.387524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:18.387524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:18.387524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:18.387524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:18.387524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:18.387524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:18.387524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:18.387524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:18.387524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:18.387524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:18.387524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:18.387524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:18.387524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:18.388479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:18.388479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:18.388479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:18.388479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:18.388479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:18.388479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:18.388479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:18.388479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:18.388479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:18.388479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:18.388479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:18.388479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:18.388479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:18.388479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:18.388479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:18.388479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:18.388479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:18.389353 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:18.389353 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:18.389353 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:18.389353 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:18.392367 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 379/747] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:18.394143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392c22c-fe6d-40fd-aa63-ff3aa903c7f9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:18.442790 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:18.486008 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a41e4f-6a39-48aa-89c2-808580289485 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:18.514695 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392c22c-fe6d-40fd-aa63-ff3aa903c7f9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:18.522764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:18.533107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca0864-49cc-4b97-a6cb-40271c7e8011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:18.533963 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca0864-49cc-4b97-a6cb-40271c7e8011 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:18.534285 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca0864-49cc-4b97-a6cb-40271c7e8011 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:18.534593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca0864-49cc-4b97-a6cb-40271c7e8011 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:18.545905 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca0864-49cc-4b97-a6cb-40271c7e8011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:18.553807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-80ca0864-49cc-4b97-a6cb-40271c7e8011 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:18.553807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:18.553807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:18.553807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:18.553807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:18.553807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:18.553807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:18.553807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:18.553807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:18.553807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:18.553807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:18.553807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:18.553807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:18.553807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:18.553807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:18.553807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:18.554778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:18.554778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:18.554778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:18.554778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:18.554778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:18.554778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:18.554778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:18.554778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:18.554778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:18.554778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:18.554778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:18.554778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:18.554778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:18.554778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:18.554778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:18.554778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:18.555621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:18.555621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:18.555621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:18.555621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:18.555621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:18.555621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:18.555621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:18.555621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:18.555621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:18.555621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:18.555621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:18.555621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:18.558906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 369/748] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:57:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:18.559985 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca0864-49cc-4b97-a6cb-40271c7e8011 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:18.564172 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2ea5e-82bd-4393-961d-f0f6cc260826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:18.565512 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2ea5e-82bd-4393-961d-f0f6cc260826 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:18.566957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2ea5e-82bd-4393-961d-f0f6cc260826 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:18.567447 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2ea5e-82bd-4393-961d-f0f6cc260826 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:18.576887 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2ea5e-82bd-4393-961d-f0f6cc260826 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:18.578928 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2ea5e-82bd-4393-961d-f0f6cc260826 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:18.598259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-aeb2ea5e-82bd-4393-961d-f0f6cc260826 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:18.598259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:18.598259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:18.598259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:18.598259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:18.598259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:18.598259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:18.598259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:18.598259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:18.598259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:18.598259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:18.598259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:18.598259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:18.598259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:18.598259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:18.599133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:18.599133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:18.599133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:18.599133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:18.599133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:18.599133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:18.599133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:18.599133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:18.599133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:18.599133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:18.599133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:18.599133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:18.599133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:18.599133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:18.599133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:18.599133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:18.599133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:18.600003 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:18.600003 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:18.600003 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:18.600003 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:18.600003 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:18.600003 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:18.600003 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:18.600003 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:18.603134 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 380/749] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:18.604064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2ea5e-82bd-4393-961d-f0f6cc260826 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:18.674211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca0864-49cc-4b97-a6cb-40271c7e8011 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:18.710944 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f64707-f8db-40b7-aa60-f6ea8f0d9ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:18.712384 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f64707-f8db-40b7-aa60-f6ea8f0d9ffd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:18.712706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f64707-f8db-40b7-aa60-f6ea8f0d9ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:18.713012 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f64707-f8db-40b7-aa60-f6ea8f0d9ffd None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:18.713817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f64707-f8db-40b7-aa60-f6ea8f0d9ffd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:18.714141 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f64707-f8db-40b7-aa60-f6ea8f0d9ffd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:18.715676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f64707-f8db-40b7-aa60-f6ea8f0d9ffd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:18.724694 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:18.728435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 370/750] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:18.729245 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f64707-f8db-40b7-aa60-f6ea8f0d9ffd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:18.735404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2ea5e-82bd-4393-961d-f0f6cc260826 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:18.769245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd75bb9-9307-4590-a634-0d81dcd15f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:18.769922 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd75bb9-9307-4590-a634-0d81dcd15f6a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:18.770203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd75bb9-9307-4590-a634-0d81dcd15f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:18.770473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd75bb9-9307-4590-a634-0d81dcd15f6a None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:18.771211 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd75bb9-9307-4590-a634-0d81dcd15f6a None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:18.771509 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd75bb9-9307-4590-a634-0d81dcd15f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:18.772902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd75bb9-9307-4590-a634-0d81dcd15f6a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:18.779926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:18.781466 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 381/751] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:57:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:18.782814 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6ea4a-665c-4445-a697-0c04f51937cf None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:18.783105 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6ea4a-665c-4445-a697-0c04f51937cf None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:18.783451 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6ea4a-665c-4445-a697-0c04f51937cf None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:18.784747 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 382/752] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:18.789115 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6ea4a-665c-4445-a697-0c04f51937cf None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:18.840475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f64707-f8db-40b7-aa60-f6ea8f0d9ffd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:18.876040 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba001b8-8a1c-4298-943e-486bc03874d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:18.877064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba001b8-8a1c-4298-943e-486bc03874d5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:18.877441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba001b8-8a1c-4298-943e-486bc03874d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:18.877727 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba001b8-8a1c-4298-943e-486bc03874d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:18.878597 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba001b8-8a1c-4298-943e-486bc03874d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:18.878911 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba001b8-8a1c-4298-943e-486bc03874d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:18.880350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba001b8-8a1c-4298-943e-486bc03874d5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:18.896867 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 371/753] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:18.897783 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba001b8-8a1c-4298-943e-486bc03874d5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:18.907015 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6ea4a-665c-4445-a697-0c04f51937cf None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:18.945558 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c1ac2-48d4-4649-a0cb-190f1c04f1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:18.946352 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c1ac2-48d4-4649-a0cb-190f1c04f1da None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:18.946637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c1ac2-48d4-4649-a0cb-190f1c04f1da None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:18.947342 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c1ac2-48d4-4649-a0cb-190f1c04f1da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:18.956976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c1ac2-48d4-4649-a0cb-190f1c04f1da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:18.959005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c1ac2-48d4-4649-a0cb-190f1c04f1da None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:18.974239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-013c1ac2-48d4-4649-a0cb-190f1c04f1da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:18.974239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:18.974239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:18.974239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:18.974239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:18.974239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:18.974239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:18.974239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:18.974239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:18.974239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:18.974239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:18.974239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:18.974239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:18.974239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:18.974239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:18.975158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:18.975158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:18.975158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:18.975158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:18.975158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:18.975158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:18.975158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:18.975158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:18.975158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:18.975158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:18.975158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:18.975158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:18.975158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:18.975158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:18.975158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:18.975158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:18.975158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:18.976076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:18.976076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:18.976076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:18.976076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:18.976076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:18.976076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:18.976076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:18.976076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:18.976076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 383/754] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:18.977821 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46516457-0bbc-4a54-a261-4fb8356149b9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:18.977821 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46516457-0bbc-4a54-a261-4fb8356149b9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:18.977821 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46516457-0bbc-4a54-a261-4fb8356149b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:18.994095 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-46516457-0bbc-4a54-a261-4fb8356149b9 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:18.995273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-46516457-0bbc-4a54-a261-4fb8356149b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:19.008830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:19.016970 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba001b8-8a1c-4298-943e-486bc03874d5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:19.025383 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:19.056532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba062843-8b39-4185-901e-b4b4ac530fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:19.057890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba062843-8b39-4185-901e-b4b4ac530fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:19.058651 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba062843-8b39-4185-901e-b4b4ac530fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:19.059358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba062843-8b39-4185-901e-b4b4ac530fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:19.065189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 384/755] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:19.066034 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46516457-0bbc-4a54-a261-4fb8356149b9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:19.078860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba062843-8b39-4185-901e-b4b4ac530fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:19.080306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba062843-8b39-4185-901e-b4b4ac530fc5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:19.102333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ba062843-8b39-4185-901e-b4b4ac530fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:19.102333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:19.102333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:19.102333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:19.102333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:19.102333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:19.102333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:19.102333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:19.102333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:19.102333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:19.102333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:19.102333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:19.102333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:19.102333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:19.102333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:19.103259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:19.103259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:19.103259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:19.103259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:19.103259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:19.103259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:19.103259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:19.103259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:19.103259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:19.103259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:19.103259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:19.103259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:19.103259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:19.103259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:19.103259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:19.103259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:19.103259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:19.104137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:19.104137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:19.104137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:19.104137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:19.104137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 372/756] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:19.104137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba062843-8b39-4185-901e-b4b4ac530fc5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:19.189698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46516457-0bbc-4a54-a261-4fb8356149b9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:19.214580 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba062843-8b39-4185-901e-b4b4ac530fc5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:19.225832 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76037ecf-6a5e-4fa6-9a14-ce8def249987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:19.226748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76037ecf-6a5e-4fa6-9a14-ce8def249987 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:19.227020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76037ecf-6a5e-4fa6-9a14-ce8def249987 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:19.227297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76037ecf-6a5e-4fa6-9a14-ce8def249987 None admin] PATH_INFO: `/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/ed08c367a3d34207a51914ff77a93898/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:19.229223 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76037ecf-6a5e-4fa6-9a14-ce8def249987 None admin] RBAC: Authorizing `identity:create_grant(project_id=6543a66af8ba48c391ce686f6d82276b, user_id=ed08c367a3d34207a51914ff77a93898, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:19.230686 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76037ecf-6a5e-4fa6-9a14-ce8def249987 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:19.246234 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 385/757] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:57:19 2022] PUT /identity/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/ed08c367a3d34207a51914ff77a93898/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:57:19.247847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76037ecf-6a5e-4fa6-9a14-ce8def249987 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:19.260750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917433f-37b5-4ffc-93a2-0c1c91a9f515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:19.261734 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917433f-37b5-4ffc-93a2-0c1c91a9f515 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:19.262011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917433f-37b5-4ffc-93a2-0c1c91a9f515 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:19.262287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917433f-37b5-4ffc-93a2-0c1c91a9f515 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:19.263093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917433f-37b5-4ffc-93a2-0c1c91a9f515 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:19.263402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917433f-37b5-4ffc-93a2-0c1c91a9f515 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:19.264955 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917433f-37b5-4ffc-93a2-0c1c91a9f515 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:19.276473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:19.284957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 373/758] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:19.284957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917433f-37b5-4ffc-93a2-0c1c91a9f515 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:19.312976 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:19.415693 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76037ecf-6a5e-4fa6-9a14-ce8def249987 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:19.419703 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917433f-37b5-4ffc-93a2-0c1c91a9f515 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:19.451282 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04def54f-23cb-4bca-a90c-8d83e8ff62c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:19.452083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04def54f-23cb-4bca-a90c-8d83e8ff62c5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:19.452359 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04def54f-23cb-4bca-a90c-8d83e8ff62c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:19.452632 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04def54f-23cb-4bca-a90c-8d83e8ff62c5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:19.453278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04def54f-23cb-4bca-a90c-8d83e8ff62c5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:19.454709 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04def54f-23cb-4bca-a90c-8d83e8ff62c5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:19.460276 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ce554-3120-4837-9878-ec4fbce647f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:19.461622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ce554-3120-4837-9878-ec4fbce647f6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:19.461931 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ce554-3120-4837-9878-ec4fbce647f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:19.462204 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ce554-3120-4837-9878-ec4fbce647f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:19.462935 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ce554-3120-4837-9878-ec4fbce647f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:19.463238 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ce554-3120-4837-9878-ec4fbce647f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:19.464595 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ce554-3120-4837-9878-ec4fbce647f6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:19.468835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-04def54f-23cb-4bca-a90c-8d83e8ff62c5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 10:57:19.468835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:19.468835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:19.468835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:19.468835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:19.468835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:19.468835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:19.468835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:19.468835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 10:57:19.468835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:19.468835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:19.468835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:19.468835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:19.468835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:19.468835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:19.468835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:19.470005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:19.470005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:19.470005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:19.470005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:19.470005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:19.470005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:19.470005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:19.470005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:19.470005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:19.470005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:19.470005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:19.470005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:19.470005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:19.470005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:19.470005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:19.470005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:19.470825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:19.470825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:19.470825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:19.470825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:19.470825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:19.470825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:19.470825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:19.470825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:19.470825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:19.470825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:19.470825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:19.470825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:19.470825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:19.470825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 10:57:19.470825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:19.470825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 386/759] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Jun 27 10:57:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:19.471661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04def54f-23cb-4bca-a90c-8d83e8ff62c5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:19.481445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 374/760] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:19.483412 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d004485-d329-4cd9-ad2f-bb1ff2abde06 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:19.483934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d004485-d329-4cd9-ad2f-bb1ff2abde06 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:19.484703 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d004485-d329-4cd9-ad2f-bb1ff2abde06 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:19.486384 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 375/761] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:19.487398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d004485-d329-4cd9-ad2f-bb1ff2abde06 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:19.546466 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:19.572146 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:19.584284 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04def54f-23cb-4bca-a90c-8d83e8ff62c5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:19.598652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d004485-d329-4cd9-ad2f-bb1ff2abde06 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:19.619494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10ec20-e2e8-428b-afeb-2608b0666ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:19.620143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10ec20-e2e8-428b-afeb-2608b0666ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:19.620679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10ec20-e2e8-428b-afeb-2608b0666ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:19.620679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10ec20-e2e8-428b-afeb-2608b0666ab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:19.621528 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10ec20-e2e8-428b-afeb-2608b0666ab1 None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=189af68908944b5e9a7cb35fde0e1bd3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:19.621838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10ec20-e2e8-428b-afeb-2608b0666ab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:19.623258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10ec20-e2e8-428b-afeb-2608b0666ab1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:19.628766 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 387/762] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:57:19 2022] GET /identity/v3/role_assignments?user.id=189af68908944b5e9a7cb35fde0e1bd3&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:19.634606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10ec20-e2e8-428b-afeb-2608b0666ab1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:19.635747 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5590c6-6484-4b28-9e31-5d7c1be51909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:19.636772 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5590c6-6484-4b28-9e31-5d7c1be51909 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:19.637055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5590c6-6484-4b28-9e31-5d7c1be51909 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:19.637323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5590c6-6484-4b28-9e31-5d7c1be51909 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:19.638084 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5590c6-6484-4b28-9e31-5d7c1be51909 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:19.638496 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5590c6-6484-4b28-9e31-5d7c1be51909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:19.639943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5590c6-6484-4b28-9e31-5d7c1be51909 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:19.652035 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 376/763] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jun 27 10:57:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:19.654032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad693-de8a-44f6-90e4-a977d1230043 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:19.654527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad693-de8a-44f6-90e4-a977d1230043 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:19.655498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad693-de8a-44f6-90e4-a977d1230043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:19.680529 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c09ad693-de8a-44f6-90e4-a977d1230043 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:19.682108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c09ad693-de8a-44f6-90e4-a977d1230043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:19.753122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10ec20-e2e8-428b-afeb-2608b0666ab1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:19.785395 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 377/764] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:19.787248 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad693-de8a-44f6-90e4-a977d1230043 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:19.791668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d99df1-6575-423b-bfab-03c8e67adc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:19.792479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d99df1-6575-423b-bfab-03c8e67adc82 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:19.792754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d99df1-6575-423b-bfab-03c8e67adc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:19.793026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d99df1-6575-423b-bfab-03c8e67adc82 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:19.796092 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:19.802417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d99df1-6575-423b-bfab-03c8e67adc82 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:19.803792 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d99df1-6575-423b-bfab-03c8e67adc82 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:19.825746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f6d99df1-6575-423b-bfab-03c8e67adc82 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 10:57:19.825746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:19.825746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:19.825746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:19.825746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:19.825746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:19.825746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:19.825746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:19.825746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:19.825746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:19.825746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:19.825746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:19.825746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:19.825746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:19.825746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:19.825746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:19.826718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:19.827645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:19.827645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:19.827645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:19.827645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:19.827645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:19.827645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:19.827645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:19.827645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:19.827645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 10:57:19.827645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:19.833442 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 388/765] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jun 27 10:57:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:19.834647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d99df1-6575-423b-bfab-03c8e67adc82 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:19.873227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:19.914555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad693-de8a-44f6-90e4-a977d1230043 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:19.953675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0631d7-db87-460c-aa13-302dd4a145a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:19.954775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0631d7-db87-460c-aa13-302dd4a145a7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:19.955214 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0631d7-db87-460c-aa13-302dd4a145a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:19.955628 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0631d7-db87-460c-aa13-302dd4a145a7 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:19.956544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0631d7-db87-460c-aa13-302dd4a145a7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:19.957002 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0631d7-db87-460c-aa13-302dd4a145a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:19.957493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d99df1-6575-423b-bfab-03c8e67adc82 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:19.959288 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0631d7-db87-460c-aa13-302dd4a145a7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:19.965785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 378/766] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jun 27 10:57:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:19.966897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0631d7-db87-460c-aa13-302dd4a145a7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:19.994187 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20448ac9-7901-4dfa-961a-5e7ca8460a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:19.995285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20448ac9-7901-4dfa-961a-5e7ca8460a19 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:19.995509 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20448ac9-7901-4dfa-961a-5e7ca8460a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:19.995883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20448ac9-7901-4dfa-961a-5e7ca8460a19 None admin] PATH_INFO: `/v3/services/network` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:19.996635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20448ac9-7901-4dfa-961a-5e7ca8460a19 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:19.998155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20448ac9-7901-4dfa-961a-5e7ca8460a19 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:20.010144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-20448ac9-7901-4dfa-961a-5e7ca8460a19 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 10:57:20.010144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:20.010144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:20.010144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:20.010144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:20.010144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:20.010144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:20.010144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:20.010144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 10:57:20.010144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:20.010144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:20.010144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:20.010144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:20.010144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:20.010144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:20.010144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:20.010144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:20.011605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:20.011605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:20.011605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:20.011605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:20.011605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:20.011605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:20.011605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:20.011605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:20.011605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:20.011605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:20.011605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:20.011605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:20.011605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:20.011605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:20.011605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:20.011605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:20.012624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:20.012624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:20.012624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:20.012624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:20.012624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:20.012624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:20.012624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:20.012624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:20.012624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:20.012624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:20.012624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:20.012624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:20.012624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 10:57:20.012624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:20.014722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 389/767] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:19 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:20.015588 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20448ac9-7901-4dfa-961a-5e7ca8460a19 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:20.075645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:20.082893 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0631d7-db87-460c-aa13-302dd4a145a7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:20.119140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20448ac9-7901-4dfa-961a-5e7ca8460a19 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:20.120830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9392ff5-9197-454a-a985-739dc1e474d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:20.121818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9392ff5-9197-454a-a985-739dc1e474d6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:20.122324 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9392ff5-9197-454a-a985-739dc1e474d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:20.122791 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9392ff5-9197-454a-a985-739dc1e474d6 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:20.123846 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9392ff5-9197-454a-a985-739dc1e474d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:20.124346 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9392ff5-9197-454a-a985-739dc1e474d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:20.126007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9392ff5-9197-454a-a985-739dc1e474d6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:20.128851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:20.146491 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 379/768] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Jun 27 10:57:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:20.147699 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9392ff5-9197-454a-a985-739dc1e474d6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:20.153844 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda73b9-af81-4899-8e35-dd0d33aa6dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:20.154501 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda73b9-af81-4899-8e35-dd0d33aa6dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:20.154784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda73b9-af81-4899-8e35-dd0d33aa6dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:20.155059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda73b9-af81-4899-8e35-dd0d33aa6dd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:20.155844 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda73b9-af81-4899-8e35-dd0d33aa6dd8 None admin] RBAC: Adding query filter params (interface=public, service_id=edb1dd383cc24818b659c8e7fa5b5109, region_id=RegionOne) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:20.156153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda73b9-af81-4899-8e35-dd0d33aa6dd8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:20.157552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda73b9-af81-4899-8e35-dd0d33aa6dd8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:20.173402 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 390/769] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jun 27 10:57:20 2022] GET /identity/v3/endpoints?service_id=edb1dd383cc24818b659c8e7fa5b5109&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:20.173402 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda73b9-af81-4899-8e35-dd0d33aa6dd8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:20.267572 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda73b9-af81-4899-8e35-dd0d33aa6dd8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:20.277023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9392ff5-9197-454a-a985-739dc1e474d6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:20.294034 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:20.311736 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3220ab5-e5bf-40bb-808d-add473db269d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:20.312983 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3220ab5-e5bf-40bb-808d-add473db269d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:20.313877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3220ab5-e5bf-40bb-808d-add473db269d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:20.314639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3220ab5-e5bf-40bb-808d-add473db269d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:20.322524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43355a73-f1f9-4cce-9271-cb0674b73500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:20.323239 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43355a73-f1f9-4cce-9271-cb0674b73500 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:20.323521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43355a73-f1f9-4cce-9271-cb0674b73500 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:20.323849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43355a73-f1f9-4cce-9271-cb0674b73500 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:20.324568 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43355a73-f1f9-4cce-9271-cb0674b73500 None admin] RBAC: Adding query filter params (name=network) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:20.324872 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43355a73-f1f9-4cce-9271-cb0674b73500 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:20.326903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43355a73-f1f9-4cce-9271-cb0674b73500 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:20.333150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 380/770] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jun 27 10:57:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:20.334269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43355a73-f1f9-4cce-9271-cb0674b73500 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:20.402250 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:20.412267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3220ab5-e5bf-40bb-808d-add473db269d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:20.414931 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3220ab5-e5bf-40bb-808d-add473db269d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:20.446670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43355a73-f1f9-4cce-9271-cb0674b73500 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:20.484395 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88db0a-268e-4396-9a8b-4a276389dbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:20.484395 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88db0a-268e-4396-9a8b-4a276389dbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:20.484395 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88db0a-268e-4396-9a8b-4a276389dbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:20.484395 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88db0a-268e-4396-9a8b-4a276389dbc1 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:20.487358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88db0a-268e-4396-9a8b-4a276389dbc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:20.487358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88db0a-268e-4396-9a8b-4a276389dbc1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:20.492356 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 381/771] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jun 27 10:57:20 2022] GET /identity/v3/services => generated 772 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:20.492356 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88db0a-268e-4396-9a8b-4a276389dbc1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:20.571080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 391/772] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:57:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:57:20.581321 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3220ab5-e5bf-40bb-808d-add473db269d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:20.629740 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:20.656063 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88db0a-268e-4396-9a8b-4a276389dbc1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:20.680414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:20.701127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2635dc3-52fd-4ff0-8eda-ced6cbec4856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:20.701860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2635dc3-52fd-4ff0-8eda-ced6cbec4856 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:20.702149 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2635dc3-52fd-4ff0-8eda-ced6cbec4856 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:20.702430 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2635dc3-52fd-4ff0-8eda-ced6cbec4856 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:20.703165 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2635dc3-52fd-4ff0-8eda-ced6cbec4856 None admin] RBAC: Adding query filter params (type=network) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:20.703478 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2635dc3-52fd-4ff0-8eda-ced6cbec4856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:20.704898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2635dc3-52fd-4ff0-8eda-ced6cbec4856 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:20.711562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 382/773] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jun 27 10:57:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:20.722477 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2635dc3-52fd-4ff0-8eda-ced6cbec4856 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:20.736245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3220ab5-e5bf-40bb-808d-add473db269d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:20.782009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb726c-8f36-4d3b-8823-b10ae41c5b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:20.782816 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb726c-8f36-4d3b-8823-b10ae41c5b5d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:20.783096 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb726c-8f36-4d3b-8823-b10ae41c5b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:20.783368 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb726c-8f36-4d3b-8823-b10ae41c5b5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:20.802626 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb726c-8f36-4d3b-8823-b10ae41c5b5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:20.804467 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb726c-8f36-4d3b-8823-b10ae41c5b5d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:20.827823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-83eb726c-8f36-4d3b-8823-b10ae41c5b5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:20.827823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:20.827823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:20.827823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:20.827823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:20.827823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:20.827823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:20.827823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:20.827823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:20.827823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:20.827823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:20.827823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:20.827823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:20.827823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:20.827823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:20.828744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:20.828744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:20.828744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:20.828744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:20.828744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:20.828744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:20.828744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:20.828744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:20.828744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:20.828744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:20.828744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:20.828744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:20.828744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:20.828744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:20.828744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:20.828744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:20.828744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:20.834281 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:20.834281 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:20.834281 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:20.834281 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:20.834281 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 392/774] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:20.837891 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb726c-8f36-4d3b-8823-b10ae41c5b5d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:20.873566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2635dc3-52fd-4ff0-8eda-ced6cbec4856 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:20.928481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:20.955143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb726c-8f36-4d3b-8823-b10ae41c5b5d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:20.962156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01db1ef-1f87-44c7-89e0-33b6c2956217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:20.963010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db1ef-1f87-44c7-89e0-33b6c2956217 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:20.963466 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db1ef-1f87-44c7-89e0-33b6c2956217 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:20.963892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db1ef-1f87-44c7-89e0-33b6c2956217 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:20.964936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01db1ef-1f87-44c7-89e0-33b6c2956217 None admin] RBAC: Adding query filter params (interface=public, service_id=b6364cec852d4f1f97186bc4cc103ea5, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:20.965399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01db1ef-1f87-44c7-89e0-33b6c2956217 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:20.967024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01db1ef-1f87-44c7-89e0-33b6c2956217 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:20.984366 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 383/775] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jun 27 10:57:20 2022] GET /identity/v3/endpoints?service_id=b6364cec852d4f1f97186bc4cc103ea5&interface=public®ion_id=RegionOne => generated 194 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:20.990533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01db1ef-1f87-44c7-89e0-33b6c2956217 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:20.998686 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39423729-179e-483e-9632-776bd4cc6dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:20.999484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39423729-179e-483e-9632-776bd4cc6dfb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:20.999845 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39423729-179e-483e-9632-776bd4cc6dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:21.000234 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39423729-179e-483e-9632-776bd4cc6dfb None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:21.001134 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39423729-179e-483e-9632-776bd4cc6dfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:21.001535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39423729-179e-483e-9632-776bd4cc6dfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:21.002962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39423729-179e-483e-9632-776bd4cc6dfb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:21.029405 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 393/776] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:21.032702 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39423729-179e-483e-9632-776bd4cc6dfb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:21.065739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:21.159431 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01db1ef-1f87-44c7-89e0-33b6c2956217 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:21.190841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39423729-179e-483e-9632-776bd4cc6dfb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:21.232829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2a167-e3fe-4c98-82a6-361259beec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:21.233651 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2a167-e3fe-4c98-82a6-361259beec68 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:21.233933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2a167-e3fe-4c98-82a6-361259beec68 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:21.234210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2a167-e3fe-4c98-82a6-361259beec68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:21.243676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc05dd-d674-4e07-855e-4e6da9d09b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:21.244219 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:21.244327 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc05dd-d674-4e07-855e-4e6da9d09b66 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:21.244611 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc05dd-d674-4e07-855e-4e6da9d09b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:21.244887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc05dd-d674-4e07-855e-4e6da9d09b66 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:21.245601 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc05dd-d674-4e07-855e-4e6da9d09b66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:21.246996 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc05dd-d674-4e07-855e-4e6da9d09b66 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:21.252899 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2a167-e3fe-4c98-82a6-361259beec68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:21.254396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2a167-e3fe-4c98-82a6-361259beec68 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:21.260917 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 384/777] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jun 27 10:57:20 2022] GET /identity/v3/services => generated 772 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:21.274185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-98c2a167-e3fe-4c98-82a6-361259beec68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:21.274185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:21.274185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:21.274185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:21.274185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:21.274185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:21.274185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:21.274185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:21.274185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:21.274185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:21.274185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:21.274185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:21.274185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:21.274185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:21.274185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:21.275154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:21.275154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:21.275154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:21.275154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:21.275154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:21.275154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:21.275154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:21.275154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:21.275154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:21.275154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:21.275154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:21.275154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:21.275154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:21.275154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:21.275154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:21.275154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:21.275154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:21.276020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:21.276020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:21.276020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:21.276020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:21.276020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:21.276020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:21.276020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:21.276020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:21.276020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 394/778] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:21.282695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc05dd-d674-4e07-855e-4e6da9d09b66 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:21.435042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc05dd-d674-4e07-855e-4e6da9d09b66 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:21.449809 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351adf6-273c-4c59-b566-b5a4cf2ef7ce None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:21.450134 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351adf6-273c-4c59-b566-b5a4cf2ef7ce None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:21.450374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351adf6-273c-4c59-b566-b5a4cf2ef7ce None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:21.451789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 395/779] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:57:21.458221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:21.463122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e24bcc-1c70-4127-af43-650a06bcdbca None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:21.463737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e24bcc-1c70-4127-af43-650a06bcdbca None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:21.464302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e24bcc-1c70-4127-af43-650a06bcdbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:21.482822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb70cb-9e08-4fdd-95db-b1f6a5ada235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:21.483625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb70cb-9e08-4fdd-95db-b1f6a5ada235 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:21.483974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb70cb-9e08-4fdd-95db-b1f6a5ada235 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:21.484315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb70cb-9e08-4fdd-95db-b1f6a5ada235 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:21.485190 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb70cb-9e08-4fdd-95db-b1f6a5ada235 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:21.485595 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb70cb-9e08-4fdd-95db-b1f6a5ada235 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:21.487137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb70cb-9e08-4fdd-95db-b1f6a5ada235 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:21.498561 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a1e24bcc-1c70-4127-af43-650a06bcdbca None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:21.500030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a1e24bcc-1c70-4127-af43-650a06bcdbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:21.504995 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 385/780] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:21.511845 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb70cb-9e08-4fdd-95db-b1f6a5ada235 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:21.619770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb70cb-9e08-4fdd-95db-b1f6a5ada235 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:21.622854 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 396/781] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:21.653561 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e24bcc-1c70-4127-af43-650a06bcdbca None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:21.667134 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba167b-08bc-4649-bc99-8035bc22a8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:21.667785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba167b-08bc-4649-bc99-8035bc22a8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:21.668065 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba167b-08bc-4649-bc99-8035bc22a8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:21.668336 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba167b-08bc-4649-bc99-8035bc22a8e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:21.669164 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba167b-08bc-4649-bc99-8035bc22a8e9 None admin] RBAC: Adding query filter params (role.id=e053e0425eb744e2a3e3316222e208f3, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=40c6739db5404d59a6799b2ace1c7982) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:21.669498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba167b-08bc-4649-bc99-8035bc22a8e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:21.670938 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba167b-08bc-4649-bc99-8035bc22a8e9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:21.685602 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 386/782] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:57:21 2022] GET /identity/v3/role_assignments?user.id=40c6739db5404d59a6799b2ace1c7982&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=e053e0425eb744e2a3e3316222e208f3 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:21.773070 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e24bcc-1c70-4127-af43-650a06bcdbca None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:21.841995 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea06e7b-f0c0-4e5d-82c1-cfec68d211c0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:21.842538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea06e7b-f0c0-4e5d-82c1-cfec68d211c0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:21.842964 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea06e7b-f0c0-4e5d-82c1-cfec68d211c0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:21.845030 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 387/783] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:57:21.850935 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c01e8-37e2-4b11-9b83-aaffa2516c32 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:21.852122 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c01e8-37e2-4b11-9b83-aaffa2516c32 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:21.852552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c01e8-37e2-4b11-9b83-aaffa2516c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:21.871329 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-704c01e8-37e2-4b11-9b83-aaffa2516c32 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:21.872828 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-704c01e8-37e2-4b11-9b83-aaffa2516c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:21.923570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:21.926616 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:21.938118 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d863b-47c3-4b77-9f30-5ece04c8e6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:21.938841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d863b-47c3-4b77-9f30-5ece04c8e6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:21.939119 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d863b-47c3-4b77-9f30-5ece04c8e6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:21.939387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d863b-47c3-4b77-9f30-5ece04c8e6b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:21.962565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d863b-47c3-4b77-9f30-5ece04c8e6b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:21.970150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-661d863b-47c3-4b77-9f30-5ece04c8e6b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:57:21.970150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:21.970150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:21.970150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:21.970150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:21.970150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:21.970150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:21.970150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:21.970150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:21.970150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:21.970150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:21.970150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:21.970150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:21.970150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:21.970150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:21.970150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:21.971097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:21.971097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:21.971097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:21.971097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:21.971097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:21.971097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:21.971097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:21.971097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:21.971097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:21.971097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:21.971097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:21.971097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:21.971097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:21.971097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:21.971097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:21.971097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:21.971917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:21.971917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:21.971917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:21.971917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:21.971917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:21.971917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:21.971917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:21.971917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:21.971917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:21.971917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:21.971917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:57:21.971917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:21.973110 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 397/784] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:57:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:21.985051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d863b-47c3-4b77-9f30-5ece04c8e6b4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:22.011585 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 388/785] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:22.051600 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c01e8-37e2-4b11-9b83-aaffa2516c32 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:22.154453 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d863b-47c3-4b77-9f30-5ece04c8e6b4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:22.193474 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c01e8-37e2-4b11-9b83-aaffa2516c32 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:22.228693 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b80a5-49af-4f4b-9a26-57092b15ee6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:22.229374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b80a5-49af-4f4b-9a26-57092b15ee6c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:22.229665 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b80a5-49af-4f4b-9a26-57092b15ee6c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:22.229938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b80a5-49af-4f4b-9a26-57092b15ee6c None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:22.230688 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b80a5-49af-4f4b-9a26-57092b15ee6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:22.230992 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b80a5-49af-4f4b-9a26-57092b15ee6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:22.232358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b80a5-49af-4f4b-9a26-57092b15ee6c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:22.233031 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1f5c9-b797-4ec4-a862-301107361e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:22.234110 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1f5c9-b797-4ec4-a862-301107361e4c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:22.234390 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1f5c9-b797-4ec4-a862-301107361e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:22.234664 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1f5c9-b797-4ec4-a862-301107361e4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:22.245929 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1f5c9-b797-4ec4-a862-301107361e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:22.252833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 398/786] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:57:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:22.258594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-72a1f5c9-b797-4ec4-a862-301107361e4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:57:22.258594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:22.258594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:22.258594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:22.258594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:22.258594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:22.258594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:22.258594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:22.258594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:22.258594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:22.258594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:22.258594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:22.258594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:22.258594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:22.258594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:22.258594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:22.259523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:22.259523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:22.259523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:22.259523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:22.259523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:22.259523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:22.259523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:22.259523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:22.259523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:22.259523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:22.259523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:22.259523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:22.259523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:22.259523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:22.259523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:22.259523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:22.260924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:22.260924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:22.260924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:22.260924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:22.260924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:22.260924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:22.260924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:22.260924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:22.260924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:22.260924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:22.260924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:57:22.260924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:22.261982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b80a5-49af-4f4b-9a26-57092b15ee6c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:22.262054 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 389/787] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:57:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:22.266400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1f5c9-b797-4ec4-a862-301107361e4c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:22.345753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:22.378622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1f5c9-b797-4ec4-a862-301107361e4c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:22.399542 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:22.418473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca965c6d-36d8-4175-b7e3-6a8e847431b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:22.419386 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca965c6d-36d8-4175-b7e3-6a8e847431b6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:22.419815 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca965c6d-36d8-4175-b7e3-6a8e847431b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:22.420493 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca965c6d-36d8-4175-b7e3-6a8e847431b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:22.421912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca965c6d-36d8-4175-b7e3-6a8e847431b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:22.422369 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca965c6d-36d8-4175-b7e3-6a8e847431b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:22.424064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca965c6d-36d8-4175-b7e3-6a8e847431b6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:22.433761 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 390/788] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:57:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:22.439127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca965c6d-36d8-4175-b7e3-6a8e847431b6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:22.524653 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b80a5-49af-4f4b-9a26-57092b15ee6c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:22.591610 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:22.593711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f140f7-727b-472e-8991-dd865fff82e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:22.594505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f140f7-727b-472e-8991-dd865fff82e7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:22.594783 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f140f7-727b-472e-8991-dd865fff82e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:22.595052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f140f7-727b-472e-8991-dd865fff82e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:22.603151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca965c6d-36d8-4175-b7e3-6a8e847431b6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:22.630238 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f140f7-727b-472e-8991-dd865fff82e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:22.631703 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f140f7-727b-472e-8991-dd865fff82e7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:22.641456 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725c2f8-a752-4447-9272-e1ed3cee765d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:22.642998 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725c2f8-a752-4447-9272-e1ed3cee765d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:22.643524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725c2f8-a752-4447-9272-e1ed3cee765d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:22.644006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725c2f8-a752-4447-9272-e1ed3cee765d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:22.655779 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725c2f8-a752-4447-9272-e1ed3cee765d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:22.657500 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725c2f8-a752-4447-9272-e1ed3cee765d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:22.673137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-57f140f7-727b-472e-8991-dd865fff82e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:22.673137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:22.673137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:22.673137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:22.673137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:22.673137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:22.673137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:22.673137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:22.673137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:22.673137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:22.673137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:22.673137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:22.673137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:22.673137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:22.673137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:22.674051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:22.674051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:22.674051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:22.674051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:22.674051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:22.674051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:22.674051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:22.674051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:22.674051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:22.674051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:22.674051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:22.674051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:22.674051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:22.674051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:22.674051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:22.674051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:22.674051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:22.674936 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:22.674936 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:22.674936 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:22.674936 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:22.677392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c725c2f8-a752-4447-9272-e1ed3cee765d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:22.677392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:22.677392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:22.677392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:22.677392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:22.677392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:22.677392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:22.677392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:22.677392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:22.677392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:22.677392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:22.677392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:22.677392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:22.677392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:22.677392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:22.678252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:22.678252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:22.678252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:22.678252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:22.678252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:22.678252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:22.678252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:22.678252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:22.678252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:22.678252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:22.678252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:22.678252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:22.678252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:22.678252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:22.678252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:22.678252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:22.678252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:22.679203 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:22.679203 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:22.679203 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:22.679203 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:22.681891 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 391/789] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:22.686099 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 399/790] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:22.687161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725c2f8-a752-4447-9272-e1ed3cee765d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:22.698367 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f140f7-727b-472e-8991-dd865fff82e7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:22.820840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725c2f8-a752-4447-9272-e1ed3cee765d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:22.869464 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:22.874115 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f140f7-727b-472e-8991-dd865fff82e7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:22.913416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d562f-02c9-474f-9757-bf96c8c69d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:22.915219 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d562f-02c9-474f-9757-bf96c8c69d4b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:22.915705 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d562f-02c9-474f-9757-bf96c8c69d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:22.916210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d562f-02c9-474f-9757-bf96c8c69d4b None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:22.917165 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d562f-02c9-474f-9757-bf96c8c69d4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:22.917737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d562f-02c9-474f-9757-bf96c8c69d4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:22.919573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d562f-02c9-474f-9757-bf96c8c69d4b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:22.922177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3b501-8c74-42cc-9df7-eea0cfb6af42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:22.922873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3b501-8c74-42cc-9df7-eea0cfb6af42 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:22.923189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3b501-8c74-42cc-9df7-eea0cfb6af42 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:22.923891 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3b501-8c74-42cc-9df7-eea0cfb6af42 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:22.924205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3b501-8c74-42cc-9df7-eea0cfb6af42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:22.924515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3b501-8c74-42cc-9df7-eea0cfb6af42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:22.925973 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3b501-8c74-42cc-9df7-eea0cfb6af42 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:22.940013 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 400/791] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:22.945384 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 392/792] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:22.946896 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d562f-02c9-474f-9757-bf96c8c69d4b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:22.947012 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3b501-8c74-42cc-9df7-eea0cfb6af42 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:22.950384 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:23.077303 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d562f-02c9-474f-9757-bf96c8c69d4b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:23.105636 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3b501-8c74-42cc-9df7-eea0cfb6af42 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:23.121961 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea49ce-0f54-43c4-bb6a-67002a27ceae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:23.122747 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea49ce-0f54-43c4-bb6a-67002a27ceae None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:23.123281 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea49ce-0f54-43c4-bb6a-67002a27ceae None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:23.123557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea49ce-0f54-43c4-bb6a-67002a27ceae None admin] PATH_INFO: `/v3/users/swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:23.133284 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea49ce-0f54-43c4-bb6a-67002a27ceae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:23.135435 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea49ce-0f54-43c4-bb6a-67002a27ceae None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:23.141949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b75e9-9479-45dd-83aa-dea28a126ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:23.142811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b75e9-9479-45dd-83aa-dea28a126ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:23.143166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b75e9-9479-45dd-83aa-dea28a126ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:23.143513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b75e9-9479-45dd-83aa-dea28a126ec5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:23.151167 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b75e9-9479-45dd-83aa-dea28a126ec5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:23.152672 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b75e9-9479-45dd-83aa-dea28a126ec5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:23.152897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-90ea49ce-0f54-43c4-bb6a-67002a27ceae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 10:57:23.152897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:23.152897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:23.152897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:23.152897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:23.152897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:23.152897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:23.152897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:23.152897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:23.152897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:23.152897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:23.152897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:23.152897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:23.152897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:23.152897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:23.152897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:23.153851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:23.155232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:23.155232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:23.155232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:23.155232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:23.155232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:23.155232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:23.155232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:23.155232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:23.155232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 10:57:23.155232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:23.155232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 401/793] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:57:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:23.156196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931613d0-0728-4dee-a258-382a4deaf923 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:23.156352 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931613d0-0728-4dee-a258-382a4deaf923 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:23.161387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931613d0-0728-4dee-a258-382a4deaf923 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:23.161387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 402/794] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:23.161387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931613d0-0728-4dee-a258-382a4deaf923 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:23.177484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d20b75e9-9479-45dd-83aa-dea28a126ec5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:57:23.177484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:23.177484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:23.177484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:23.177484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:23.177484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:23.177484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:23.177484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:23.177484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:23.177484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:23.177484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:23.177484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:23.177484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:23.177484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:23.177484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:23.177484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:23.180187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:23.182632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:23.182632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:23.182632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:23.182632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:23.182632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:23.182632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:23.182632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:23.182632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:23.182632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:57:23.182632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:23.193414 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:23.193605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 393/795] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jun 27 10:57:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:23.193605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77101afd-b0cc-44ff-b374-ed3856a8e950 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:23.193605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77101afd-b0cc-44ff-b374-ed3856a8e950 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:23.193605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77101afd-b0cc-44ff-b374-ed3856a8e950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:23.213274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-77101afd-b0cc-44ff-b374-ed3856a8e950 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:23.214829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-77101afd-b0cc-44ff-b374-ed3856a8e950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:23.277734 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:23.293407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 394/796] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:23.293407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77101afd-b0cc-44ff-b374-ed3856a8e950 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:23.307485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931613d0-0728-4dee-a258-382a4deaf923 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:23.357011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434ecfb-6547-4711-b0bd-b8ad775fd49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:23.357712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434ecfb-6547-4711-b0bd-b8ad775fd49e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:23.357995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434ecfb-6547-4711-b0bd-b8ad775fd49e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:23.358293 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434ecfb-6547-4711-b0bd-b8ad775fd49e None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:23.359106 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434ecfb-6547-4711-b0bd-b8ad775fd49e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:23.359410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434ecfb-6547-4711-b0bd-b8ad775fd49e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:23.360878 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434ecfb-6547-4711-b0bd-b8ad775fd49e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:23.383689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 403/797] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Jun 27 10:57:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:23.384622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434ecfb-6547-4711-b0bd-b8ad775fd49e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:23.419337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77101afd-b0cc-44ff-b374-ed3856a8e950 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:23.454787 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65bfd0-d8a9-471d-a179-b2b16b40e1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:23.455825 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65bfd0-d8a9-471d-a179-b2b16b40e1ba None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:23.456331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65bfd0-d8a9-471d-a179-b2b16b40e1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:23.456802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65bfd0-d8a9-471d-a179-b2b16b40e1ba None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:23.457882 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65bfd0-d8a9-471d-a179-b2b16b40e1ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:23.458405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65bfd0-d8a9-471d-a179-b2b16b40e1ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:23.460030 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65bfd0-d8a9-471d-a179-b2b16b40e1ba None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:23.467318 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:23.485327 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 395/798] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jun 27 10:57:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:23.486505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65bfd0-d8a9-471d-a179-b2b16b40e1ba None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:23.492234 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434ecfb-6547-4711-b0bd-b8ad775fd49e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:23.533347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d320160-af88-4258-aaef-56fb7da46b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:23.534770 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d320160-af88-4258-aaef-56fb7da46b0c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:23.535379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d320160-af88-4258-aaef-56fb7da46b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:23.535766 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d320160-af88-4258-aaef-56fb7da46b0c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:23.536538 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d320160-af88-4258-aaef-56fb7da46b0c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:23.538784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d320160-af88-4258-aaef-56fb7da46b0c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:23.542850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:23.558429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-3d320160-af88-4258-aaef-56fb7da46b0c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 10:57:23.558429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:23.558429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:23.558429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:23.558429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:23.558429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:23.558429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:23.558429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:23.558429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 10:57:23.558429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:23.558429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:23.558429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:23.558429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:23.558429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:23.558429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:23.558429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:23.559431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:23.559431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:23.559431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:23.559431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:23.559431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:23.559431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:23.559431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:23.559431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:23.559431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:23.559431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:23.559431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:23.559431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:23.559431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:23.559431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:23.559431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:23.559431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:23.560256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:23.560256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:23.560256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:23.560256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:23.560256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:23.560256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:23.560256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:23.560256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:23.560256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:23.560256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:23.560256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:23.560256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:23.560256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:23.560256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 10:57:23.560256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:23.564832 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 404/799] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Jun 27 10:57:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:23.566396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d320160-af88-4258-aaef-56fb7da46b0c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:23.606201 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65bfd0-d8a9-471d-a179-b2b16b40e1ba None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:23.642984 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2c6b3-e886-42bb-9955-cb110e513e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:23.644065 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2c6b3-e886-42bb-9955-cb110e513e39 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:23.644530 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2c6b3-e886-42bb-9955-cb110e513e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:23.645015 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2c6b3-e886-42bb-9955-cb110e513e39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:23.656547 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2c6b3-e886-42bb-9955-cb110e513e39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:23.658442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2c6b3-e886-42bb-9955-cb110e513e39 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:23.686889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-efa2c6b3-e886-42bb-9955-cb110e513e39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:23.686889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:23.686889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:23.686889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:23.686889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:23.686889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:23.686889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:23.686889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:23.686889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:23.686889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:23.686889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:23.686889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:23.686889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:23.686889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:23.686889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:23.687860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:23.687860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:23.687860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:23.687860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:23.687860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:23.687860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:23.687860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:23.687860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:23.687860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:23.687860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:23.687860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:23.687860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:23.687860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:23.687860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:23.687860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:23.687860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:23.687860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:23.688767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:23.688767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:23.688767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:23.688767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:23.692916 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 396/800] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:23.693774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2c6b3-e886-42bb-9955-cb110e513e39 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:23.698844 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d320160-af88-4258-aaef-56fb7da46b0c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:23.739614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701d8e6-9ef3-4600-ad26-5b3a0e96fa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:23.740268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701d8e6-9ef3-4600-ad26-5b3a0e96fa07 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:23.740549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701d8e6-9ef3-4600-ad26-5b3a0e96fa07 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:23.740826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701d8e6-9ef3-4600-ad26-5b3a0e96fa07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:23.757267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:23.810610 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2c6b3-e886-42bb-9955-cb110e513e39 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:23.812652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:23.837405 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701d8e6-9ef3-4600-ad26-5b3a0e96fa07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:23.839518 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701d8e6-9ef3-4600-ad26-5b3a0e96fa07 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:23.851207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937854c7-5f72-4a6b-b615-f9a823f500f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:23.852243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937854c7-5f72-4a6b-b615-f9a823f500f0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:23.852734 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937854c7-5f72-4a6b-b615-f9a823f500f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:23.853210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937854c7-5f72-4a6b-b615-f9a823f500f0 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:23.854216 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937854c7-5f72-4a6b-b615-f9a823f500f0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:23.854747 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937854c7-5f72-4a6b-b615-f9a823f500f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:23.856334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937854c7-5f72-4a6b-b615-f9a823f500f0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:23.866490 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 397/801] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jun 27 10:57:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:23.867687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937854c7-5f72-4a6b-b615-f9a823f500f0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:23.949501 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 405/802] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:57:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:57:23.950104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701d8e6-9ef3-4600-ad26-5b3a0e96fa07 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:23.972709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937854c7-5f72-4a6b-b615-f9a823f500f0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:23.991447 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:24.005644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b467d-8764-4fe0-95db-4d8d9fa4ba57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:24.006299 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b467d-8764-4fe0-95db-4d8d9fa4ba57 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:24.006581 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b467d-8764-4fe0-95db-4d8d9fa4ba57 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:24.006852 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b467d-8764-4fe0-95db-4d8d9fa4ba57 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:24.008083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b467d-8764-4fe0-95db-4d8d9fa4ba57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:24.008382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b467d-8764-4fe0-95db-4d8d9fa4ba57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:24.009785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b467d-8764-4fe0-95db-4d8d9fa4ba57 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:24.020902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 398/803] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:24.022204 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4c5b6-681b-4817-b337-eff4fd373343 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:24.022494 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4c5b6-681b-4817-b337-eff4fd373343 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:24.022768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4c5b6-681b-4817-b337-eff4fd373343 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:24.024741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 399/804] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:24.025955 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a4d80-b73c-425c-a091-fe57ec010e6f None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:24.026208 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a4d80-b73c-425c-a091-fe57ec010e6f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:24.026487 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a4d80-b73c-425c-a091-fe57ec010e6f None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:24.027819 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 400/805] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:24.028435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a4d80-b73c-425c-a091-fe57ec010e6f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:24.051732 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701d8e6-9ef3-4600-ad26-5b3a0e96fa07 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:24.057280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:24.085358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797ea00-dd3e-4033-9f5e-ebe11160cda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:24.086128 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ea00-dd3e-4033-9f5e-ebe11160cda5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:24.086409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ea00-dd3e-4033-9f5e-ebe11160cda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:24.086679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ea00-dd3e-4033-9f5e-ebe11160cda5 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:24.087375 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797ea00-dd3e-4033-9f5e-ebe11160cda5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:24.087678 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797ea00-dd3e-4033-9f5e-ebe11160cda5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:24.089036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797ea00-dd3e-4033-9f5e-ebe11160cda5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:24.093670 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 406/806] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jun 27 10:57:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:24.094424 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797ea00-dd3e-4033-9f5e-ebe11160cda5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:24.133814 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a4d80-b73c-425c-a091-fe57ec010e6f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:24.165930 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd1c20-2534-4d1e-b370-cbebb531b303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:24.166710 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd1c20-2534-4d1e-b370-cbebb531b303 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:24.166993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd1c20-2534-4d1e-b370-cbebb531b303 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:24.167269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd1c20-2534-4d1e-b370-cbebb531b303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:24.177627 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd1c20-2534-4d1e-b370-cbebb531b303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:24.179065 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd1c20-2534-4d1e-b370-cbebb531b303 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:24.192020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797ea00-dd3e-4033-9f5e-ebe11160cda5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:24.196900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-cbdd1c20-2534-4d1e-b370-cbebb531b303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:24.196900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:24.196900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:24.196900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:24.196900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:24.196900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:24.196900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:24.196900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:24.196900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:24.196900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:24.196900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:24.196900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:24.196900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:24.196900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:24.196900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:24.198039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:24.198039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:24.198039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:24.198039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:24.198039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:24.198039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:24.198039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:24.198039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:24.198039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:24.198039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:24.198039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:24.198039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:24.198039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:24.198039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:24.198039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:24.198039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:24.198039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:24.203852 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:24.203852 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:24.203852 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:24.203852 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:24.203852 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 401/807] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:24.203852 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a003f0c-b346-4535-a0b7-8890ad67c10a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:24.203852 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a003f0c-b346-4535-a0b7-8890ad67c10a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:24.203852 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a003f0c-b346-4535-a0b7-8890ad67c10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:24.206055 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:24.218980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0a003f0c-b346-4535-a0b7-8890ad67c10a None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:24.220164 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0a003f0c-b346-4535-a0b7-8890ad67c10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:24.227294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8721a2-8089-43a9-a44d-5f80ae401a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:24.228078 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8721a2-8089-43a9-a44d-5f80ae401a23 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:24.228354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8721a2-8089-43a9-a44d-5f80ae401a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:24.228625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8721a2-8089-43a9-a44d-5f80ae401a23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:24.235112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8721a2-8089-43a9-a44d-5f80ae401a23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:24.236529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8721a2-8089-43a9-a44d-5f80ae401a23 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:24.250308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-bd8721a2-8089-43a9-a44d-5f80ae401a23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:24.250308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:24.250308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:24.250308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:24.250308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:24.250308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:24.250308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:24.250308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:24.250308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:24.250308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:24.250308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:24.250308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:24.250308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:24.250308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:24.250308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:24.251274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:24.251274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:24.251274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:24.251274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:24.251274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:24.251274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:24.251274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:24.251274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:24.251274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:24.251274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:24.251274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:24.251274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:24.251274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:24.251274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:24.251274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:24.251274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:24.251274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:24.252194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:24.252194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:24.252194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:24.252194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:24.252194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:24.252194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:24.252194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:24.252194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:24.252194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 407/808] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:24.252982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43893c42-3a5d-4415-8195-59b92cf2dd70 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:24.253266 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43893c42-3a5d-4415-8195-59b92cf2dd70 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:24.253480 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43893c42-3a5d-4415-8195-59b92cf2dd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:24.269800 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-43893c42-3a5d-4415-8195-59b92cf2dd70 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:24.270968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-43893c42-3a5d-4415-8195-59b92cf2dd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:24.285348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 402/809] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:24.286045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a003f0c-b346-4535-a0b7-8890ad67c10a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:24.296039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:24.341642 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 408/810] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:24.342482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43893c42-3a5d-4415-8195-59b92cf2dd70 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:24.397249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a003f0c-b346-4535-a0b7-8890ad67c10a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:24.430765 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77428f2-479e-499f-9ac7-d65e072e7f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:24.431419 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77428f2-479e-499f-9ac7-d65e072e7f35 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:24.431703 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77428f2-479e-499f-9ac7-d65e072e7f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:24.431978 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77428f2-479e-499f-9ac7-d65e072e7f35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:24.432709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77428f2-479e-499f-9ac7-d65e072e7f35 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:24.433175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:24.434109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77428f2-479e-499f-9ac7-d65e072e7f35 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:24.439228 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43893c42-3a5d-4415-8195-59b92cf2dd70 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:24.453646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 403/811] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jun 27 10:57:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:57:24.454854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77428f2-479e-499f-9ac7-d65e072e7f35 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:24.498689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b2ad1-605d-45a8-bd73-0f3ad1bf425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:24.499372 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b2ad1-605d-45a8-bd73-0f3ad1bf425f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:24.499654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b2ad1-605d-45a8-bd73-0f3ad1bf425f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:24.499926 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b2ad1-605d-45a8-bd73-0f3ad1bf425f None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:24.501075 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b2ad1-605d-45a8-bd73-0f3ad1bf425f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:24.501431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b2ad1-605d-45a8-bd73-0f3ad1bf425f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:24.503192 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b2ad1-605d-45a8-bd73-0f3ad1bf425f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:24.520422 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 409/812] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:24.520422 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b2ad1-605d-45a8-bd73-0f3ad1bf425f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:24.528871 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:24.576969 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77428f2-479e-499f-9ac7-d65e072e7f35 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:24.616661 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663752f-bd55-4d78-a0f6-d26668e6772a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:24.618150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663752f-bd55-4d78-a0f6-d26668e6772a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:24.618262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663752f-bd55-4d78-a0f6-d26668e6772a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:24.618535 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663752f-bd55-4d78-a0f6-d26668e6772a None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:24.619399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663752f-bd55-4d78-a0f6-d26668e6772a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:24.619626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663752f-bd55-4d78-a0f6-d26668e6772a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:24.621091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663752f-bd55-4d78-a0f6-d26668e6772a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:24.634099 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 404/813] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:24.635683 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663752f-bd55-4d78-a0f6-d26668e6772a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:24.643274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b2ad1-605d-45a8-bd73-0f3ad1bf425f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:24.677304 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8da6ef-59e7-4740-9e9a-cb840ceb8657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:24.678162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8da6ef-59e7-4740-9e9a-cb840ceb8657 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:24.678449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8da6ef-59e7-4740-9e9a-cb840ceb8657 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:24.678723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8da6ef-59e7-4740-9e9a-cb840ceb8657 None admin] PATH_INFO: `/v3/services/network` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:24.679367 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8da6ef-59e7-4740-9e9a-cb840ceb8657 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:24.681383 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8da6ef-59e7-4740-9e9a-cb840ceb8657 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:24.693020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-fe8da6ef-59e7-4740-9e9a-cb840ceb8657 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 10:57:24.693020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:24.693020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:24.693020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:24.693020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:24.693020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:24.693020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:24.693020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:24.693020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 10:57:24.693020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:24.693020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:24.693020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:24.693020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:24.693020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:24.693020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:24.693020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:24.693020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:24.694162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:24.694162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:24.694162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:24.694162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:24.694162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:24.694162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:24.694162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:24.694162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:24.694162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:24.694162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:24.694162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:24.694162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:24.694162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:24.694162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:24.694162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:24.694162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:24.695285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:24.695285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:24.695285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:24.695285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:24.695285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:24.695285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:24.695285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:24.695285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:24.695285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:24.695285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:24.695285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:24.695285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:24.695285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 10:57:24.695285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:24.699058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 410/814] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:24 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:24.699898 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8da6ef-59e7-4740-9e9a-cb840ceb8657 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:24.717440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:24.750113 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663752f-bd55-4d78-a0f6-d26668e6772a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:24.776139 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:24.787953 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41310690-ed13-48e1-aa0b-f2f760a8de17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:24.788747 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41310690-ed13-48e1-aa0b-f2f760a8de17 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:24.789573 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41310690-ed13-48e1-aa0b-f2f760a8de17 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:24.789849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41310690-ed13-48e1-aa0b-f2f760a8de17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:24.800081 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8da6ef-59e7-4740-9e9a-cb840ceb8657 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:24.800371 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41310690-ed13-48e1-aa0b-f2f760a8de17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:24.808688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-41310690-ed13-48e1-aa0b-f2f760a8de17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:24.808688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:24.808688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:24.808688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:24.808688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:24.808688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:24.808688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:24.808688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:24.808688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:24.808688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:24.808688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:24.808688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:24.808688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:24.808688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:24.808688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:24.808688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:24.809685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:24.809685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:24.809685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:24.809685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:24.809685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:24.809685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:24.809685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:24.809685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:24.809685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:24.809685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:24.809685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:24.809685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:24.809685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:24.809685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:24.809685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:24.809685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:24.810531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:24.810531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:24.810531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:24.810531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:24.810531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:24.810531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:24.810531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:24.810531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:24.810531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:24.810531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:24.810531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:24.810531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:24.810531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 405/815] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:57:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:24.811250 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41310690-ed13-48e1-aa0b-f2f760a8de17 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:24.840097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191f1f3-8b6d-4ffb-b8ad-657bdc9df078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:24.840988 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191f1f3-8b6d-4ffb-b8ad-657bdc9df078 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:24.841277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191f1f3-8b6d-4ffb-b8ad-657bdc9df078 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:24.841585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191f1f3-8b6d-4ffb-b8ad-657bdc9df078 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:24.848436 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191f1f3-8b6d-4ffb-b8ad-657bdc9df078 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:24.849910 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191f1f3-8b6d-4ffb-b8ad-657bdc9df078 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:24.864715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-0191f1f3-8b6d-4ffb-b8ad-657bdc9df078 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:24.864715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:24.864715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:24.864715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:24.864715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:24.864715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:24.864715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:24.864715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:24.864715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:24.864715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:24.864715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:24.864715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:24.864715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:24.864715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:24.864715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:24.865637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:24.865637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:24.865637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:24.865637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:24.865637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:24.865637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:24.865637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:24.865637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:24.865637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:24.865637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:24.865637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:24.865637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:24.865637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:24.865637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:24.865637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:24.865637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:24.865637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:24.867143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:24.867143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:24.867143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:24.867143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:24.867143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:24.867143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:24.867143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:24.867143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:24.867143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 411/816] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:24.867143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191f1f3-8b6d-4ffb-b8ad-657bdc9df078 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:24.924380 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41310690-ed13-48e1-aa0b-f2f760a8de17 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:24.949297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:24.963557 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ff322-04dc-45f8-855f-6185a2fe8a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:24.965113 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ff322-04dc-45f8-855f-6185a2fe8a3b None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:24.965434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ff322-04dc-45f8-855f-6185a2fe8a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:24.965867 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ff322-04dc-45f8-855f-6185a2fe8a3b None admin] PATH_INFO: `/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/189af68908944b5e9a7cb35fde0e1bd3/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:24.968821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ff322-04dc-45f8-855f-6185a2fe8a3b None admin] RBAC: Authorizing `identity:create_grant(project_id=6543a66af8ba48c391ce686f6d82276b, user_id=189af68908944b5e9a7cb35fde0e1bd3, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:24.971038 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ff322-04dc-45f8-855f-6185a2fe8a3b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:24.973562 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191f1f3-8b6d-4ffb-b8ad-657bdc9df078 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:24.989440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 406/817] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:57:24 2022] PUT /identity/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/189af68908944b5e9a7cb35fde0e1bd3/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:57:24.990501 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ff322-04dc-45f8-855f-6185a2fe8a3b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:25.022188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d2e72-7855-40e7-ab68-3ad8bf751507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:25.023834 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d2e72-7855-40e7-ab68-3ad8bf751507 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:25.024315 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d2e72-7855-40e7-ab68-3ad8bf751507 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:25.024793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d2e72-7855-40e7-ab68-3ad8bf751507 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:25.025947 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d2e72-7855-40e7-ab68-3ad8bf751507 None admin] RBAC: Adding query filter params (name=network) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:25.026525 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d2e72-7855-40e7-ab68-3ad8bf751507 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:25.028485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d2e72-7855-40e7-ab68-3ad8bf751507 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:25.034862 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 412/818] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jun 27 10:57:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:25.036202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d2e72-7855-40e7-ab68-3ad8bf751507 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:25.049702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:25.115728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ff322-04dc-45f8-855f-6185a2fe8a3b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:25.156219 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfb56a-e737-4e25-ae40-69954cdd5a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:25.157257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfb56a-e737-4e25-ae40-69954cdd5a5e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:25.157817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfb56a-e737-4e25-ae40-69954cdd5a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:25.158302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfb56a-e737-4e25-ae40-69954cdd5a5e None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:25.159240 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfb56a-e737-4e25-ae40-69954cdd5a5e None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:25.159750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfb56a-e737-4e25-ae40-69954cdd5a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:25.161346 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfb56a-e737-4e25-ae40-69954cdd5a5e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:25.176189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 407/819] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:57:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:25.176189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfb56a-e737-4e25-ae40-69954cdd5a5e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:25.186279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d2e72-7855-40e7-ab68-3ad8bf751507 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:25.233155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f0f80-66b5-42d2-a770-d20e31271f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:25.233785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f0f80-66b5-42d2-a770-d20e31271f0b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:25.234032 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f0f80-66b5-42d2-a770-d20e31271f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:25.234334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f0f80-66b5-42d2-a770-d20e31271f0b None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:25.235112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f0f80-66b5-42d2-a770-d20e31271f0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:25.235438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f0f80-66b5-42d2-a770-d20e31271f0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:25.236824 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f0f80-66b5-42d2-a770-d20e31271f0b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:25.245663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:25.249649 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 413/820] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:25.250453 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f0f80-66b5-42d2-a770-d20e31271f0b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:25.308392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfb56a-e737-4e25-ae40-69954cdd5a5e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:25.318764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:25.354889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666ef91-1bf5-4c6b-8ad3-16cefd2d90d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:25.356034 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666ef91-1bf5-4c6b-8ad3-16cefd2d90d2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:25.356471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666ef91-1bf5-4c6b-8ad3-16cefd2d90d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:25.356923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666ef91-1bf5-4c6b-8ad3-16cefd2d90d2 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:25.357525 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f0f80-66b5-42d2-a770-d20e31271f0b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:25.357976 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666ef91-1bf5-4c6b-8ad3-16cefd2d90d2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:25.358430 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666ef91-1bf5-4c6b-8ad3-16cefd2d90d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:25.360899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666ef91-1bf5-4c6b-8ad3-16cefd2d90d2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:25.367080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 408/821] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jun 27 10:57:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:25.368427 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666ef91-1bf5-4c6b-8ad3-16cefd2d90d2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:25.399327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee820e4f-3b85-47f1-b450-603b40024347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:25.400167 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee820e4f-3b85-47f1-b450-603b40024347 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:25.400537 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee820e4f-3b85-47f1-b450-603b40024347 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:25.400945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee820e4f-3b85-47f1-b450-603b40024347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:25.412126 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee820e4f-3b85-47f1-b450-603b40024347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:25.413790 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee820e4f-3b85-47f1-b450-603b40024347 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:25.431262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-ee820e4f-3b85-47f1-b450-603b40024347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:25.431262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:25.431262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:25.431262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:25.431262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:25.431262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:25.431262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:25.431262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:25.431262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:25.431262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:25.431262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:25.431262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:25.431262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:25.431262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:25.431262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:25.432360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:25.432360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:25.432360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:25.432360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:25.432360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:25.432360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:25.432360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:25.432360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:25.432360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:25.432360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:25.432360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:25.432360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:25.432360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:25.432360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:25.432360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:25.432360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:25.432360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:25.433473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:25.433473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:25.433473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:25.433473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:25.435166 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 414/822] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:25.435946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee820e4f-3b85-47f1-b450-603b40024347 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:25.493643 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:25.503703 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666ef91-1bf5-4c6b-8ad3-16cefd2d90d2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:25.545584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392d29c-fb69-4a3a-962e-87eee74328cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:25.546242 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392d29c-fb69-4a3a-962e-87eee74328cd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:25.546526 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392d29c-fb69-4a3a-962e-87eee74328cd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:25.546802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392d29c-fb69-4a3a-962e-87eee74328cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:25.547639 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392d29c-fb69-4a3a-962e-87eee74328cd None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=ed08c367a3d34207a51914ff77a93898) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:25.547956 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392d29c-fb69-4a3a-962e-87eee74328cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:25.549411 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392d29c-fb69-4a3a-962e-87eee74328cd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:25.555132 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee820e4f-3b85-47f1-b450-603b40024347 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:25.556348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 409/823] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:57:25 2022] GET /identity/v3/role_assignments?user.id=ed08c367a3d34207a51914ff77a93898&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:25.557159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392d29c-fb69-4a3a-962e-87eee74328cd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:25.597080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:25.612972 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a8a1f-4380-4dab-a4f5-191903a613a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:25.613687 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a8a1f-4380-4dab-a4f5-191903a613a4 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:25.613971 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a8a1f-4380-4dab-a4f5-191903a613a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:25.614248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a8a1f-4380-4dab-a4f5-191903a613a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:25.615094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a8a1f-4380-4dab-a4f5-191903a613a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:25.616549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a8a1f-4380-4dab-a4f5-191903a613a4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:25.648757 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 415/824] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jun 27 10:57:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:57:25.688235 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392d29c-fb69-4a3a-962e-87eee74328cd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:25.735174 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c0844-78d8-413c-b49a-4c1b5950c7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:25.736180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c0844-78d8-413c-b49a-4c1b5950c7cf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:25.736624 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c0844-78d8-413c-b49a-4c1b5950c7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:25.737056 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c0844-78d8-413c-b49a-4c1b5950c7cf None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:25.738005 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c0844-78d8-413c-b49a-4c1b5950c7cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:25.738470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c0844-78d8-413c-b49a-4c1b5950c7cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:25.740063 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c0844-78d8-413c-b49a-4c1b5950c7cf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:25.754524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 410/825] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:25.760268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a8a1f-4380-4dab-a4f5-191903a613a4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:25.874833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a8a1f-4380-4dab-a4f5-191903a613a4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:25.885454 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:25.914707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ab249-899f-419e-be51-4cfc870e9b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:25.915508 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ab249-899f-419e-be51-4cfc870e9b49 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:25.915785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ab249-899f-419e-be51-4cfc870e9b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:25.916052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ab249-899f-419e-be51-4cfc870e9b49 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:25.923930 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ab249-899f-419e-be51-4cfc870e9b49 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:25.925434 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ab249-899f-419e-be51-4cfc870e9b49 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:25.940696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-c08ab249-899f-419e-be51-4cfc870e9b49 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 10:57:25.940696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:25.940696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:25.940696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:25.940696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:25.940696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:25.940696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:25.940696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:25.940696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:25.940696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:25.940696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:25.940696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:25.940696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:25.940696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:25.940696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:25.940696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:25.941718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:25.942664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:25.942664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:25.942664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:25.942664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:25.942664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:25.942664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:25.942664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:25.942664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:25.942664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 10:57:25.942664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:25.942664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 416/826] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jun 27 10:57:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:25.949313 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c0844-78d8-413c-b49a-4c1b5950c7cf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:26.058774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:26.069455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c0844-78d8-413c-b49a-4c1b5950c7cf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:26.107703 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5297e9-b6e3-4367-bdee-93dee947fe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:26.108375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5297e9-b6e3-4367-bdee-93dee947fe94 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:26.108658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5297e9-b6e3-4367-bdee-93dee947fe94 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:26.108936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5297e9-b6e3-4367-bdee-93dee947fe94 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:26.109834 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5297e9-b6e3-4367-bdee-93dee947fe94 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:26.110142 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5297e9-b6e3-4367-bdee-93dee947fe94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:26.111594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5297e9-b6e3-4367-bdee-93dee947fe94 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:26.130751 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 411/827] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Jun 27 10:57:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:26.135856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ab249-899f-419e-be51-4cfc870e9b49 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:26.248511 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ab249-899f-419e-be51-4cfc870e9b49 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:26.285041 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3333db7-a13f-4696-b373-b8cf04947556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:26.285864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3333db7-a13f-4696-b373-b8cf04947556 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:26.286146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3333db7-a13f-4696-b373-b8cf04947556 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:26.286419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3333db7-a13f-4696-b373-b8cf04947556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:26.298011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3333db7-a13f-4696-b373-b8cf04947556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:26.299449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3333db7-a13f-4696-b373-b8cf04947556 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:26.317475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f3333db7-a13f-4696-b373-b8cf04947556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:26.317475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:26.317475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:26.317475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:26.317475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:26.317475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:26.317475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:26.317475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:26.317475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:26.317475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:26.317475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:26.317475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:26.317475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:26.317475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:26.317475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:26.318420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:26.318420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:26.318420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:26.318420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:26.318420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:26.318420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:26.318420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:26.318420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:26.318420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:26.318420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:26.318420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:26.318420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:26.318420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:26.318420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:26.318420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:26.318420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:26.318420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:26.319312 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:26.319312 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:26.319312 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:26.319312 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:26.319312 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 417/828] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:26.324401 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5297e9-b6e3-4367-bdee-93dee947fe94 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:26.433744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5297e9-b6e3-4367-bdee-93dee947fe94 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:26.469843 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076c88e-1854-4ac8-ad5d-f3a814ce363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:26.470781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076c88e-1854-4ac8-ad5d-f3a814ce363c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:26.471214 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076c88e-1854-4ac8-ad5d-f3a814ce363c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:26.471636 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076c88e-1854-4ac8-ad5d-f3a814ce363c None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:26.472506 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076c88e-1854-4ac8-ad5d-f3a814ce363c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:26.472957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076c88e-1854-4ac8-ad5d-f3a814ce363c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:26.474533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076c88e-1854-4ac8-ad5d-f3a814ce363c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:26.487306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 412/829] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:26.497474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3333db7-a13f-4696-b373-b8cf04947556 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:26.519680 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:26.598805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3333db7-a13f-4696-b373-b8cf04947556 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:26.632710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746c308-2168-49f1-9948-7d35d861cf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:26.633582 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746c308-2168-49f1-9948-7d35d861cf8e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:26.633863 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746c308-2168-49f1-9948-7d35d861cf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:26.634181 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746c308-2168-49f1-9948-7d35d861cf8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:26.641274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746c308-2168-49f1-9948-7d35d861cf8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:26.642747 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746c308-2168-49f1-9948-7d35d861cf8e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:26.657351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-8746c308-2168-49f1-9948-7d35d861cf8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:26.657351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:26.657351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:26.657351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:26.657351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:26.657351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:26.657351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:26.657351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:26.657351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:26.657351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:26.657351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:26.657351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:26.657351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:26.657351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:26.657351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:26.658265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:26.658265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:26.658265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:26.658265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:26.658265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:26.658265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:26.658265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:26.658265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:26.658265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:26.658265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:26.658265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:26.658265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:26.658265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:26.658265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:26.658265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:26.658265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:26.658265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:26.659252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:26.659252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:26.659252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:26.659252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:26.659252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:26.659252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:26.659252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:26.659252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:26.659252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 418/830] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:26.665048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076c88e-1854-4ac8-ad5d-f3a814ce363c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:26.676716 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:26.717619 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59537e-4ff0-4960-b3e3-c261e12b4632 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:26.717938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59537e-4ff0-4960-b3e3-c261e12b4632 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:26.718212 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59537e-4ff0-4960-b3e3-c261e12b4632 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:26.719929 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 419/831] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:57:26.724961 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047461fc-a93c-4312-a275-be6d8127fab8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:26.725253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047461fc-a93c-4312-a275-be6d8127fab8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:26.725573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047461fc-a93c-4312-a275-be6d8127fab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:26.742881 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-047461fc-a93c-4312-a275-be6d8127fab8 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:26.744074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-047461fc-a93c-4312-a275-be6d8127fab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:26.776619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076c88e-1854-4ac8-ad5d-f3a814ce363c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:26.817753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c28200-f8a0-4821-b2a9-b253eb31b2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:26.818445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c28200-f8a0-4821-b2a9-b253eb31b2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:26.818733 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c28200-f8a0-4821-b2a9-b253eb31b2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:26.819136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c28200-f8a0-4821-b2a9-b253eb31b2f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:26.820544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c28200-f8a0-4821-b2a9-b253eb31b2f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:26.820861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c28200-f8a0-4821-b2a9-b253eb31b2f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:26.822444 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c28200-f8a0-4821-b2a9-b253eb31b2f6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:26.825897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 420/832] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:26.836738 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 413/833] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:26.842997 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047461fc-a93c-4312-a275-be6d8127fab8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:26.852985 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c28200-f8a0-4821-b2a9-b253eb31b2f6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:26.857075 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:26.938720 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:26.969415 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047461fc-a93c-4312-a275-be6d8127fab8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:26.983515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c28200-f8a0-4821-b2a9-b253eb31b2f6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:27.006938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda6afa-41b6-4a40-99e4-30a388bd1c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:27.008744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda6afa-41b6-4a40-99e4-30a388bd1c8d None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:27.009233 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda6afa-41b6-4a40-99e4-30a388bd1c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:27.009779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda6afa-41b6-4a40-99e4-30a388bd1c8d None admin] PATH_INFO: `/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/40c6739db5404d59a6799b2ace1c7982/roles/e053e0425eb744e2a3e3316222e208f3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:27.025257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b3323-821a-4ff0-a57c-56e8fbc5655e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:27.026098 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b3323-821a-4ff0-a57c-56e8fbc5655e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:27.026378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b3323-821a-4ff0-a57c-56e8fbc5655e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:27.026654 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b3323-821a-4ff0-a57c-56e8fbc5655e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:27.027305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b3323-821a-4ff0-a57c-56e8fbc5655e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:27.028043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda6afa-41b6-4a40-99e4-30a388bd1c8d None admin] RBAC: Authorizing `identity:create_grant(project_id=6543a66af8ba48c391ce686f6d82276b, user_id=40c6739db5404d59a6799b2ace1c7982, role_id=e053e0425eb744e2a3e3316222e208f3)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:27.028673 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b3323-821a-4ff0-a57c-56e8fbc5655e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:27.029921 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda6afa-41b6-4a40-99e4-30a388bd1c8d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:27.042269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-255b3323-821a-4ff0-a57c-56e8fbc5655e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 10:57:27.042269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:27.042269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:27.042269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:27.042269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:27.042269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:27.042269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:27.042269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:27.042269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 10:57:27.042269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:27.042269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:27.042269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:27.042269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:27.042269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:27.042269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:27.042269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:27.042269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:27.043295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:27.043295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:27.043295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:27.043295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:27.043295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:27.043295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:27.043295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:27.043295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:27.043295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:27.043295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:27.043295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:27.043295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:27.043295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:27.043295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:27.043295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:27.043295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:27.044182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:27.044182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:27.044182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:27.044182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:27.044182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:27.044182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:27.044182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:27.044182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:27.044182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:27.044182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:27.044182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:27.044182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:27.044182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 10:57:27.044182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:27.048502 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 414/834] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:57:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:27.049871 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b3323-821a-4ff0-a57c-56e8fbc5655e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:27.051245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 421/835] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:57:26 2022] PUT /identity/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/40c6739db5404d59a6799b2ace1c7982/roles/e053e0425eb744e2a3e3316222e208f3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:57:27.161494 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b3323-821a-4ff0-a57c-56e8fbc5655e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:27.193878 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:27.202950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e453cb-506b-4462-851e-6e860bafb6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:27.206488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e453cb-506b-4462-851e-6e860bafb6aa None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:27.206488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e453cb-506b-4462-851e-6e860bafb6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:27.206488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e453cb-506b-4462-851e-6e860bafb6aa None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:27.206488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e453cb-506b-4462-851e-6e860bafb6aa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:27.206488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e453cb-506b-4462-851e-6e860bafb6aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:27.206488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e453cb-506b-4462-851e-6e860bafb6aa None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:27.216517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 415/836] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:57:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:27.217929 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda6afa-41b6-4a40-99e4-30a388bd1c8d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:27.282399 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:27.284568 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebb06a-d5c4-46e0-8731-2b2d87f0ff88 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:27.285558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebb06a-d5c4-46e0-8731-2b2d87f0ff88 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:27.285558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebb06a-d5c4-46e0-8731-2b2d87f0ff88 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:27.290645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 416/837] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:27.296978 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe2239-2f90-461d-885d-cae257b9b882 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:27.297264 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe2239-2f90-461d-885d-cae257b9b882 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:27.297572 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe2239-2f90-461d-885d-cae257b9b882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:27.319256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4cfe2239-2f90-461d-885d-cae257b9b882 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:27.321724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4cfe2239-2f90-461d-885d-cae257b9b882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:27.338342 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda6afa-41b6-4a40-99e4-30a388bd1c8d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:27.375257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6245e9-3abf-4ae1-89e1-a2f53a7c61c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:27.375916 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6245e9-3abf-4ae1-89e1-a2f53a7c61c9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:27.376190 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6245e9-3abf-4ae1-89e1-a2f53a7c61c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:27.376460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6245e9-3abf-4ae1-89e1-a2f53a7c61c9 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:27.377160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6245e9-3abf-4ae1-89e1-a2f53a7c61c9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:27.377499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6245e9-3abf-4ae1-89e1-a2f53a7c61c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:27.378853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6245e9-3abf-4ae1-89e1-a2f53a7c61c9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:27.393402 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 422/838] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:57:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:27.420131 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 417/839] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:27.444577 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6245e9-3abf-4ae1-89e1-a2f53a7c61c9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:27.558029 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6245e9-3abf-4ae1-89e1-a2f53a7c61c9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:27.582732 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:27.595750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ace24-36c9-45b1-a235-e3a32ad129f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:27.596531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ace24-36c9-45b1-a235-e3a32ad129f4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:27.596861 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ace24-36c9-45b1-a235-e3a32ad129f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:27.597135 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ace24-36c9-45b1-a235-e3a32ad129f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:27.608489 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ace24-36c9-45b1-a235-e3a32ad129f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:27.616048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-547ace24-36c9-45b1-a235-e3a32ad129f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:57:27.616048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:27.616048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:27.616048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:27.616048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:27.616048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:27.616048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:27.616048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:27.616048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:27.616048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:27.616048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:27.616048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:27.616048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:27.616048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:27.616048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:27.616048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:27.617858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:27.617858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:27.617858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:27.617858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:27.617858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:27.617858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:27.617858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:27.617858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:27.617858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:27.617858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:27.617858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:27.617858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:27.617858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:27.617858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:27.617858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:27.617858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:27.618923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:27.618923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:27.618923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:27.618923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:27.618923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:27.618923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:27.618923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:27.618923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:27.618923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:27.618923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:27.618923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:57:27.618923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:27.618923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 423/840] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:57:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:27.625725 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe2239-2f90-461d-885d-cae257b9b882 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:27.843636 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe2239-2f90-461d-885d-cae257b9b882 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:27.870631 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:27.879680 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891c553-06fc-48cf-ac82-ef0515ecaec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:27.880901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891c553-06fc-48cf-ac82-ef0515ecaec3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:27.881467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891c553-06fc-48cf-ac82-ef0515ecaec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:27.882161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891c553-06fc-48cf-ac82-ef0515ecaec3 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:27.882974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891c553-06fc-48cf-ac82-ef0515ecaec3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:27.883280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891c553-06fc-48cf-ac82-ef0515ecaec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:27.884688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891c553-06fc-48cf-ac82-ef0515ecaec3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:27.899174 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 418/841] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:57:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:27.900749 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ace24-36c9-45b1-a235-e3a32ad129f4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:27.969893 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc568d-78ae-405e-ba5a-3a9321ce7963 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:27.970241 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc568d-78ae-405e-ba5a-3a9321ce7963 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:27.970439 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc568d-78ae-405e-ba5a-3a9321ce7963 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:27.972135 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 419/842] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:57:27.978191 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d30c5-912e-47b3-87ba-fcc0cd775c4d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:27.978481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d30c5-912e-47b3-87ba-fcc0cd775c4d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:27.978762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d30c5-912e-47b3-87ba-fcc0cd775c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:27.995219 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d84d30c5-912e-47b3-87ba-fcc0cd775c4d None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:27.996408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d84d30c5-912e-47b3-87ba-fcc0cd775c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:28.009599 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ace24-36c9-45b1-a235-e3a32ad129f4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:28.050509 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a03656-88df-4c52-90e7-6e58323c7d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:28.051656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a03656-88df-4c52-90e7-6e58323c7d75 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:28.052088 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a03656-88df-4c52-90e7-6e58323c7d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:28.052589 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a03656-88df-4c52-90e7-6e58323c7d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:28.063657 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a03656-88df-4c52-90e7-6e58323c7d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:28.065492 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a03656-88df-4c52-90e7-6e58323c7d75 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:28.077690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 420/843] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:28.083630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-65a03656-88df-4c52-90e7-6e58323c7d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:28.083630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:28.083630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:28.083630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:28.083630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:28.083630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:28.083630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:28.083630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:28.083630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:28.083630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:28.083630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:28.083630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:28.083630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:28.083630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:28.083630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:28.084650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:28.084650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:28.084650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:28.084650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:28.084650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:28.084650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:28.084650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:28.084650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:28.084650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:28.084650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:28.084650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:28.084650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:28.084650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:28.084650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:28.084650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:28.084650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:28.084650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:28.086154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:28.086154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:28.086154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:28.086154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:28.088194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 424/844] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:28.094887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d30c5-912e-47b3-87ba-fcc0cd775c4d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:28.095943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a03656-88df-4c52-90e7-6e58323c7d75 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:28.137171 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:28.217177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d30c5-912e-47b3-87ba-fcc0cd775c4d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:28.220555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a03656-88df-4c52-90e7-6e58323c7d75 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:28.237511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:28.255112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8059b-cb36-4136-83c8-3d13e1259b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:28.256066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8059b-cb36-4136-83c8-3d13e1259b74 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:28.256404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8059b-cb36-4136-83c8-3d13e1259b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:28.256731 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8059b-cb36-4136-83c8-3d13e1259b74 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:28.257196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127fdee-4b5d-4b5e-aaf6-8383642791bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:28.258288 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8059b-cb36-4136-83c8-3d13e1259b74 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:28.259079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127fdee-4b5d-4b5e-aaf6-8383642791bc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:28.259507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127fdee-4b5d-4b5e-aaf6-8383642791bc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:28.259636 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8059b-cb36-4136-83c8-3d13e1259b74 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:28.260083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127fdee-4b5d-4b5e-aaf6-8383642791bc None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:28.260963 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127fdee-4b5d-4b5e-aaf6-8383642791bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:28.261692 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127fdee-4b5d-4b5e-aaf6-8383642791bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:28.263250 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127fdee-4b5d-4b5e-aaf6-8383642791bc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:28.272696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a3f8059b-cb36-4136-83c8-3d13e1259b74 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 10:57:28.272696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:28.272696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:28.272696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:28.272696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:28.272696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:28.272696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:28.272696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:28.272696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 10:57:28.272696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:28.272696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:28.272696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:28.272696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:28.272696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:28.272696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:28.272696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:28.274403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:28.274403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:28.274403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:28.274403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:28.274403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:28.274403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:28.274403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:28.274403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:28.274403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:28.274403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:28.274403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:28.274403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:28.274403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:28.274403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:28.274403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:28.274403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:28.275249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:28.275249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:28.275249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:28.275249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:28.275249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:28.275249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:28.275249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:28.275249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:28.275249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:28.275249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:28.275249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:28.275249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:28.275249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:28.275249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 10:57:28.275249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:28.276053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 425/845] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Jun 27 10:57:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:28.282133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8059b-cb36-4136-83c8-3d13e1259b74 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:28.284630 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 421/846] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:28.290328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127fdee-4b5d-4b5e-aaf6-8383642791bc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:28.397853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:28.402009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8059b-cb36-4136-83c8-3d13e1259b74 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:28.416671 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127fdee-4b5d-4b5e-aaf6-8383642791bc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:28.446138 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a52388-5e46-4ff6-b122-23d8403e3a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:28.447205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a52388-5e46-4ff6-b122-23d8403e3a28 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:28.447489 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a52388-5e46-4ff6-b122-23d8403e3a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:28.448019 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a52388-5e46-4ff6-b122-23d8403e3a28 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:28.448725 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a52388-5e46-4ff6-b122-23d8403e3a28 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:28.449113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a52388-5e46-4ff6-b122-23d8403e3a28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:28.450677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a52388-5e46-4ff6-b122-23d8403e3a28 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:28.451943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc7c03-4052-493e-996e-63001954836c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:28.452829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc7c03-4052-493e-996e-63001954836c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:28.453207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc7c03-4052-493e-996e-63001954836c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:28.453611 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc7c03-4052-493e-996e-63001954836c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:28.456170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 426/847] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jun 27 10:57:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:28.462121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a52388-5e46-4ff6-b122-23d8403e3a28 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:28.462544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc7c03-4052-493e-996e-63001954836c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:28.463984 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc7c03-4052-493e-996e-63001954836c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:28.479850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c8cc7c03-4052-493e-996e-63001954836c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 10:57:28.479850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:28.479850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:28.479850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:28.479850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:28.479850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:28.479850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:28.479850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:28.479850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:28.479850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:28.479850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:28.479850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:28.479850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:28.479850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:28.479850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:28.479850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:28.481025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:28.482023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:28.482023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:28.482023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:28.482023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:28.482023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:28.482023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:28.482023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:28.482023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:28.482023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 10:57:28.482023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:28.482556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 422/848] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:57:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:28.487601 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc7c03-4052-493e-996e-63001954836c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:28.531503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:28.586285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a52388-5e46-4ff6-b122-23d8403e3a28 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:28.613333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc7c03-4052-493e-996e-63001954836c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:28.629886 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793daa10-c2ed-4b69-97ac-0e8fc411a7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:28.630847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793daa10-c2ed-4b69-97ac-0e8fc411a7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:28.631130 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793daa10-c2ed-4b69-97ac-0e8fc411a7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:28.631405 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793daa10-c2ed-4b69-97ac-0e8fc411a7d7 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:28.632462 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793daa10-c2ed-4b69-97ac-0e8fc411a7d7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:28.633258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793daa10-c2ed-4b69-97ac-0e8fc411a7d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:28.634893 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793daa10-c2ed-4b69-97ac-0e8fc411a7d7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:28.645814 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 427/849] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jun 27 10:57:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:28.656879 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e40b9-73e3-4c91-88a9-520a621b0cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:28.657609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e40b9-73e3-4c91-88a9-520a621b0cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:28.657960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e40b9-73e3-4c91-88a9-520a621b0cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:28.658308 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e40b9-73e3-4c91-88a9-520a621b0cc6 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:28.659252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e40b9-73e3-4c91-88a9-520a621b0cc6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:28.659650 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e40b9-73e3-4c91-88a9-520a621b0cc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:28.661213 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e40b9-73e3-4c91-88a9-520a621b0cc6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:28.687840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 423/850] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Jun 27 10:57:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:28.689253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793daa10-c2ed-4b69-97ac-0e8fc411a7d7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:28.726830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:28.806863 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793daa10-c2ed-4b69-97ac-0e8fc411a7d7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:28.841759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e411780-0fb5-4ab4-afc7-a757181e89d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:28.842404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e411780-0fb5-4ab4-afc7-a757181e89d3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:28.842688 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e411780-0fb5-4ab4-afc7-a757181e89d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:28.842961 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e411780-0fb5-4ab4-afc7-a757181e89d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:28.912502 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e411780-0fb5-4ab4-afc7-a757181e89d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:28.914413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e411780-0fb5-4ab4-afc7-a757181e89d3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:28.942892 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:29.021170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 428/851] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:57:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:57:29.026651 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e40b9-73e3-4c91-88a9-520a621b0cc6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:29.125840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:29.131971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e40b9-73e3-4c91-88a9-520a621b0cc6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:29.148867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d346e3-1687-4f34-947d-6fb6711dddf9 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:29.149206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d346e3-1687-4f34-947d-6fb6711dddf9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:29.149467 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d346e3-1687-4f34-947d-6fb6711dddf9 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:29.150974 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 429/852] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:57:29.155959 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea8d4d-fd28-43fc-a5ff-439d9324748f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:29.156479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea8d4d-fd28-43fc-a5ff-439d9324748f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:29.156975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea8d4d-fd28-43fc-a5ff-439d9324748f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:29.174799 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e3ea8d4d-fd28-43fc-a5ff-439d9324748f None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:29.176245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e3ea8d4d-fd28-43fc-a5ff-439d9324748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:29.178082 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93f189-d425-43e3-a2a4-440f7c10fdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:29.181988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93f189-d425-43e3-a2a4-440f7c10fdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:29.182535 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93f189-d425-43e3-a2a4-440f7c10fdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:29.183010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93f189-d425-43e3-a2a4-440f7c10fdc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:29.207935 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93f189-d425-43e3-a2a4-440f7c10fdc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:29.210477 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93f189-d425-43e3-a2a4-440f7c10fdc1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:29.238367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ec93f189-d425-43e3-a2a4-440f7c10fdc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:29.238367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:29.238367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:29.238367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:29.238367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:29.238367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:29.238367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:29.238367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:29.238367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:29.238367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:29.238367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:29.238367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:29.238367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:29.238367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:29.238367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:29.239596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:29.239596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:29.239596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:29.239596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:29.239596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:29.239596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:29.239596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:29.239596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:29.239596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:29.239596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:29.239596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:29.239596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:29.239596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:29.239596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:29.239596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:29.239596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:29.239596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:29.240723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:29.240723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:29.240723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:29.240723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:29.243169 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 424/853] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:29.251027 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93f189-d425-43e3-a2a4-440f7c10fdc1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:29.265463 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 430/854] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:29.282570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea8d4d-fd28-43fc-a5ff-439d9324748f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:29.346026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:29.362122 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93f189-d425-43e3-a2a4-440f7c10fdc1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:29.394590 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea8d4d-fd28-43fc-a5ff-439d9324748f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:29.409037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a418f-734b-4c1c-8863-f9cab4e5b75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:29.409736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a418f-734b-4c1c-8863-f9cab4e5b75b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:29.410021 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a418f-734b-4c1c-8863-f9cab4e5b75b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:29.410298 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a418f-734b-4c1c-8863-f9cab4e5b75b None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:29.411494 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a418f-734b-4c1c-8863-f9cab4e5b75b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:29.411802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a418f-734b-4c1c-8863-f9cab4e5b75b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:29.413457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a418f-734b-4c1c-8863-f9cab4e5b75b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:29.430910 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 425/855] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:29.435917 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a418f-734b-4c1c-8863-f9cab4e5b75b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:29.438124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499eed3e-b3f4-41fa-b3de-d941825a61f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:29.438924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eed3e-b3f4-41fa-b3de-d941825a61f1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:29.439201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eed3e-b3f4-41fa-b3de-d941825a61f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:29.439472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eed3e-b3f4-41fa-b3de-d941825a61f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:29.451044 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:29.456373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499eed3e-b3f4-41fa-b3de-d941825a61f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:29.466248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-499eed3e-b3f4-41fa-b3de-d941825a61f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:29.466248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:29.466248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:29.466248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:29.466248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:29.466248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:29.466248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:29.466248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:29.466248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:29.466248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:29.466248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:29.466248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:29.466248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:29.466248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:29.466248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:29.466248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:29.467188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:29.467188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:29.467188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:29.467188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:29.467188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:29.467188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:29.467188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:29.467188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:29.467188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:29.467188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:29.467188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:29.467188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:29.467188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:29.467188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:29.467188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:29.467188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:29.468184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:29.468184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:29.468184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:29.468184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:29.468184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:29.468184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:29.468184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:29.468184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:29.468184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:29.468184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:29.468184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:57:29.468184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:29.468184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 431/856] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:57:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:29.473917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499eed3e-b3f4-41fa-b3de-d941825a61f1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:29.572605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a418f-734b-4c1c-8863-f9cab4e5b75b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:29.582403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499eed3e-b3f4-41fa-b3de-d941825a61f1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:29.601888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:29.608802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f2f41-ec87-48f1-8aea-43ae317d0d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:29.609643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f2f41-ec87-48f1-8aea-43ae317d0d98 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:29.609920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f2f41-ec87-48f1-8aea-43ae317d0d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:29.610198 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f2f41-ec87-48f1-8aea-43ae317d0d98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:29.616683 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f2f41-ec87-48f1-8aea-43ae317d0d98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:29.618175 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f2f41-ec87-48f1-8aea-43ae317d0d98 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:29.620337 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a9b9b-5c1a-4045-89d6-b5e00480a768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:29.621196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a9b9b-5c1a-4045-89d6-b5e00480a768 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:29.621716 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a9b9b-5c1a-4045-89d6-b5e00480a768 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:29.622157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a9b9b-5c1a-4045-89d6-b5e00480a768 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:29.623048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a9b9b-5c1a-4045-89d6-b5e00480a768 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:29.623496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a9b9b-5c1a-4045-89d6-b5e00480a768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:29.624981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a9b9b-5c1a-4045-89d6-b5e00480a768 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:29.631865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-f47f2f41-ec87-48f1-8aea-43ae317d0d98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:29.631865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:29.631865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:29.631865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:29.631865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:29.631865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:29.631865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:29.631865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:29.631865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:29.631865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:29.631865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:29.631865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:29.631865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:29.631865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:29.631865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:29.632943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:29.632943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:29.632943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:29.632943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:29.632943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:29.632943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:29.632943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:29.632943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:29.632943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:29.632943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:29.632943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:29.632943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:29.632943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:29.632943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:29.632943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:29.632943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:29.632943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:29.633884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:29.633884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:29.633884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:29.633884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:29.633884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:29.633884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:29.633884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:29.633884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:29.633884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 426/857] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:29.634369 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28957f5c-0ca8-49be-a1aa-efd653d66df0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:29.634587 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28957f5c-0ca8-49be-a1aa-efd653d66df0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:29.634865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28957f5c-0ca8-49be-a1aa-efd653d66df0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:29.637396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 427/858] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:29.639700 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28957f5c-0ca8-49be-a1aa-efd653d66df0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:29.640882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 432/859] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:57:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:29.641781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a9b9b-5c1a-4045-89d6-b5e00480a768 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:29.706526 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:29.745522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28957f5c-0ca8-49be-a1aa-efd653d66df0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:29.748639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a9b9b-5c1a-4045-89d6-b5e00480a768 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:29.781473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaf4f5-8225-48fc-a34e-fe2c9e935516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:29.782132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaf4f5-8225-48fc-a34e-fe2c9e935516 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:29.782415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaf4f5-8225-48fc-a34e-fe2c9e935516 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:29.782688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaf4f5-8225-48fc-a34e-fe2c9e935516 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:29.783464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaf4f5-8225-48fc-a34e-fe2c9e935516 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:29.783770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaf4f5-8225-48fc-a34e-fe2c9e935516 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:29.784125 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf9fd1-765a-468c-b3a7-e245c244221e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:29.784911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf9fd1-765a-468c-b3a7-e245c244221e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:29.785187 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf9fd1-765a-468c-b3a7-e245c244221e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:29.785280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaf4f5-8225-48fc-a34e-fe2c9e935516 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:29.785551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf9fd1-765a-468c-b3a7-e245c244221e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:29.796571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf9fd1-765a-468c-b3a7-e245c244221e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:29.802797 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 428/860] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:29.802972 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf9fd1-765a-468c-b3a7-e245c244221e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:29.803065 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadd35a-f964-4a3f-b016-1eb2d0960bf5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:29.803065 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadd35a-f964-4a3f-b016-1eb2d0960bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:29.803065 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadd35a-f964-4a3f-b016-1eb2d0960bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:29.821244 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8dadd35a-f964-4a3f-b016-1eb2d0960bf5 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:29.822456 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8dadd35a-f964-4a3f-b016-1eb2d0960bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:29.824196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-e7cf9fd1-765a-468c-b3a7-e245c244221e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:29.824196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:29.824196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:29.824196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:29.824196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:29.824196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:29.824196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:29.824196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:29.824196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:29.824196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:29.824196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:29.824196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:29.824196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:29.824196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:29.824196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:29.825100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:29.825100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:29.825100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:29.825100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:29.825100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:29.825100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:29.825100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:29.825100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:29.825100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:29.825100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:29.825100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:29.825100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:29.825100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:29.825100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:29.825100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:29.825100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:29.825100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:29.826479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:29.826479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:29.826479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:29.826479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:29.826479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 433/861] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:29.826479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf9fd1-765a-468c-b3a7-e245c244221e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:29.858990 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:29.901685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 429/862] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:29.902511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadd35a-f964-4a3f-b016-1eb2d0960bf5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:29.954236 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf9fd1-765a-468c-b3a7-e245c244221e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:29.964515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:29.990695 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ca7e0-9dc0-416a-828d-5cde2cde286d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:29.991335 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ca7e0-9dc0-416a-828d-5cde2cde286d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:29.991614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ca7e0-9dc0-416a-828d-5cde2cde286d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:29.991919 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ca7e0-9dc0-416a-828d-5cde2cde286d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:29.992737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ca7e0-9dc0-416a-828d-5cde2cde286d None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=189af68908944b5e9a7cb35fde0e1bd3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:29.993043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ca7e0-9dc0-416a-828d-5cde2cde286d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:29.994484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ca7e0-9dc0-416a-828d-5cde2cde286d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:30.009398 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 434/863] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:57:29 2022] GET /identity/v3/role_assignments?user.id=189af68908944b5e9a7cb35fde0e1bd3&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:30.009398 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ca7e0-9dc0-416a-828d-5cde2cde286d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:30.019414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadd35a-f964-4a3f-b016-1eb2d0960bf5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:30.068622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b8f21-99a6-42b7-877f-204c72bec7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:30.069738 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b8f21-99a6-42b7-877f-204c72bec7be None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:30.070654 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b8f21-99a6-42b7-877f-204c72bec7be None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:30.071003 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b8f21-99a6-42b7-877f-204c72bec7be None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:30.072130 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b8f21-99a6-42b7-877f-204c72bec7be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:30.073021 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b8f21-99a6-42b7-877f-204c72bec7be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:30.074873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b8f21-99a6-42b7-877f-204c72bec7be None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:30.091380 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 430/864] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:30.097552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b8f21-99a6-42b7-877f-204c72bec7be None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:30.118696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:30.125669 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ca7e0-9dc0-416a-828d-5cde2cde286d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:30.166562 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991940ba-e879-45f8-9c60-58f486e2dc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:30.167403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991940ba-e879-45f8-9c60-58f486e2dc42 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:30.167774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991940ba-e879-45f8-9c60-58f486e2dc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:30.168128 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991940ba-e879-45f8-9c60-58f486e2dc42 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:30.168907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991940ba-e879-45f8-9c60-58f486e2dc42 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:30.170423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991940ba-e879-45f8-9c60-58f486e2dc42 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:30.192348 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 435/865] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jun 27 10:57:30 2022] POST /identity/v3/services => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:57:30.253198 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b8f21-99a6-42b7-877f-204c72bec7be None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:30.275323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:30.305222 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a20944-c2dc-454f-8f0e-caacc93f15e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:30.306099 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a20944-c2dc-454f-8f0e-caacc93f15e4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:30.306954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a20944-c2dc-454f-8f0e-caacc93f15e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:30.306954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a20944-c2dc-454f-8f0e-caacc93f15e4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:30.315269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a20944-c2dc-454f-8f0e-caacc93f15e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:30.316734 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a20944-c2dc-454f-8f0e-caacc93f15e4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:30.333124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-09a20944-c2dc-454f-8f0e-caacc93f15e4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 10:57:30.333124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:30.333124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:30.333124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:30.333124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:30.333124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:30.333124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:30.333124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:30.333124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:30.333124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:30.333124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:30.333124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:30.333124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:30.333124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:30.333124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:30.333124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:30.334211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:30.335194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:30.335194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:30.335194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:30.335194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:30.335194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:30.335194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:30.335194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:30.335194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:30.335194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 10:57:30.335194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:30.335194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 431/866] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jun 27 10:57:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:30.340141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991940ba-e879-45f8-9c60-58f486e2dc42 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:30.451121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991940ba-e879-45f8-9c60-58f486e2dc42 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:30.485764 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d92558-74e1-4ca1-8a5f-4e96708a76f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:30.486427 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d92558-74e1-4ca1-8a5f-4e96708a76f0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:30.486709 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d92558-74e1-4ca1-8a5f-4e96708a76f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:30.486983 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d92558-74e1-4ca1-8a5f-4e96708a76f0 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:30.487816 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d92558-74e1-4ca1-8a5f-4e96708a76f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:30.488120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d92558-74e1-4ca1-8a5f-4e96708a76f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:30.489638 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d92558-74e1-4ca1-8a5f-4e96708a76f0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:30.507993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 436/867] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Jun 27 10:57:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:30.514467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a20944-c2dc-454f-8f0e-caacc93f15e4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:30.627107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a20944-c2dc-454f-8f0e-caacc93f15e4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:30.664118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55d94d-e031-4aac-b6bc-abb9b53bf0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:30.665046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55d94d-e031-4aac-b6bc-abb9b53bf0ab None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:30.665496 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55d94d-e031-4aac-b6bc-abb9b53bf0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:30.665912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55d94d-e031-4aac-b6bc-abb9b53bf0ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:30.710625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:30.737169 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55d94d-e031-4aac-b6bc-abb9b53bf0ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:30.739049 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55d94d-e031-4aac-b6bc-abb9b53bf0ab None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:30.797191 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a551675-9f5a-4057-bdfe-5fa520342c85 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:30.797521 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a551675-9f5a-4057-bdfe-5fa520342c85 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:30.797804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a551675-9f5a-4057-bdfe-5fa520342c85 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:30.799419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 437/868] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:30.805131 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1d691-d6fb-4708-9a06-e28ea8b4085a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:30.805458 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1d691-d6fb-4708-9a06-e28ea8b4085a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:30.805743 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1d691-d6fb-4708-9a06-e28ea8b4085a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:30.822387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7aa1d691-d6fb-4708-9a06-e28ea8b4085a None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:30.823574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7aa1d691-d6fb-4708-9a06-e28ea8b4085a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:30.833517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:30.848615 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 432/869] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:57:30 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:57:30.856462 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55d94d-e031-4aac-b6bc-abb9b53bf0ab None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:30.898950 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 438/870] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:30 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:30.922270 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1d691-d6fb-4708-9a06-e28ea8b4085a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:30.947840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:30.983256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55d94d-e031-4aac-b6bc-abb9b53bf0ab None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:31.023887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda7afe-cd6f-42de-83aa-13824fd6f175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:31.024678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda7afe-cd6f-42de-83aa-13824fd6f175 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:31.024960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda7afe-cd6f-42de-83aa-13824fd6f175 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:31.025236 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda7afe-cd6f-42de-83aa-13824fd6f175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:31.035890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda7afe-cd6f-42de-83aa-13824fd6f175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:31.037348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda7afe-cd6f-42de-83aa-13824fd6f175 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:31.056107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-0cda7afe-cd6f-42de-83aa-13824fd6f175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:31.056107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:31.056107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:31.056107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:31.056107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:31.056107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:31.056107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:31.056107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:31.056107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:31.056107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:31.056107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:31.056107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:31.056107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:31.056107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:31.056107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:31.056997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:31.056997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:31.056997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:31.056997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:31.056997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:31.056997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:31.056997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:31.056997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:31.056997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:31.056997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:31.056997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:31.056997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:31.056997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:31.056997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:31.056997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:31.056997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:31.056997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:31.057927 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:31.057927 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:31.057927 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:31.057927 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:31.060186 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1d691-d6fb-4708-9a06-e28ea8b4085a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:31.062087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 433/871] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:31.062994 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda7afe-cd6f-42de-83aa-13824fd6f175 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:31.107730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eee51b-1207-449b-ba62-5242c189a553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:31.109139 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eee51b-1207-449b-ba62-5242c189a553 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:31.109689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eee51b-1207-449b-ba62-5242c189a553 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:31.110478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eee51b-1207-449b-ba62-5242c189a553 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:31.111408 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eee51b-1207-449b-ba62-5242c189a553 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:31.113769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eee51b-1207-449b-ba62-5242c189a553 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:31.141829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 439/872] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jun 27 10:57:30 2022] POST /identity/v3/services => generated 269 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 10:57:31.189586 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda7afe-cd6f-42de-83aa-13824fd6f175 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:31.225006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:31.249553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb0d87-0c79-434b-9a16-525046f7e13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:31.250584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb0d87-0c79-434b-9a16-525046f7e13e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:31.251095 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb0d87-0c79-434b-9a16-525046f7e13e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:31.251576 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb0d87-0c79-434b-9a16-525046f7e13e None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:31.252542 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb0d87-0c79-434b-9a16-525046f7e13e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:31.253092 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb0d87-0c79-434b-9a16-525046f7e13e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:31.254830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb0d87-0c79-434b-9a16-525046f7e13e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:31.269447 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 434/873] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:31.277424 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eee51b-1207-449b-ba62-5242c189a553 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:31.280526 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:31.395331 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eee51b-1207-449b-ba62-5242c189a553 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:31.430177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b868231-2187-4b9e-815b-f1117c28160e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:31.430968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b868231-2187-4b9e-815b-f1117c28160e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:31.431251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b868231-2187-4b9e-815b-f1117c28160e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:31.431534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b868231-2187-4b9e-815b-f1117c28160e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:31.438769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b868231-2187-4b9e-815b-f1117c28160e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:31.440213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b868231-2187-4b9e-815b-f1117c28160e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:31.455258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-3b868231-2187-4b9e-815b-f1117c28160e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:31.455258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:31.455258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:31.455258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:31.455258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:31.455258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:31.455258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:31.455258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:31.455258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:31.455258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:31.455258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:31.455258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:31.455258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:31.455258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:31.455258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:31.456660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:31.456660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:31.456660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:31.456660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:31.456660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:31.456660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:31.456660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:31.456660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:31.456660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:31.456660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:31.456660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:31.456660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:31.456660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:31.456660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:31.456660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:31.456660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:31.456660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:31.457595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:31.457595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:31.457595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:31.457595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:31.457595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:31.457595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:31.457595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:31.457595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:31.457595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 440/874] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:31.463711 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb0d87-0c79-434b-9a16-525046f7e13e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:31.574499 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb0d87-0c79-434b-9a16-525046f7e13e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:31.609337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a3482-4943-4795-ab4a-9d64afe6632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:31.610349 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a3482-4943-4795-ab4a-9d64afe6632d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:31.610843 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a3482-4943-4795-ab4a-9d64afe6632d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:31.611323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a3482-4943-4795-ab4a-9d64afe6632d None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:31.612408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a3482-4943-4795-ab4a-9d64afe6632d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:31.612920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a3482-4943-4795-ab4a-9d64afe6632d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:31.614640 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a3482-4943-4795-ab4a-9d64afe6632d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:31.628199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 435/875] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:31.634306 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b868231-2187-4b9e-815b-f1117c28160e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:31.706834 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:31.750801 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b868231-2187-4b9e-815b-f1117c28160e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:31.786965 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0822e-3a99-4905-b470-c95f65d0aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:31.787858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0822e-3a99-4905-b470-c95f65d0aad1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:31.788298 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0822e-3a99-4905-b470-c95f65d0aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:31.788772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0822e-3a99-4905-b470-c95f65d0aad1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:31.789774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0822e-3a99-4905-b470-c95f65d0aad1 None admin] RBAC: Adding query filter params (role.id=e053e0425eb744e2a3e3316222e208f3, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=40c6739db5404d59a6799b2ace1c7982) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:31.790230 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0822e-3a99-4905-b470-c95f65d0aad1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:31.791803 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0822e-3a99-4905-b470-c95f65d0aad1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:31.798414 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 441/876] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:57:31 2022] GET /identity/v3/role_assignments?user.id=40c6739db5404d59a6799b2ace1c7982&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=e053e0425eb744e2a3e3316222e208f3 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:32.215030 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90e116-d53d-49db-8ab1-1e75ef338b99 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:32.215315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90e116-d53d-49db-8ab1-1e75ef338b99 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:32.215591 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90e116-d53d-49db-8ab1-1e75ef338b99 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:32.217241 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 436/877] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:32.222539 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18f297-2625-484e-91e0-45efd9390182 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:32.222828 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18f297-2625-484e-91e0-45efd9390182 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:32.223106 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18f297-2625-484e-91e0-45efd9390182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:32.241061 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-bb18f297-2625-484e-91e0-45efd9390182 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:32.242891 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bb18f297-2625-484e-91e0-45efd9390182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:32.317183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 442/878] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:32.336310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90e116-d53d-49db-8ab1-1e75ef338b99 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:32.382438 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:32.406746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a2501-f3f5-4387-a0b9-af2098eb3f96 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:32.407083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a2501-f3f5-4387-a0b9-af2098eb3f96 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:32.407298 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a2501-f3f5-4387-a0b9-af2098eb3f96 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:32.408984 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 443/879] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:32.415062 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f03645-1930-4897-9f58-6a2b970a63d9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:32.415346 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f03645-1930-4897-9f58-6a2b970a63d9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:32.415622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f03645-1930-4897-9f58-6a2b970a63d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:32.432390 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-42f03645-1930-4897-9f58-6a2b970a63d9 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:32.433554 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-42f03645-1930-4897-9f58-6a2b970a63d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:32.453006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90e116-d53d-49db-8ab1-1e75ef338b99 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:32.491274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:32.503736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45d441-773f-4b4a-b86e-8da9d3e1ae1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:32.504744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45d441-773f-4b4a-b86e-8da9d3e1ae1f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:32.505179 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45d441-773f-4b4a-b86e-8da9d3e1ae1f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:32.505656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45d441-773f-4b4a-b86e-8da9d3e1ae1f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:32.506459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45d441-773f-4b4a-b86e-8da9d3e1ae1f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:32.508154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45d441-773f-4b4a-b86e-8da9d3e1ae1f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:32.513675 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 444/880] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:32.522275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-df45d441-773f-4b4a-b86e-8da9d3e1ae1f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 10:57:32.522275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:32.522275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:32.522275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:32.522275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:32.522275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:32.522275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:32.522275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:32.522275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 10:57:32.522275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:32.522275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:32.522275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:32.522275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:32.522275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:32.522275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:32.522275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:32.522275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:32.524025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:32.524025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:32.524025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:32.524025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:32.524025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:32.524025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:32.524025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:32.524025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:32.524025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:32.524025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:32.524025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:32.524025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:32.524025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:32.524025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:32.524025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:32.524025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:32.524923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:32.524923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:32.524923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:32.524923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:32.524923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:32.524923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:32.524923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:32.524923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:32.524923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:32.524923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:32.524923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:32.524923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:32.524923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 10:57:32.524923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:32.527923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 437/881] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jun 27 10:57:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:32.533530 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f03645-1930-4897-9f58-6a2b970a63d9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:32.534156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45d441-773f-4b4a-b86e-8da9d3e1ae1f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:32.640544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45d441-773f-4b4a-b86e-8da9d3e1ae1f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:32.647723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:32.666657 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f03645-1930-4897-9f58-6a2b970a63d9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:32.677453 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33967e1-a3b4-4a99-934a-b6ad2f80fab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:32.678237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33967e1-a3b4-4a99-934a-b6ad2f80fab1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:32.678616 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33967e1-a3b4-4a99-934a-b6ad2f80fab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:32.679149 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33967e1-a3b4-4a99-934a-b6ad2f80fab1 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:32.679862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33967e1-a3b4-4a99-934a-b6ad2f80fab1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:32.680261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33967e1-a3b4-4a99-934a-b6ad2f80fab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:32.681782 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33967e1-a3b4-4a99-934a-b6ad2f80fab1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:32.691163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 438/882] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jun 27 10:57:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:32.692410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33967e1-a3b4-4a99-934a-b6ad2f80fab1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:32.708632 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ab257-14a1-4253-a8ae-ee8d167ae9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:32.709998 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ab257-14a1-4253-a8ae-ee8d167ae9fa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:32.711107 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ab257-14a1-4253-a8ae-ee8d167ae9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:32.711653 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ab257-14a1-4253-a8ae-ee8d167ae9fa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:32.712447 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ab257-14a1-4253-a8ae-ee8d167ae9fa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:32.714414 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ab257-14a1-4253-a8ae-ee8d167ae9fa None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:32.730111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-2f8ab257-14a1-4253-a8ae-ee8d167ae9fa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 10:57:32.730111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:32.730111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:32.730111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:32.730111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:32.730111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:32.730111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:32.730111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:32.730111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 10:57:32.730111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:32.730111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:32.730111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:32.730111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:32.730111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:32.730111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:32.730111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:32.730111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:32.731277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:32.731277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:32.731277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:32.731277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:32.731277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:32.731277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:32.731277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:32.731277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:32.731277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:32.731277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:32.731277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:32.731277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:32.731277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:32.731277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:32.731277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:32.731277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:32.732145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:32.732145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:32.732145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:32.732145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:32.732145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:32.732145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:32.732145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:32.732145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:32.732145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:32.732145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:32.732145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:32.732145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:32.732145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 10:57:32.732145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:32.734785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 445/883] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:57:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:32.742639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ab257-14a1-4253-a8ae-ee8d167ae9fa None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:32.812362 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:32.816144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33967e1-a3b4-4a99-934a-b6ad2f80fab1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:32.859292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d8e46-6f29-4f3c-a93f-d2af1e0107fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:32.860572 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d8e46-6f29-4f3c-a93f-d2af1e0107fb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:32.861749 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d8e46-6f29-4f3c-a93f-d2af1e0107fb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:32.862485 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d8e46-6f29-4f3c-a93f-d2af1e0107fb None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:32.863617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d8e46-6f29-4f3c-a93f-d2af1e0107fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:32.864100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d8e46-6f29-4f3c-a93f-d2af1e0107fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:32.866253 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d8e46-6f29-4f3c-a93f-d2af1e0107fb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:32.870335 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ab257-14a1-4253-a8ae-ee8d167ae9fa None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:32.877459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 439/884] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jun 27 10:57:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:32.915487 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e25e88-3f65-4779-9a87-15363d2420e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:32.916327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e25e88-3f65-4779-9a87-15363d2420e2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:32.916708 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e25e88-3f65-4779-9a87-15363d2420e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:32.917082 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e25e88-3f65-4779-9a87-15363d2420e2 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:32.917948 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e25e88-3f65-4779-9a87-15363d2420e2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:32.918356 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e25e88-3f65-4779-9a87-15363d2420e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:32.919848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e25e88-3f65-4779-9a87-15363d2420e2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:32.925993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 446/885] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:57:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:32.931938 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d8e46-6f29-4f3c-a93f-d2af1e0107fb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:32.975209 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:33.050684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d8e46-6f29-4f3c-a93f-d2af1e0107fb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:33.087713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb971a-2111-4da0-b8b7-197b445c5535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:33.088375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb971a-2111-4da0-b8b7-197b445c5535 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:33.088658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb971a-2111-4da0-b8b7-197b445c5535 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:33.088933 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb971a-2111-4da0-b8b7-197b445c5535 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:33.089661 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb971a-2111-4da0-b8b7-197b445c5535 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:33.089966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb971a-2111-4da0-b8b7-197b445c5535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:33.091329 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb971a-2111-4da0-b8b7-197b445c5535 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:33.096647 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 440/886] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:57:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:33.102384 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e25e88-3f65-4779-9a87-15363d2420e2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:33.209400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e25e88-3f65-4779-9a87-15363d2420e2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:33.226383 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:33.245742 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7bf6c-48ef-4790-ae7c-454bd7d44b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:33.246406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7bf6c-48ef-4790-ae7c-454bd7d44b7f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:33.247116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7bf6c-48ef-4790-ae7c-454bd7d44b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:33.247393 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7bf6c-48ef-4790-ae7c-454bd7d44b7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:33.248253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7bf6c-48ef-4790-ae7c-454bd7d44b7f None admin] RBAC: Adding query filter params (interface=public, service_id=a3d32102bd38433c8cb166d84c7ef47b, region_id=RegionOne) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:33.248566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7bf6c-48ef-4790-ae7c-454bd7d44b7f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:33.250026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7bf6c-48ef-4790-ae7c-454bd7d44b7f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:33.255602 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 447/887] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jun 27 10:57:33 2022] GET /identity/v3/endpoints?service_id=a3d32102bd38433c8cb166d84c7ef47b&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:33.261608 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb971a-2111-4da0-b8b7-197b445c5535 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:33.361917 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:33.367383 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb971a-2111-4da0-b8b7-197b445c5535 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:33.394329 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7cec4-3ab6-482b-a00a-9d3c21f22c3a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:33.394654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7cec4-3ab6-482b-a00a-9d3c21f22c3a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:33.394886 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7cec4-3ab6-482b-a00a-9d3c21f22c3a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:33.397191 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 448/888] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:57:33.402943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f73bab-7743-4e07-a6f2-bbdfc0113652 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:33.403358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f73bab-7743-4e07-a6f2-bbdfc0113652 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:33.403735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f73bab-7743-4e07-a6f2-bbdfc0113652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:33.415134 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fc8c2-6500-476a-a3f2-6bd8fa5a840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:33.415802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc8c2-6500-476a-a3f2-6bd8fa5a840b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:33.416087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc8c2-6500-476a-a3f2-6bd8fa5a840b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:33.416363 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc8c2-6500-476a-a3f2-6bd8fa5a840b None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:33.417622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fc8c2-6500-476a-a3f2-6bd8fa5a840b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:33.419317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fc8c2-6500-476a-a3f2-6bd8fa5a840b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:33.422717 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-82f73bab-7743-4e07-a6f2-bbdfc0113652 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:33.424005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-82f73bab-7743-4e07-a6f2-bbdfc0113652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:33.425803 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 441/889] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jun 27 10:57:33 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 10:57:33.508303 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 449/890] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:33.531166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fc8c2-6500-476a-a3f2-6bd8fa5a840b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:33.642739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fc8c2-6500-476a-a3f2-6bd8fa5a840b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:33.677766 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9954bd-909c-4711-9820-8cd24179ca9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:33.678578 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9954bd-909c-4711-9820-8cd24179ca9e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:33.678862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9954bd-909c-4711-9820-8cd24179ca9e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:33.679169 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9954bd-909c-4711-9820-8cd24179ca9e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:33.680349 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9954bd-909c-4711-9820-8cd24179ca9e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:33.681752 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9954bd-909c-4711-9820-8cd24179ca9e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:33.694280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8c9954bd-909c-4711-9820-8cd24179ca9e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 10:57:33.694280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:33.694280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:33.694280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:33.694280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:33.694280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:33.694280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:33.694280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:33.694280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 10:57:33.694280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:33.694280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:33.694280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:33.694280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:33.694280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:33.694280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:33.694280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:33.695317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:33.695317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:33.695317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:33.695317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:33.695317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:33.695317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:33.695317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:33.695317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:33.695317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:33.695317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:33.695317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:33.695317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:33.695317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:33.695317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:33.695317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:33.695317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:33.696159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:33.696159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:33.696159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:33.696159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:33.696159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:33.696159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:33.696159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:33.696159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:33.696159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:33.696159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:33.696159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:33.696159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:33.696159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:33.696159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 10:57:33.696159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:33.696159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 442/891] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Jun 27 10:57:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:33.703522 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f73bab-7743-4e07-a6f2-bbdfc0113652 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:33.811354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f73bab-7743-4e07-a6f2-bbdfc0113652 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:33.822602 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:33.847409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e6873-8b6f-432e-9e29-96fe10908cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:33.848078 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e6873-8b6f-432e-9e29-96fe10908cda None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:33.848362 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e6873-8b6f-432e-9e29-96fe10908cda None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:33.848640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e6873-8b6f-432e-9e29-96fe10908cda None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:33.849346 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e6873-8b6f-432e-9e29-96fe10908cda None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:33.849678 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e6873-8b6f-432e-9e29-96fe10908cda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:33.851116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e6873-8b6f-432e-9e29-96fe10908cda None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:33.856883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 450/892] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jun 27 10:57:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:33.866412 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9954bd-909c-4711-9820-8cd24179ca9e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:33.895096 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:33.941439 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bed3e-5ee8-4a3d-8cd0-362c1a414124 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:33.941766 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bed3e-5ee8-4a3d-8cd0-362c1a414124 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:33.941994 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bed3e-5ee8-4a3d-8cd0-362c1a414124 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:33.943606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 451/893] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:57:33.948707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3a5fa-988d-4a9b-8b6e-ddf52bde9a49 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:33.948985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3a5fa-988d-4a9b-8b6e-ddf52bde9a49 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:33.949377 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3a5fa-988d-4a9b-8b6e-ddf52bde9a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:33.970933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3fc3a5fa-988d-4a9b-8b6e-ddf52bde9a49 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:33.972464 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3fc3a5fa-988d-4a9b-8b6e-ddf52bde9a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:33.978958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9954bd-909c-4711-9820-8cd24179ca9e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:34.023410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30451a09-b66b-4b36-9ab9-ef21a627e407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:34.024100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30451a09-b66b-4b36-9ab9-ef21a627e407 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:34.024385 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30451a09-b66b-4b36-9ab9-ef21a627e407 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:34.024667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30451a09-b66b-4b36-9ab9-ef21a627e407 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:34.025726 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30451a09-b66b-4b36-9ab9-ef21a627e407 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:34.026041 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30451a09-b66b-4b36-9ab9-ef21a627e407 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:34.027670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30451a09-b66b-4b36-9ab9-ef21a627e407 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:34.040049 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 443/894] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jun 27 10:57:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:34.042432 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30451a09-b66b-4b36-9ab9-ef21a627e407 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:34.054325 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 452/895] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:34.081671 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3a5fa-988d-4a9b-8b6e-ddf52bde9a49 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:34.148644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:34.164355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30451a09-b66b-4b36-9ab9-ef21a627e407 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:34.208072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643579a6-4d3a-4c25-8468-3e101ab9d590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:34.209097 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643579a6-4d3a-4c25-8468-3e101ab9d590 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:34.209672 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643579a6-4d3a-4c25-8468-3e101ab9d590 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:34.211254 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643579a6-4d3a-4c25-8468-3e101ab9d590 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:34.212382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643579a6-4d3a-4c25-8468-3e101ab9d590 None admin] RBAC: Adding query filter params (interface=public, service_id=72ea25de8d154a7ba6a3b4f662473482, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:34.213860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643579a6-4d3a-4c25-8468-3e101ab9d590 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:34.216052 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643579a6-4d3a-4c25-8468-3e101ab9d590 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:34.226878 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3a5fa-988d-4a9b-8b6e-ddf52bde9a49 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:34.226878 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:34.228774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 444/896] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jun 27 10:57:34 2022] GET /identity/v3/endpoints?service_id=72ea25de8d154a7ba6a3b4f662473482&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:34.228774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643579a6-4d3a-4c25-8468-3e101ab9d590 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:34.269697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d776f-9a30-4fc8-b2a5-e9f1b0b1b41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:34.270687 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d776f-9a30-4fc8-b2a5-e9f1b0b1b41f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:34.271155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d776f-9a30-4fc8-b2a5-e9f1b0b1b41f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:34.271533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d776f-9a30-4fc8-b2a5-e9f1b0b1b41f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:34.285980 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d776f-9a30-4fc8-b2a5-e9f1b0b1b41f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:34.295355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-028d776f-9a30-4fc8-b2a5-e9f1b0b1b41f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 10:57:34.295355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:34.295355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:34.295355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:34.295355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:34.295355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:34.295355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:34.295355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:34.295355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:34.295355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:34.295355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:34.295355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:34.295355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:34.295355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:34.295355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:34.295355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:34.296294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:34.296294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:34.296294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:34.296294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:34.296294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:34.296294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:34.296294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:34.296294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:34.296294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:34.296294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:34.296294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:34.296294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:34.296294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:34.296294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:34.296294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:34.296294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:34.297140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:34.297140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:34.297140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:34.297140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:34.297140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:34.297140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:34.297140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:34.297140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:34.297140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:34.297140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:34.297140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 10:57:34.297140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:34.299856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 453/897] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Jun 27 10:57:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:34.305740 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d776f-9a30-4fc8-b2a5-e9f1b0b1b41f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:34.361816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643579a6-4d3a-4c25-8468-3e101ab9d590 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:34.406884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff3b9a-e3d8-43c9-9d8c-32eecf31ed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:34.407820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff3b9a-e3d8-43c9-9d8c-32eecf31ed73 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:34.408117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff3b9a-e3d8-43c9-9d8c-32eecf31ed73 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:34.408398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff3b9a-e3d8-43c9-9d8c-32eecf31ed73 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:34.409084 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff3b9a-e3d8-43c9-9d8c-32eecf31ed73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:34.410549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d776f-9a30-4fc8-b2a5-e9f1b0b1b41f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:34.410662 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff3b9a-e3d8-43c9-9d8c-32eecf31ed73 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:34.421433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 445/898] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jun 27 10:57:34 2022] GET /identity/v3/services => generated 1268 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 10:57:34.453555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f19a8-fee6-4309-8f91-dfb434356d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:34.454695 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f19a8-fee6-4309-8f91-dfb434356d5a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:34.455183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f19a8-fee6-4309-8f91-dfb434356d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:34.455672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f19a8-fee6-4309-8f91-dfb434356d5a None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:34.456732 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f19a8-fee6-4309-8f91-dfb434356d5a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:34.457303 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f19a8-fee6-4309-8f91-dfb434356d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:34.459063 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f19a8-fee6-4309-8f91-dfb434356d5a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:34.469836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 454/899] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Jun 27 10:57:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:34.475889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff3b9a-e3d8-43c9-9d8c-32eecf31ed73 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:34.498601 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:34.591913 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff3b9a-e3d8-43c9-9d8c-32eecf31ed73 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:34.630895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfd6b7-2beb-4c8b-9ecb-106dac377db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:34.631612 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfd6b7-2beb-4c8b-9ecb-106dac377db6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:34.631897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfd6b7-2beb-4c8b-9ecb-106dac377db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:34.632178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfd6b7-2beb-4c8b-9ecb-106dac377db6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:34.644631 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfd6b7-2beb-4c8b-9ecb-106dac377db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:34.646124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfd6b7-2beb-4c8b-9ecb-106dac377db6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:34.664402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-dacfd6b7-2beb-4c8b-9ecb-106dac377db6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:34.664402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:34.664402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:34.664402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:34.664402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:34.664402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:34.664402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:34.664402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:34.664402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:34.664402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:34.664402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:34.664402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:34.664402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:34.664402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:34.664402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:34.665348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:34.665348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:34.665348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:34.665348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:34.665348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:34.665348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:34.665348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:34.665348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:34.665348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:34.665348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:34.665348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:34.665348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:34.665348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:34.665348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:34.665348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:34.665348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:34.665348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:34.666352 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:34.666352 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:34.666352 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:34.666352 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:34.666352 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 446/900] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:34.671542 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f19a8-fee6-4309-8f91-dfb434356d5a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:34.701316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:34.777112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f19a8-fee6-4309-8f91-dfb434356d5a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:34.811698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f9793-a879-44bd-95d3-7f656cc255a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:34.812424 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f9793-a879-44bd-95d3-7f656cc255a9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:34.812714 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f9793-a879-44bd-95d3-7f656cc255a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:34.812990 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f9793-a879-44bd-95d3-7f656cc255a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:34.813775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f9793-a879-44bd-95d3-7f656cc255a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:34.814080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f9793-a879-44bd-95d3-7f656cc255a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:34.815564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f9793-a879-44bd-95d3-7f656cc255a9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:34.828673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 455/901] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:34.834189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfd6b7-2beb-4c8b-9ecb-106dac377db6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:34.909096 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:34.943760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfd6b7-2beb-4c8b-9ecb-106dac377db6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:34.966392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3d2c6-edcf-492e-9678-498ef7b140a7 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:34.966805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3d2c6-edcf-492e-9678-498ef7b140a7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:34.967085 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3d2c6-edcf-492e-9678-498ef7b140a7 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:34.969185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 456/902] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:57:34.975669 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c9353-9de6-4409-9623-540d50923c28 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:34.976272 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c9353-9de6-4409-9623-540d50923c28 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:34.976556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c9353-9de6-4409-9623-540d50923c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:34.985419 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7cf24-2ee1-4cbf-a5a4-d922cb9c11c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:34.986224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7cf24-2ee1-4cbf-a5a4-d922cb9c11c3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:34.986502 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7cf24-2ee1-4cbf-a5a4-d922cb9c11c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:34.986772 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7cf24-2ee1-4cbf-a5a4-d922cb9c11c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:34.994428 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7cf24-2ee1-4cbf-a5a4-d922cb9c11c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:34.995609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-124c9353-9de6-4409-9623-540d50923c28 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:34.995867 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7cf24-2ee1-4cbf-a5a4-d922cb9c11c3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:34.996858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-124c9353-9de6-4409-9623-540d50923c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:35.010943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-82d7cf24-2ee1-4cbf-a5a4-d922cb9c11c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 10:57:35.010943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:35.010943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:35.010943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:35.010943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:35.010943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:35.010943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:35.010943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:35.010943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:35.010943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:35.010943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:35.010943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:35.010943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:35.010943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:35.010943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:35.010943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:35.012196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:35.013156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:35.013156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:35.013156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:35.013156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:35.013156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:35.013156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:35.013156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:35.013156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:35.013156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 10:57:35.013156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:35.013156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 447/903] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jun 27 10:57:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:35.017896 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7cf24-2ee1-4cbf-a5a4-d922cb9c11c3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:35.089502 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 457/904] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:35.111356 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c9353-9de6-4409-9623-540d50923c28 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:35.133083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:35.154176 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7cf24-2ee1-4cbf-a5a4-d922cb9c11c3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:35.196628 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:35.211849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc28a56-2a43-4bf8-b8dc-899eda15f79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:35.212540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc28a56-2a43-4bf8-b8dc-899eda15f79b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:35.212824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc28a56-2a43-4bf8-b8dc-899eda15f79b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:35.213101 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc28a56-2a43-4bf8-b8dc-899eda15f79b None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:35.213986 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc28a56-2a43-4bf8-b8dc-899eda15f79b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:35.214419 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc28a56-2a43-4bf8-b8dc-899eda15f79b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:35.215937 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc28a56-2a43-4bf8-b8dc-899eda15f79b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:35.246540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 448/905] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Jun 27 10:57:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:35.247582 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc28a56-2a43-4bf8-b8dc-899eda15f79b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:35.248945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c9353-9de6-4409-9623-540d50923c28 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:35.293304 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50f9fe-d442-4315-9f66-c3e21aa57403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:35.293994 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50f9fe-d442-4315-9f66-c3e21aa57403 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:35.294277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50f9fe-d442-4315-9f66-c3e21aa57403 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:35.294587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50f9fe-d442-4315-9f66-c3e21aa57403 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:35.295826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50f9fe-d442-4315-9f66-c3e21aa57403 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:35.297672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50f9fe-d442-4315-9f66-c3e21aa57403 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:35.321421 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 458/906] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jun 27 10:57:35 2022] POST /identity/v3/services => generated 241 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 10:57:35.372379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc28a56-2a43-4bf8-b8dc-899eda15f79b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:35.419223 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea09ccb-3357-497f-b092-8e4e0f673909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:35.419882 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea09ccb-3357-497f-b092-8e4e0f673909 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:35.420163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea09ccb-3357-497f-b092-8e4e0f673909 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:35.420482 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea09ccb-3357-497f-b092-8e4e0f673909 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:35.480693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:35.497553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea09ccb-3357-497f-b092-8e4e0f673909 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:35.499010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea09ccb-3357-497f-b092-8e4e0f673909 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:35.549996 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71168a86-512a-4448-8002-a31dfd65a792 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:35.550314 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71168a86-512a-4448-8002-a31dfd65a792 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:35.550557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71168a86-512a-4448-8002-a31dfd65a792 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:35.552176 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 459/907] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:57:35.557342 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfc458-1d11-4fc0-8feb-2305c0097302 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:35.557655 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfc458-1d11-4fc0-8feb-2305c0097302 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:35.557933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfc458-1d11-4fc0-8feb-2305c0097302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:35.574646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-82bfc458-1d11-4fc0-8feb-2305c0097302 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:35.581556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-82bfc458-1d11-4fc0-8feb-2305c0097302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:35.619808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 449/908] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:57:35 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:57:35.625286 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea09ccb-3357-497f-b092-8e4e0f673909 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:35.666141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 460/909] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:35.694026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfc458-1d11-4fc0-8feb-2305c0097302 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:35.702907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:35.723214 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:35.743915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea09ccb-3357-497f-b092-8e4e0f673909 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:35.792363 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f514e-918e-4c27-9112-2317c2ae4e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:35.793705 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f514e-918e-4c27-9112-2317c2ae4e95 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:35.794136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f514e-918e-4c27-9112-2317c2ae4e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:35.794579 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f514e-918e-4c27-9112-2317c2ae4e95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:35.808006 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfc458-1d11-4fc0-8feb-2305c0097302 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:35.808187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f514e-918e-4c27-9112-2317c2ae4e95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:35.809962 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f514e-918e-4c27-9112-2317c2ae4e95 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:35.832120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a65f514e-918e-4c27-9112-2317c2ae4e95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:35.832120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:35.832120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:35.832120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:35.832120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:35.832120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:35.832120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:35.832120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:35.832120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:35.832120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:35.832120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:35.832120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:35.832120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:35.832120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:35.832120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:35.833228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:35.833228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:35.833228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:35.833228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:35.833228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:35.833228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:35.833228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:35.833228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:35.833228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:35.833228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:35.833228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:35.833228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:35.833228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:35.833228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:35.833228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:35.833228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:35.833228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:35.834378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:35.834378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:35.834378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:35.834378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:35.837481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 450/910] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:35.842713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f514e-918e-4c27-9112-2317c2ae4e95 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:35.847425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d4205-9f48-44d8-8ce3-cd79ac4f33fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:35.848330 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d4205-9f48-44d8-8ce3-cd79ac4f33fc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:35.848677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d4205-9f48-44d8-8ce3-cd79ac4f33fc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:35.849011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d4205-9f48-44d8-8ce3-cd79ac4f33fc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:35.849752 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d4205-9f48-44d8-8ce3-cd79ac4f33fc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:35.851251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d4205-9f48-44d8-8ce3-cd79ac4f33fc None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:35.864614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-ee7d4205-9f48-44d8-8ce3-cd79ac4f33fc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 10:57:35.864614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:35.864614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:35.864614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:35.864614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:35.864614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:35.864614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:35.864614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:35.864614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 10:57:35.864614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:35.864614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:35.864614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:35.864614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:35.864614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:35.864614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:35.864614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:35.864614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:35.865841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:35.865841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:35.865841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:35.865841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:35.865841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:35.865841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:35.865841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:35.865841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:35.865841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:35.865841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:35.865841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:35.865841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:35.865841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:35.865841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:35.865841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:35.865841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:35.866912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:35.866912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:35.866912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:35.866912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:35.866912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:35.866912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:35.866912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:35.866912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:35.866912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:35.866912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:35.866912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:35.866912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:35.866912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 10:57:35.866912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:35.873091 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 461/911] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:57:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:35.874257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d4205-9f48-44d8-8ce3-cd79ac4f33fc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:35.964735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:35.975806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f514e-918e-4c27-9112-2317c2ae4e95 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:36.012569 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d4205-9f48-44d8-8ce3-cd79ac4f33fc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:36.019323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dc9a5-8e5d-4fda-a2a2-3ec829129fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:36.020247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dc9a5-8e5d-4fda-a2a2-3ec829129fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:36.020780 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dc9a5-8e5d-4fda-a2a2-3ec829129fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:36.021254 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dc9a5-8e5d-4fda-a2a2-3ec829129fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:36.022215 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0dc9a5-8e5d-4fda-a2a2-3ec829129fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:36.022740 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0dc9a5-8e5d-4fda-a2a2-3ec829129fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:36.024845 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0dc9a5-8e5d-4fda-a2a2-3ec829129fc3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:36.028044 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:36.038936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 451/912] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:36.045128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dc9a5-8e5d-4fda-a2a2-3ec829129fc3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:36.055962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7634a-a291-4f56-8f9a-19b362502dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:36.056957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7634a-a291-4f56-8f9a-19b362502dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:36.057520 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7634a-a291-4f56-8f9a-19b362502dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:36.057997 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7634a-a291-4f56-8f9a-19b362502dc0 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:36.058909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7634a-a291-4f56-8f9a-19b362502dc0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:36.059409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7634a-a291-4f56-8f9a-19b362502dc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:36.060965 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7634a-a291-4f56-8f9a-19b362502dc0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:36.071387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 462/913] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:57:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:36.072501 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7634a-a291-4f56-8f9a-19b362502dc0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:36.152895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dc9a5-8e5d-4fda-a2a2-3ec829129fc3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:36.174248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7634a-a291-4f56-8f9a-19b362502dc0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:36.195641 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b29b4-490a-4357-9d11-9c6301c79907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:36.196953 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b29b4-490a-4357-9d11-9c6301c79907 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:36.197237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b29b4-490a-4357-9d11-9c6301c79907 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:36.197555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b29b4-490a-4357-9d11-9c6301c79907 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:36.207370 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b29b4-490a-4357-9d11-9c6301c79907 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:36.209196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b29b4-490a-4357-9d11-9c6301c79907 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:36.212408 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2e0fa-b8ea-4a5d-81b5-ad598e229fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:36.213445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2e0fa-b8ea-4a5d-81b5-ad598e229fab None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:36.213943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2e0fa-b8ea-4a5d-81b5-ad598e229fab None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:36.214443 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2e0fa-b8ea-4a5d-81b5-ad598e229fab None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:36.215410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2e0fa-b8ea-4a5d-81b5-ad598e229fab None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:36.215911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2e0fa-b8ea-4a5d-81b5-ad598e229fab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:36.217661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2e0fa-b8ea-4a5d-81b5-ad598e229fab None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:36.219363 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:36.229626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9f8b29b4-490a-4357-9d11-9c6301c79907 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:36.229626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:36.229626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:36.229626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:36.229626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:36.229626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:36.229626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:36.229626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:36.229626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:36.229626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:36.229626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:36.229626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:36.229626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:36.229626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:36.229626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:36.230706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:36.230706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:36.230706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:36.230706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:36.230706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:36.230706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:36.230706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:36.230706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:36.230706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:36.230706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:36.230706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:36.230706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:36.230706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:36.230706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:36.230706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:36.230706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:36.230706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:36.231760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:36.231760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:36.231760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:36.231760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:36.231760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:36.231760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:36.231760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:36.231760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:36.231760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 452/915] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:36.232393 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 463/915] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jun 27 10:57:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:36.233234 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b29b4-490a-4357-9d11-9c6301c79907 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:36.233875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2e0fa-b8ea-4a5d-81b5-ad598e229fab None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:36.309983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:36.343459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2e0fa-b8ea-4a5d-81b5-ad598e229fab None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:36.363104 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b29b4-490a-4357-9d11-9c6301c79907 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:36.387902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2a8db-3f63-4f2b-aded-3c3b2af16f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:36.388772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2a8db-3f63-4f2b-aded-3c3b2af16f9f None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:36.389117 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2a8db-3f63-4f2b-aded-3c3b2af16f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:36.389582 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2a8db-3f63-4f2b-aded-3c3b2af16f9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:36.390857 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2a8db-3f63-4f2b-aded-3c3b2af16f9f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:36.392231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2a8db-3f63-4f2b-aded-3c3b2af16f9f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:36.407981 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439df1a5-174a-413d-9a55-2475e01cfd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:36.408730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439df1a5-174a-413d-9a55-2475e01cfd00 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:36.409032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439df1a5-174a-413d-9a55-2475e01cfd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:36.409393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439df1a5-174a-413d-9a55-2475e01cfd00 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:36.410230 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439df1a5-174a-413d-9a55-2475e01cfd00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:36.410546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439df1a5-174a-413d-9a55-2475e01cfd00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:36.412161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439df1a5-174a-413d-9a55-2475e01cfd00 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:36.423600 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 464/916] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jun 27 10:57:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 10:57:36.428066 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 453/917] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:36.434623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2a8db-3f63-4f2b-aded-3c3b2af16f9f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:36.502557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:36.561928 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2a8db-3f63-4f2b-aded-3c3b2af16f9f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:36.571981 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbefac2-43c5-48a8-9558-d22a5902da0b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:36.572292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbefac2-43c5-48a8-9558-d22a5902da0b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:36.572543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbefac2-43c5-48a8-9558-d22a5902da0b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:36.574230 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 454/918] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:36.580150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961117b-5318-4157-b66a-1df9dd63b207 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:36.580443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961117b-5318-4157-b66a-1df9dd63b207 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:36.580717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961117b-5318-4157-b66a-1df9dd63b207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:36.600481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e961117b-5318-4157-b66a-1df9dd63b207 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:36.602299 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e961117b-5318-4157-b66a-1df9dd63b207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:36.607523 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269decb-b440-45d0-825f-769c5ae83dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:36.608481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269decb-b440-45d0-825f-769c5ae83dac None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:36.608768 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269decb-b440-45d0-825f-769c5ae83dac None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:36.609102 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269decb-b440-45d0-825f-769c5ae83dac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:36.610228 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269decb-b440-45d0-825f-769c5ae83dac None admin] RBAC: Adding query filter params (role.id=f56089ab411e48aaa42f4c510bb4b1cb, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=40c6739db5404d59a6799b2ace1c7982) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:36.610335 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269decb-b440-45d0-825f-769c5ae83dac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:36.613722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269decb-b440-45d0-825f-769c5ae83dac None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:36.619124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 465/919] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:57:36 2022] GET /identity/v3/role_assignments?user.id=40c6739db5404d59a6799b2ace1c7982&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=f56089ab411e48aaa42f4c510bb4b1cb => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:36.691167 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 455/920] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:36.714297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269decb-b440-45d0-825f-769c5ae83dac None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:36.828319 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269decb-b440-45d0-825f-769c5ae83dac None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:36.842870 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:36.864212 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe84635-360b-4a3e-9289-6284a4e969d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:36.865033 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe84635-360b-4a3e-9289-6284a4e969d3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:36.865314 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe84635-360b-4a3e-9289-6284a4e969d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:36.865617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe84635-360b-4a3e-9289-6284a4e969d3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:36.866262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe84635-360b-4a3e-9289-6284a4e969d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:36.867661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe84635-360b-4a3e-9289-6284a4e969d3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:36.879951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-4fe84635-360b-4a3e-9289-6284a4e969d3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 10:57:36.879951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:36.879951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:36.879951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:36.879951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:36.879951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:36.879951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:36.879951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:36.879951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 10:57:36.879951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:36.879951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:36.879951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:36.879951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:36.879951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:36.879951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:36.879951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:36.880933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:36.880933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:36.880933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:36.880933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:36.880933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:36.880933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:36.880933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:36.880933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:36.880933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:36.880933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:36.880933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:36.880933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:36.880933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:36.880933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:36.880933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:36.880933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:36.881830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:36.881830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:36.881830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:36.881830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:36.881830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:36.881830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:36.881830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:36.881830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:36.881830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:36.881830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:36.881830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:36.881830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:36.881830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:36.881830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 10:57:36.881830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:36.881830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 466/921] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Jun 27 10:57:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:36.887570 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961117b-5318-4157-b66a-1df9dd63b207 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:36.940913 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:37.012216 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961117b-5318-4157-b66a-1df9dd63b207 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:37.047982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26c43b-0d4c-4170-9548-c92d45404416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:37.049040 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26c43b-0d4c-4170-9548-c92d45404416 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:37.049566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26c43b-0d4c-4170-9548-c92d45404416 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:37.050054 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26c43b-0d4c-4170-9548-c92d45404416 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:37.050993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26c43b-0d4c-4170-9548-c92d45404416 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:37.051504 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26c43b-0d4c-4170-9548-c92d45404416 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:37.053129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26c43b-0d4c-4170-9548-c92d45404416 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:37.059214 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 456/922] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jun 27 10:57:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:37.067100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe84635-360b-4a3e-9289-6284a4e969d3 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:37.180546 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe84635-360b-4a3e-9289-6284a4e969d3 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:37.222208 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46057585-4ecf-4d6f-9cf1-b78d7d27bfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:37.223184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46057585-4ecf-4d6f-9cf1-b78d7d27bfdd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:37.223686 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46057585-4ecf-4d6f-9cf1-b78d7d27bfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:37.224191 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46057585-4ecf-4d6f-9cf1-b78d7d27bfdd None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:37.225104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46057585-4ecf-4d6f-9cf1-b78d7d27bfdd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:37.225650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46057585-4ecf-4d6f-9cf1-b78d7d27bfdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:37.227255 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46057585-4ecf-4d6f-9cf1-b78d7d27bfdd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:37.232902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 467/923] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jun 27 10:57:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:37.238752 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26c43b-0d4c-4170-9548-c92d45404416 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:37.347552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26c43b-0d4c-4170-9548-c92d45404416 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:37.358846 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:37.385352 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b3037-71b0-4646-898e-3a1e0e48b113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:37.386281 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b3037-71b0-4646-898e-3a1e0e48b113 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:37.386623 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b3037-71b0-4646-898e-3a1e0e48b113 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:37.386903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b3037-71b0-4646-898e-3a1e0e48b113 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:37.387643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b3037-71b0-4646-898e-3a1e0e48b113 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:37.389007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b3037-71b0-4646-898e-3a1e0e48b113 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:37.413822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 457/924] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jun 27 10:57:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:57:37.580542 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186d29e-e72f-4aaa-a341-bcdeec8a449a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:37.580904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186d29e-e72f-4aaa-a341-bcdeec8a449a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:37.581190 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186d29e-e72f-4aaa-a341-bcdeec8a449a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:37.582834 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 468/925] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:37.588058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ec88c-c40d-446f-a17e-f606703e6c5f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:37.588349 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ec88c-c40d-446f-a17e-f606703e6c5f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:37.588626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ec88c-c40d-446f-a17e-f606703e6c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:37.606331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ea8ec88c-c40d-446f-a17e-f606703e6c5f None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:37.607505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ea8ec88c-c40d-446f-a17e-f606703e6c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:37.682887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 458/926] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:37.707011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186d29e-e72f-4aaa-a341-bcdeec8a449a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:37.753110 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:37.814616 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186d29e-e72f-4aaa-a341-bcdeec8a449a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:37.851159 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc0bee-6b39-45de-8d09-a40e8cb3e42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:37.851889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc0bee-6b39-45de-8d09-a40e8cb3e42d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:37.852172 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc0bee-6b39-45de-8d09-a40e8cb3e42d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:37.852447 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc0bee-6b39-45de-8d09-a40e8cb3e42d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:37.853106 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc0bee-6b39-45de-8d09-a40e8cb3e42d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:37.854521 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc0bee-6b39-45de-8d09-a40e8cb3e42d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:37.867639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-15cc0bee-6b39-45de-8d09-a40e8cb3e42d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 10:57:37.867639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:37.867639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:37.867639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:37.867639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:37.867639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:37.867639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:37.867639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:37.867639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 10:57:37.867639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:37.867639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:37.867639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:37.867639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:37.867639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:37.867639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:37.867639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:37.867639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:37.868724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:37.868724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:37.868724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:37.868724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:37.868724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:37.868724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:37.868724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:37.868724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:37.868724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:37.868724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:37.868724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:37.868724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:37.868724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:37.868724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:37.868724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:37.868724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:37.869673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:37.869673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:37.869673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:37.869673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:37.869673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:37.869673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:37.869673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:37.869673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:37.869673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:37.869673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:37.869673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:37.869673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:37.869673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 10:57:37.869673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:37.869673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 469/927] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jun 27 10:57:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:37.874943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ec88c-c40d-446f-a17e-f606703e6c5f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:37.969623 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:37.978939 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ec88c-c40d-446f-a17e-f606703e6c5f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:38.014292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df2a35-fdab-4f2b-9945-0a7ed09a87cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:38.014953 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df2a35-fdab-4f2b-9945-0a7ed09a87cb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:38.015232 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df2a35-fdab-4f2b-9945-0a7ed09a87cb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:38.015504 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df2a35-fdab-4f2b-9945-0a7ed09a87cb None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:38.016207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df2a35-fdab-4f2b-9945-0a7ed09a87cb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:38.016506 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df2a35-fdab-4f2b-9945-0a7ed09a87cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:38.017896 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df2a35-fdab-4f2b-9945-0a7ed09a87cb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:38.023012 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 459/928] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jun 27 10:57:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:38.028288 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc0bee-6b39-45de-8d09-a40e8cb3e42d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:38.130710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc0bee-6b39-45de-8d09-a40e8cb3e42d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:38.138134 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:38.167175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366a304-51df-43c4-910c-89b5385a5f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:38.167887 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366a304-51df-43c4-910c-89b5385a5f53 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:38.168172 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366a304-51df-43c4-910c-89b5385a5f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:38.168446 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366a304-51df-43c4-910c-89b5385a5f53 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:38.169148 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366a304-51df-43c4-910c-89b5385a5f53 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:38.169478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366a304-51df-43c4-910c-89b5385a5f53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:38.170836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366a304-51df-43c4-910c-89b5385a5f53 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:38.176290 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 470/929] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jun 27 10:57:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:38.184381 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df2a35-fdab-4f2b-9945-0a7ed09a87cb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:38.288033 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df2a35-fdab-4f2b-9945-0a7ed09a87cb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:38.324309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe082b4-2f69-4111-a011-8ffd0c72f3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:38.324971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe082b4-2f69-4111-a011-8ffd0c72f3fb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:38.325252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe082b4-2f69-4111-a011-8ffd0c72f3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:38.325569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe082b4-2f69-4111-a011-8ffd0c72f3fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:38.326358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe082b4-2f69-4111-a011-8ffd0c72f3fb None admin] RBAC: Adding query filter params (interface=public, service_id=ca3017841b954f509bee37db14f102e0, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:38.326666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe082b4-2f69-4111-a011-8ffd0c72f3fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:38.328036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe082b4-2f69-4111-a011-8ffd0c72f3fb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:38.333784 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 460/930] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jun 27 10:57:38 2022] GET /identity/v3/endpoints?service_id=ca3017841b954f509bee37db14f102e0&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:38.339899 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366a304-51df-43c4-910c-89b5385a5f53 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:38.450622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366a304-51df-43c4-910c-89b5385a5f53 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:38.484913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16de924-8a3f-4f15-abb5-42c249325c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:38.485595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16de924-8a3f-4f15-abb5-42c249325c1c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:38.485875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16de924-8a3f-4f15-abb5-42c249325c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:38.486147 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16de924-8a3f-4f15-abb5-42c249325c1c None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:38.486815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16de924-8a3f-4f15-abb5-42c249325c1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:38.488214 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16de924-8a3f-4f15-abb5-42c249325c1c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:38.494626 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 471/931] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jun 27 10:57:38 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 10:57:38.653647 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f74e3-2faa-4c26-9071-d5106815b745 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:38.654320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f74e3-2faa-4c26-9071-d5106815b745 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:38.654815 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f74e3-2faa-4c26-9071-d5106815b745 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:38.656404 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 461/932] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:38.661938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd24d6-2ba2-4747-af25-984de259acb7 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:38.662482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd24d6-2ba2-4747-af25-984de259acb7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:38.662981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd24d6-2ba2-4747-af25-984de259acb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:38.681501 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f4cd24d6-2ba2-4747-af25-984de259acb7 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:38.683116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f4cd24d6-2ba2-4747-af25-984de259acb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:38.712865 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:38.753288 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 472/933] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:38.777870 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f74e3-2faa-4c26-9071-d5106815b745 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:38.800107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:38.846457 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561dc9f-8c46-4b27-801a-8a2c1a0fc6ff None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:38.846798 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561dc9f-8c46-4b27-801a-8a2c1a0fc6ff None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:38.847012 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561dc9f-8c46-4b27-801a-8a2c1a0fc6ff None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:38.848502 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 473/934] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:57:38.854625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cfaa5-dfb9-4dd3-aec5-3e4a660359eb None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:38.854907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cfaa5-dfb9-4dd3-aec5-3e4a660359eb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:38.855182 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cfaa5-dfb9-4dd3-aec5-3e4a660359eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:38.874085 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-184cfaa5-dfb9-4dd3-aec5-3e4a660359eb None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:38.875259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-184cfaa5-dfb9-4dd3-aec5-3e4a660359eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:38.890687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f74e3-2faa-4c26-9071-d5106815b745 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:38.925873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4685b4-18ed-48e0-933a-1c3050856848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:38.926608 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4685b4-18ed-48e0-933a-1c3050856848 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:38.926955 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4685b4-18ed-48e0-933a-1c3050856848 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:38.927293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4685b4-18ed-48e0-933a-1c3050856848 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:38.928059 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4685b4-18ed-48e0-933a-1c3050856848 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:38.929604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4685b4-18ed-48e0-933a-1c3050856848 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:38.931020 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.common [None req-af4685b4-18ed-48e0-933a-1c3050856848 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 27 10:57:38.950774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.sql.core [None req-af4685b4-18ed-48e0-933a-1c3050856848 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 27 10:57:38.950774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 27 10:57:38.950774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [parameters: {'id': '59515171a56544e38270efe239990028', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 27 10:57:38.950774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80240) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 27 10:57:38.970160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 474/935] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:38.977421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-af4685b4-18ed-48e0-933a-1c3050856848 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59515171a56544e38270efe239990028.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59515171a56544e38270efe239990028. Jun 27 10:57:38.977421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:38.977421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 10:57:38.977421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 10:57:38.977421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 10:57:38.977421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 10:57:38.977421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 10:57:38.977421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 10:57:38.977421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 10:57:38.977421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application conn.query(q) Jun 27 10:57:38.977421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 10:57:38.977421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 10:57:38.977421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result.read() Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 27 10:57:38.978574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 27 10:57:38.979555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 10:57:38.979555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application next(self.gen) Jun 27 10:57:38.979555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 27 10:57:38.979555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application yield resource Jun 27 10:57:38.979555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 10:57:38.979555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application next(self.gen) Jun 27 10:57:38.979555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 27 10:57:38.979555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.session.rollback() Jun 27 10:57:38.979555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 27 10:57:38.979555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.force_reraise() Jun 27 10:57:38.979555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 27 10:57:38.979555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise self.value Jun 27 10:57:38.979555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 27 10:57:38.979555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 27 10:57:38.979555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 27 10:57:38.979555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application session.commit() Jun 27 10:57:38.979555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 27 10:57:38.980435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 27 10:57:38.980435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 27 10:57:38.980435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._prepare_impl() Jun 27 10:57:38.980435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 27 10:57:38.980435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.session.flush() Jun 27 10:57:38.980435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 27 10:57:38.980435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._flush(objects) Jun 27 10:57:38.980435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 27 10:57:38.980435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 27 10:57:38.980435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 27 10:57:38.980435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application compat.raise_( Jun 27 10:57:38.980435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 10:57:38.980435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception Jun 27 10:57:38.980435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 27 10:57:38.980435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application flush_context.execute() Jun 27 10:57:38.980435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 27 10:57:38.980435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rec.execute(self) Jun 27 10:57:38.981854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 27 10:57:38.981854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 27 10:57:38.981854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 27 10:57:38.981854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 27 10:57:38.981854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 27 10:57:38.981854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 27 10:57:38.981854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 27 10:57:38.981854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 27 10:57:38.981854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 27 10:57:38.981854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 27 10:57:38.981854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 27 10:57:38.981854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 27 10:57:38.981854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 27 10:57:38.981854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 27 10:57:38.981854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 27 10:57:38.982670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 27 10:57:38.982670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 10:57:38.982670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception Jun 27 10:57:38.982670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 10:57:38.982670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 10:57:38.982670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 10:57:38.982670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 10:57:38.982670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 10:57:38.982670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 10:57:38.982670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 10:57:38.982670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application conn.query(q) Jun 27 10:57:38.982670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 10:57:38.982670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 10:57:38.982670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 10:57:38.982670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result.read() Jun 27 10:57:38.982670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 10:57:38.982670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 10:57:38.983598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 10:57:38.983598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 10:57:38.983598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 10:57:38.983598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 10:57:38.983598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 10:57:38.983598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 10:57:38.983598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 27 10:57:38.983598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 27 10:57:38.983598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [parameters: {'id': '59515171a56544e38270efe239990028', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 27 10:57:38.983598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 27 10:57:38.983598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:38.983598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:38.983598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:38.983598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:38.983598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 27 10:57:38.984398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 27 10:57:38.984398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 27 10:57:38.984398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 27 10:57:38.984398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 27 10:57:38.984398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:38.984398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:38.984398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:38.984398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:38.984398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:38.984398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:38.984398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:38.984398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:38.984398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:38.984398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:38.984398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:38.984398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:38.984398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:38.985920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:38.985920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 27 10:57:38.985920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 27 10:57:38.985920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:38.985920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:38.985920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 27 10:57:38.985920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 27 10:57:38.985920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59515171a56544e38270efe239990028. Jun 27 10:57:38.985920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:38.985920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 462/936] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Jun 27 10:57:38 2022] POST /identity/v3/projects => generated 262 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:38.987130 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cfaa5-dfb9-4dd3-aec5-3e4a660359eb None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:39.001688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4685b4-18ed-48e0-933a-1c3050856848 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:39.091015 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:39.098548 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cfaa5-dfb9-4dd3-aec5-3e4a660359eb None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:39.111777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:39.141789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4685b4-18ed-48e0-933a-1c3050856848 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:39.146045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cea46-b1b4-4d38-b928-4c1c75f53962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:39.147013 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cea46-b1b4-4d38-b928-4c1c75f53962 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:39.147439 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cea46-b1b4-4d38-b928-4c1c75f53962 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:39.147889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cea46-b1b4-4d38-b928-4c1c75f53962 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:39.156950 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cea46-b1b4-4d38-b928-4c1c75f53962 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:39.159327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cea46-b1b4-4d38-b928-4c1c75f53962 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:39.175987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-d28cea46-b1b4-4d38-b928-4c1c75f53962 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:39.175987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:39.175987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:39.175987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:39.175987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:39.175987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:39.175987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:39.175987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:39.175987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:39.175987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:39.175987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:39.175987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:39.175987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:39.175987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:39.175987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:39.177100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:39.177100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:39.177100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:39.177100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:39.177100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:39.177100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:39.177100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:39.177100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:39.177100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:39.177100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:39.177100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:39.177100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:39.177100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:39.177100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:39.177100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:39.177100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:39.177100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:39.178206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:39.178206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:39.178206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:39.178206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:39.178206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:39.178206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:39.178206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:39.178206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:39.184374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 475/937] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:39.189040 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cea46-b1b4-4d38-b928-4c1c75f53962 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:39.191303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3535303-7262-4160-92b1-97278745929f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:39.192125 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3535303-7262-4160-92b1-97278745929f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:39.192407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3535303-7262-4160-92b1-97278745929f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:39.192682 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3535303-7262-4160-92b1-97278745929f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:39.204966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3535303-7262-4160-92b1-97278745929f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:39.213777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e3535303-7262-4160-92b1-97278745929f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 10:57:39.213777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:39.213777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:39.213777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:39.213777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:39.213777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:39.213777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:39.213777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:39.213777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:39.213777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:39.213777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:39.213777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:39.213777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:39.213777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:39.213777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:39.213777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:39.214717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:39.214717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:39.214717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:39.214717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:39.214717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:39.214717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:39.214717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:39.214717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:39.214717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:39.214717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:39.214717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:39.214717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:39.214717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:39.214717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:39.214717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:39.214717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:39.215561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:39.215561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:39.215561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:39.215561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:39.215561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:39.215561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:39.215561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:39.215561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:39.215561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:39.215561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:39.215561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 10:57:39.215561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:39.215561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 463/938] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Jun 27 10:57:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:39.222634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3535303-7262-4160-92b1-97278745929f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:39.308993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cea46-b1b4-4d38-b928-4c1c75f53962 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:39.328485 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3535303-7262-4160-92b1-97278745929f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:39.344701 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee05a6-23ee-479d-99ad-24b37056fb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:39.345359 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee05a6-23ee-479d-99ad-24b37056fb5f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:39.345678 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee05a6-23ee-479d-99ad-24b37056fb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:39.345955 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee05a6-23ee-479d-99ad-24b37056fb5f None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:39.346828 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee05a6-23ee-479d-99ad-24b37056fb5f None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:39.347135 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee05a6-23ee-479d-99ad-24b37056fb5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:39.348622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee05a6-23ee-479d-99ad-24b37056fb5f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:39.362017 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9fb0a-133a-414a-8910-a83d744555c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:39.362676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9fb0a-133a-414a-8910-a83d744555c8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:39.362954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9fb0a-133a-414a-8910-a83d744555c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:39.363231 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9fb0a-133a-414a-8910-a83d744555c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:39.363971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9fb0a-133a-414a-8910-a83d744555c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:39.364274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9fb0a-133a-414a-8910-a83d744555c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:39.365874 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9fb0a-133a-414a-8910-a83d744555c8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:39.374002 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:39.374261 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 476/939] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jun 27 10:57:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:39.379437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 464/940] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Jun 27 10:57:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:39.386531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee05a6-23ee-479d-99ad-24b37056fb5f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:39.405065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:39.500985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee05a6-23ee-479d-99ad-24b37056fb5f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:39.538870 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29eafa1-165e-4d71-8dbc-9ce31413f9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:39.539931 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29eafa1-165e-4d71-8dbc-9ce31413f9bd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:39.540365 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29eafa1-165e-4d71-8dbc-9ce31413f9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:39.540792 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29eafa1-165e-4d71-8dbc-9ce31413f9bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:39.551749 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29eafa1-165e-4d71-8dbc-9ce31413f9bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:39.553425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29eafa1-165e-4d71-8dbc-9ce31413f9bd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:39.560179 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc72911-87d5-4538-870e-0d482ba044f8 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:39.560470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc72911-87d5-4538-870e-0d482ba044f8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:39.560746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc72911-87d5-4538-870e-0d482ba044f8 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:39.562408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 465/941] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:39.569343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef3b08-735e-48c5-ab74-749e98ad029e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:39.570199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef3b08-735e-48c5-ab74-749e98ad029e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:39.570475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef3b08-735e-48c5-ab74-749e98ad029e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:39.574183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a29eafa1-165e-4d71-8dbc-9ce31413f9bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:39.574183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:39.574183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:39.574183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:39.574183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:39.574183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:39.574183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:39.574183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:39.574183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:39.574183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:39.574183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:39.574183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:39.574183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:39.574183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:39.574183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:39.575084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:39.575084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:39.575084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:39.575084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:39.575084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:39.575084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:39.575084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:39.575084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:39.575084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:39.575084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:39.575084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:39.575084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:39.575084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:39.575084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:39.575084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:39.575084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:39.575084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:39.575995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:39.575995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:39.575995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:39.575995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:39.575995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 477/942] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:39.581866 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29eafa1-165e-4d71-8dbc-9ce31413f9bd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:39.592518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4cef3b08-735e-48c5-ab74-749e98ad029e None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:39.594832 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4cef3b08-735e-48c5-ab74-749e98ad029e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:39.657264 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:39.679627 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 466/943] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:39.700184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29eafa1-165e-4d71-8dbc-9ce31413f9bd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:39.702998 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef3b08-735e-48c5-ab74-749e98ad029e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:39.752344 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfa156-7267-4aa3-ad29-228169ee1a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:39.753187 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfa156-7267-4aa3-ad29-228169ee1a46 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:39.753499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfa156-7267-4aa3-ad29-228169ee1a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:39.754022 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfa156-7267-4aa3-ad29-228169ee1a46 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:39.754489 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfa156-7267-4aa3-ad29-228169ee1a46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:39.754788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfa156-7267-4aa3-ad29-228169ee1a46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:39.756928 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfa156-7267-4aa3-ad29-228169ee1a46 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:39.774258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 478/944] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:39.780216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfa156-7267-4aa3-ad29-228169ee1a46 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:39.818643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef3b08-735e-48c5-ab74-749e98ad029e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:39.849003 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:39.858752 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128fc09-4909-4b9e-afc0-8a07d35a1936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:39.859820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128fc09-4909-4b9e-afc0-8a07d35a1936 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:39.860309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128fc09-4909-4b9e-afc0-8a07d35a1936 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:39.860802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128fc09-4909-4b9e-afc0-8a07d35a1936 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:39.861696 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128fc09-4909-4b9e-afc0-8a07d35a1936 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:39.863248 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128fc09-4909-4b9e-afc0-8a07d35a1936 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:39.877014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5128fc09-4909-4b9e-afc0-8a07d35a1936 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 10:57:39.877014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:39.877014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:39.877014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:39.877014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:39.877014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:39.877014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:39.877014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:39.877014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 10:57:39.877014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:39.877014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:39.877014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:39.877014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:39.877014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:39.877014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:39.877014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:39.877014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:39.878047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:39.878047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:39.878047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:39.878047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:39.878047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:39.878047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:39.878047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:39.878047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:39.878047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:39.878047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:39.878047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:39.878047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:39.878047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:39.878047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:39.878047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:39.878047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:39.878932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:39.878932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:39.878932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:39.878932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:39.878932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:39.878932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:39.878932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:39.878932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:39.878932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:39.878932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:39.878932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:39.878932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:39.878932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 10:57:39.878932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:39.887226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 467/945] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:39.888330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128fc09-4909-4b9e-afc0-8a07d35a1936 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:39.906075 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfa156-7267-4aa3-ad29-228169ee1a46 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:39.933512 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:39.946343 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f377c48-80a1-4ac6-8b46-daddc5e09dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:39.947539 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f377c48-80a1-4ac6-8b46-daddc5e09dba None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:39.948035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f377c48-80a1-4ac6-8b46-daddc5e09dba None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:39.948545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f377c48-80a1-4ac6-8b46-daddc5e09dba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:39.957899 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f377c48-80a1-4ac6-8b46-daddc5e09dba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:39.959679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f377c48-80a1-4ac6-8b46-daddc5e09dba None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:39.976797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-3f377c48-80a1-4ac6-8b46-daddc5e09dba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 10:57:39.976797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:39.976797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:39.976797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:39.976797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:39.976797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:39.976797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:39.976797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:39.976797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:39.976797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:39.976797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:39.976797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:39.976797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:39.976797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:39.976797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:39.976797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:39.977815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:39.978779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:39.978779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:39.978779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:39.978779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:39.978779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:39.978779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:39.978779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:39.978779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:39.978779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 10:57:39.978779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:39.981529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 479/946] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jun 27 10:57:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:39.987548 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f377c48-80a1-4ac6-8b46-daddc5e09dba None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:40.013397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128fc09-4909-4b9e-afc0-8a07d35a1936 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:40.048939 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe62bfc-faef-4c95-886c-f933e01c9b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:40.049798 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe62bfc-faef-4c95-886c-f933e01c9b65 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:40.050176 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe62bfc-faef-4c95-886c-f933e01c9b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:40.050552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe62bfc-faef-4c95-886c-f933e01c9b65 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:40.051352 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe62bfc-faef-4c95-886c-f933e01c9b65 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:40.051750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe62bfc-faef-4c95-886c-f933e01c9b65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:40.053346 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe62bfc-faef-4c95-886c-f933e01c9b65 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:40.063801 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 468/947] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jun 27 10:57:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:40.065355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe62bfc-faef-4c95-886c-f933e01c9b65 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:40.126982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:40.129896 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f377c48-80a1-4ac6-8b46-daddc5e09dba None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:40.178668 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe62bfc-faef-4c95-886c-f933e01c9b65 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:40.181705 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9add8-a759-47d8-969f-04a1a4c01d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:40.182418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9add8-a759-47d8-969f-04a1a4c01d3d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:40.182703 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9add8-a759-47d8-969f-04a1a4c01d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:40.182980 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9add8-a759-47d8-969f-04a1a4c01d3d None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:40.183832 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9add8-a759-47d8-969f-04a1a4c01d3d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:40.184144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9add8-a759-47d8-969f-04a1a4c01d3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:40.185619 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9add8-a759-47d8-969f-04a1a4c01d3d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:40.204252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 480/948] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Jun 27 10:57:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:40.209524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9add8-a759-47d8-969f-04a1a4c01d3d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:40.234043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdad0d-e2e5-4155-8532-4a72fa150d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:40.235508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdad0d-e2e5-4155-8532-4a72fa150d82 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:40.236208 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdad0d-e2e5-4155-8532-4a72fa150d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:40.236650 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdad0d-e2e5-4155-8532-4a72fa150d82 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:40.237778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdad0d-e2e5-4155-8532-4a72fa150d82 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:40.238659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdad0d-e2e5-4155-8532-4a72fa150d82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:40.240497 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdad0d-e2e5-4155-8532-4a72fa150d82 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:40.247836 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 469/949] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jun 27 10:57:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:40.267833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:40.330727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9add8-a759-47d8-969f-04a1a4c01d3d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:40.369636 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc05b3d-0157-441e-a6e0-a7d289024fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:40.370431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05b3d-0157-441e-a6e0-a7d289024fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:40.370706 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05b3d-0157-441e-a6e0-a7d289024fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:40.371190 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05b3d-0157-441e-a6e0-a7d289024fc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:40.384468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc05b3d-0157-441e-a6e0-a7d289024fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:40.385959 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc05b3d-0157-441e-a6e0-a7d289024fc6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:40.405157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9cc05b3d-0157-441e-a6e0-a7d289024fc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:40.405157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:40.405157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:40.405157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:40.405157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:40.405157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:40.405157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:40.405157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:40.405157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:40.405157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:40.405157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:40.405157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:40.405157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:40.405157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:40.405157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:40.406179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:40.406179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:40.406179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:40.406179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:40.406179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:40.406179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:40.406179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:40.406179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:40.406179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:40.406179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:40.406179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:40.406179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:40.406179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:40.406179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:40.406179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:40.406179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:40.406179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:40.407063 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:40.407063 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:40.407063 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:40.407063 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:40.411001 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 481/950] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:40.412546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdad0d-e2e5-4155-8532-4a72fa150d82 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:40.523974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdad0d-e2e5-4155-8532-4a72fa150d82 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:40.544442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:40.565481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1920d1f-3a7d-4631-aa12-fd7c1ec766bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:40.566154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1920d1f-3a7d-4631-aa12-fd7c1ec766bc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:40.566441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1920d1f-3a7d-4631-aa12-fd7c1ec766bc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:40.566719 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1920d1f-3a7d-4631-aa12-fd7c1ec766bc None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:40.567449 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1920d1f-3a7d-4631-aa12-fd7c1ec766bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:40.567756 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1920d1f-3a7d-4631-aa12-fd7c1ec766bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:40.569142 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1920d1f-3a7d-4631-aa12-fd7c1ec766bc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:40.582319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 470/951] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:40.588258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc05b3d-0157-441e-a6e0-a7d289024fc6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:40.655194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e2410-483b-49de-89d3-b2397b4c64d5 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:40.655519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e2410-483b-49de-89d3-b2397b4c64d5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:40.655761 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e2410-483b-49de-89d3-b2397b4c64d5 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:40.657418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 471/952] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:40.662395 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20054606-01bc-4103-9663-45d812637e53 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:40.662687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20054606-01bc-4103-9663-45d812637e53 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:40.662971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20054606-01bc-4103-9663-45d812637e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:40.680362 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-20054606-01bc-4103-9663-45d812637e53 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:40.681594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-20054606-01bc-4103-9663-45d812637e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:40.704838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:40.713274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc05b3d-0157-441e-a6e0-a7d289024fc6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:40.758629 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaca81-1657-4261-8638-4c3c0f72569f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:40.760458 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaca81-1657-4261-8638-4c3c0f72569f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:40.761508 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaca81-1657-4261-8638-4c3c0f72569f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:40.762408 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaca81-1657-4261-8638-4c3c0f72569f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:40.771849 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eaca81-1657-4261-8638-4c3c0f72569f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:40.773731 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eaca81-1657-4261-8638-4c3c0f72569f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:40.776503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 472/953] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:40.791595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-60eaca81-1657-4261-8638-4c3c0f72569f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:40.791595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:40.791595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:40.791595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:40.791595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:40.791595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:40.791595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:40.791595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:40.791595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:40.791595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:40.791595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:40.791595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:40.791595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:40.791595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:40.791595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:40.792506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:40.792506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:40.792506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:40.792506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:40.792506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:40.792506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:40.792506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:40.792506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:40.792506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:40.792506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:40.792506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:40.792506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:40.792506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:40.792506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:40.792506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:40.792506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:40.792506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:40.793612 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:40.793612 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:40.793612 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:40.793612 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:40.793612 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:40.793612 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:40.793612 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:40.793612 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:40.796346 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20054606-01bc-4103-9663-45d812637e53 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:40.797893 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 482/954] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:40.805751 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaca81-1657-4261-8638-4c3c0f72569f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:40.912065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaca81-1657-4261-8638-4c3c0f72569f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:40.923380 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20054606-01bc-4103-9663-45d812637e53 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:40.936073 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:40.951136 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824f759-a612-4a00-97df-eb06c0fd96d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:40.952188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824f759-a612-4a00-97df-eb06c0fd96d5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:40.952756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824f759-a612-4a00-97df-eb06c0fd96d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:40.953250 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824f759-a612-4a00-97df-eb06c0fd96d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:40.954357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824f759-a612-4a00-97df-eb06c0fd96d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:40.955002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824f759-a612-4a00-97df-eb06c0fd96d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:40.956738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824f759-a612-4a00-97df-eb06c0fd96d5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:40.962751 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547ce6b-9bc0-4982-9019-697879d08806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:40.963558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547ce6b-9bc0-4982-9019-697879d08806 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:40.963832 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547ce6b-9bc0-4982-9019-697879d08806 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:40.964102 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547ce6b-9bc0-4982-9019-697879d08806 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:40.964752 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547ce6b-9bc0-4982-9019-697879d08806 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:40.966228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547ce6b-9bc0-4982-9019-697879d08806 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:40.971772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 483/955] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:40.978681 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824f759-a612-4a00-97df-eb06c0fd96d5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:40.984443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-0547ce6b-9bc0-4982-9019-697879d08806 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 10:57:40.984443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:40.984443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:40.984443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:40.984443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:40.984443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:40.984443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:40.984443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:40.984443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 10:57:40.984443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:40.984443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:40.984443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:40.984443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:40.984443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:40.984443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:40.984443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:40.984443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:40.985633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:40.985633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:40.985633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:40.985633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:40.985633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:40.985633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:40.985633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:40.985633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:40.985633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:40.985633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:40.985633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:40.985633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:40.985633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:40.985633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:40.985633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:40.985633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:40.991826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:40.991826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:40.991826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:40.991826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:40.991826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:40.991826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:40.991826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:40.991826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:40.991826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:40.991826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:40.991826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:40.991826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:40.991826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 10:57:40.991826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:40.991826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 473/956] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jun 27 10:57:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:40.993970 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547ce6b-9bc0-4982-9019-697879d08806 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:41.003990 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:41.096570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824f759-a612-4a00-97df-eb06c0fd96d5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:41.119148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547ce6b-9bc0-4982-9019-697879d08806 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:41.134027 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a516073-ca3b-47af-93f6-0d7643383d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:41.134908 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a516073-ca3b-47af-93f6-0d7643383d18 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:41.135185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a516073-ca3b-47af-93f6-0d7643383d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:41.135508 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a516073-ca3b-47af-93f6-0d7643383d18 None admin] PATH_INFO: `/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/40c6739db5404d59a6799b2ace1c7982/roles/f56089ab411e48aaa42f4c510bb4b1cb` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:41.138219 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a516073-ca3b-47af-93f6-0d7643383d18 None admin] RBAC: Authorizing `identity:create_grant(project_id=6543a66af8ba48c391ce686f6d82276b, user_id=40c6739db5404d59a6799b2ace1c7982, role_id=f56089ab411e48aaa42f4c510bb4b1cb)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:41.139693 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a516073-ca3b-47af-93f6-0d7643383d18 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:41.156056 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ba658-99e8-464a-bcb6-58f21fd59b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:41.156724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ba658-99e8-464a-bcb6-58f21fd59b36 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:41.157009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ba658-99e8-464a-bcb6-58f21fd59b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:41.157282 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ba658-99e8-464a-bcb6-58f21fd59b36 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:41.158035 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ba658-99e8-464a-bcb6-58f21fd59b36 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:41.158340 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ba658-99e8-464a-bcb6-58f21fd59b36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:41.158611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 484/957] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:57:40 2022] PUT /identity/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/40c6739db5404d59a6799b2ace1c7982/roles/f56089ab411e48aaa42f4c510bb4b1cb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 10:57:41.159697 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ba658-99e8-464a-bcb6-58f21fd59b36 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:41.164865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 474/958] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jun 27 10:57:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:41.170685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a516073-ca3b-47af-93f6-0d7643383d18 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:41.279793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:41.306002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a516073-ca3b-47af-93f6-0d7643383d18 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:41.341993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040aee0-16c5-4bc1-b91e-859de0051a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:41.342658 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040aee0-16c5-4bc1-b91e-859de0051a58 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:41.342934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040aee0-16c5-4bc1-b91e-859de0051a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:41.343203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040aee0-16c5-4bc1-b91e-859de0051a58 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:41.343906 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040aee0-16c5-4bc1-b91e-859de0051a58 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:41.344202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040aee0-16c5-4bc1-b91e-859de0051a58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:41.345568 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040aee0-16c5-4bc1-b91e-859de0051a58 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:41.351214 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 485/959] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jun 27 10:57:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:41.356694 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ba658-99e8-464a-bcb6-58f21fd59b36 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:41.400888 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:41.466426 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ba658-99e8-464a-bcb6-58f21fd59b36 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:41.503103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeefcc-cedb-496f-9801-5571ca2a130f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:41.503818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeefcc-cedb-496f-9801-5571ca2a130f None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:41.504099 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeefcc-cedb-496f-9801-5571ca2a130f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:41.504374 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeefcc-cedb-496f-9801-5571ca2a130f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:41.505118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeefcc-cedb-496f-9801-5571ca2a130f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:41.506520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeefcc-cedb-496f-9801-5571ca2a130f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:41.531325 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 475/960] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jun 27 10:57:41 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:57:41.571136 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c808176-72cc-4f72-b0e5-e0145d3762b8 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:41.571794 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c808176-72cc-4f72-b0e5-e0145d3762b8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:41.572274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c808176-72cc-4f72-b0e5-e0145d3762b8 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:41.574328 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 486/961] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:41.579859 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e600bae-7f32-41dc-9d19-caaee2b486dd None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:41.580156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e600bae-7f32-41dc-9d19-caaee2b486dd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:41.580438 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e600bae-7f32-41dc-9d19-caaee2b486dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:41.598796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1e600bae-7f32-41dc-9d19-caaee2b486dd None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:41.600061 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1e600bae-7f32-41dc-9d19-caaee2b486dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:41.681117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 476/962] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:41.707208 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c808176-72cc-4f72-b0e5-e0145d3762b8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:41.813623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c808176-72cc-4f72-b0e5-e0145d3762b8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:41.847847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5784f-3ecf-4010-b1ae-a3b0a1d617be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:41.848505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5784f-3ecf-4010-b1ae-a3b0a1d617be None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:41.848790 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5784f-3ecf-4010-b1ae-a3b0a1d617be None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:41.849062 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5784f-3ecf-4010-b1ae-a3b0a1d617be None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:41.849799 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5784f-3ecf-4010-b1ae-a3b0a1d617be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:41.851756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5784f-3ecf-4010-b1ae-a3b0a1d617be None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:41.853064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.common [None req-a4c5784f-3ecf-4010-b1ae-a3b0a1d617be None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 27 10:57:41.870595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.sql.core [None req-a4c5784f-3ecf-4010-b1ae-a3b0a1d617be None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 27 10:57:41.870595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 27 10:57:41.870595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [parameters: {'user_id': '65247f16dbf04d769c71f1d9819c91cd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 27 10:57:41.870595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80241) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 27 10:57:41.878093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a4c5784f-3ecf-4010-b1ae-a3b0a1d617be None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 27 10:57:41.878093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:41.878093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 10:57:41.878093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 10:57:41.878093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 10:57:41.878093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 10:57:41.878093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 10:57:41.878093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 10:57:41.878093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 10:57:41.878093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application conn.query(q) Jun 27 10:57:41.878093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 10:57:41.878093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 10:57:41.878093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 10:57:41.878093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result.read() Jun 27 10:57:41.878093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 10:57:41.878945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application next(self.gen) Jun 27 10:57:41.879927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 27 10:57:41.879927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application yield resource Jun 27 10:57:41.879927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 10:57:41.879927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application next(self.gen) Jun 27 10:57:41.879927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 27 10:57:41.879927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.session.rollback() Jun 27 10:57:41.879927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 27 10:57:41.879927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.force_reraise() Jun 27 10:57:41.879927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 27 10:57:41.879927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise self.value Jun 27 10:57:41.879927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 27 10:57:41.879927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 27 10:57:41.879927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 27 10:57:41.879927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application session.commit() Jun 27 10:57:41.879927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 27 10:57:41.879927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 27 10:57:41.879927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 27 10:57:41.880825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._prepare_impl() Jun 27 10:57:41.880825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 27 10:57:41.880825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.session.flush() Jun 27 10:57:41.880825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 27 10:57:41.880825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._flush(objects) Jun 27 10:57:41.880825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 27 10:57:41.880825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 27 10:57:41.880825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 27 10:57:41.880825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application compat.raise_( Jun 27 10:57:41.880825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 10:57:41.880825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception Jun 27 10:57:41.880825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 27 10:57:41.880825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application flush_context.execute() Jun 27 10:57:41.880825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 27 10:57:41.880825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rec.execute(self) Jun 27 10:57:41.880825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 27 10:57:41.880825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 27 10:57:41.881758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 27 10:57:41.881758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 27 10:57:41.881758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 27 10:57:41.881758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 27 10:57:41.881758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 27 10:57:41.881758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 27 10:57:41.881758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 27 10:57:41.881758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 27 10:57:41.881758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 27 10:57:41.881758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 27 10:57:41.881758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 27 10:57:41.881758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 27 10:57:41.881758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 27 10:57:41.881758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 27 10:57:41.881758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 10:57:41.881758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception Jun 27 10:57:41.882654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 10:57:41.882654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 10:57:41.882654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 10:57:41.882654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 10:57:41.882654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 10:57:41.882654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 10:57:41.882654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 10:57:41.882654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application conn.query(q) Jun 27 10:57:41.882654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 10:57:41.882654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 10:57:41.882654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 10:57:41.882654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result.read() Jun 27 10:57:41.882654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 10:57:41.882654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 10:57:41.882654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 10:57:41.882654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 10:57:41.883494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 10:57:41.883494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 10:57:41.883494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 10:57:41.883494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 10:57:41.883494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 27 10:57:41.883494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 27 10:57:41.883494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [parameters: {'user_id': '65247f16dbf04d769c71f1d9819c91cd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 27 10:57:41.883494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 27 10:57:41.883494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:41.883494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:41.883494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:41.883494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:41.883494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:41.883494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:41.883494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:41.884296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:41.884296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:41.884296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:41.884296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:41.884296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:41.884296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:41.884296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:41.884296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 27 10:57:41.884296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 27 10:57:41.884296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:41.884296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:41.884296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:41.884296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:41.884296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:41.884296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:41.884296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 27 10:57:41.884296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 27 10:57:41.885231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 27 10:57:41.885231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 27 10:57:41.885231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 27 10:57:41.885231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 27 10:57:41.885231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 27 10:57:41.885231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:41.885231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 487/963] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Jun 27 10:57:41 2022] POST /identity/v3/users => generated 160 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:41.891632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e600bae-7f32-41dc-9d19-caaee2b486dd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:41.907454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:41.990440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e600bae-7f32-41dc-9d19-caaee2b486dd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:42.025201 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390d422-4ef1-4c6e-b9a8-20abbed70e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:42.026029 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390d422-4ef1-4c6e-b9a8-20abbed70e8d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:42.026310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390d422-4ef1-4c6e-b9a8-20abbed70e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:42.026585 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390d422-4ef1-4c6e-b9a8-20abbed70e8d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:42.038165 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390d422-4ef1-4c6e-b9a8-20abbed70e8d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:42.040213 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390d422-4ef1-4c6e-b9a8-20abbed70e8d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:42.055544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5390d422-4ef1-4c6e-b9a8-20abbed70e8d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 10:57:42.055544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:42.055544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:42.055544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:42.055544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:42.055544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:42.055544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:42.055544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:42.055544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:42.055544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:42.055544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:42.055544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:42.055544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:42.055544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:42.055544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:42.055544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:42.056503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:42.057498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:42.057498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:42.057498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:42.057498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:42.057498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:42.057498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:42.057498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:42.057498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:42.057498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 10:57:42.057498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:42.057498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 477/964] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:57:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:42.062748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5784f-3ecf-4010-b1ae-a3b0a1d617be None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:42.068353 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:42.170773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5784f-3ecf-4010-b1ae-a3b0a1d617be None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:42.209471 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691fe3c-5115-40be-b2b0-c3c198740601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:42.210146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691fe3c-5115-40be-b2b0-c3c198740601 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:42.210950 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691fe3c-5115-40be-b2b0-c3c198740601 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:42.211227 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691fe3c-5115-40be-b2b0-c3c198740601 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:42.212032 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691fe3c-5115-40be-b2b0-c3c198740601 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:42.212397 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691fe3c-5115-40be-b2b0-c3c198740601 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:42.214106 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691fe3c-5115-40be-b2b0-c3c198740601 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:42.252560 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 488/965] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jun 27 10:57:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:42.523906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcde2d-aa6c-475b-8ac9-a9b4b884240d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:42.524444 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcde2d-aa6c-475b-8ac9-a9b4b884240d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:42.524659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcde2d-aa6c-475b-8ac9-a9b4b884240d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:42.526142 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 478/966] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:42.531318 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e220168-52d5-483b-8fc3-2b9aa5820a29 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:42.531612 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e220168-52d5-483b-8fc3-2b9aa5820a29 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:42.531887 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e220168-52d5-483b-8fc3-2b9aa5820a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:42.548795 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2e220168-52d5-483b-8fc3-2b9aa5820a29 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:42.550335 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2e220168-52d5-483b-8fc3-2b9aa5820a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:42.606155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:42.618084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 489/967] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:42.641155 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcde2d-aa6c-475b-8ac9-a9b4b884240d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:42.724386 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:42.745176 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcde2d-aa6c-475b-8ac9-a9b4b884240d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:42.779847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb35a0-5984-48f5-b83d-18495044348a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:42.780432 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb35a0-5984-48f5-b83d-18495044348a None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:42.780714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb35a0-5984-48f5-b83d-18495044348a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:42.780990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb35a0-5984-48f5-b83d-18495044348a None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:42.781742 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb35a0-5984-48f5-b83d-18495044348a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:42.783109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb35a0-5984-48f5-b83d-18495044348a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:42.798156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 479/968] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jun 27 10:57:42 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:57:43.315931 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0572b-65e0-4fdc-abb9-569d8a507ada None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:43.316467 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0572b-65e0-4fdc-abb9-569d8a507ada None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:43.316467 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0572b-65e0-4fdc-abb9-569d8a507ada None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:43.317924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 490/969] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:43.322935 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b30de2-2e5e-47f9-83d0-56283626d9e8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:43.323236 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b30de2-2e5e-47f9-83d0-56283626d9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:43.323511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b30de2-2e5e-47f9-83d0-56283626d9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:43.340063 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-99b30de2-2e5e-47f9-83d0-56283626d9e8 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:43.341223 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-99b30de2-2e5e-47f9-83d0-56283626d9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:43.417383 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 480/970] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:43.440517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0572b-65e0-4fdc-abb9-569d8a507ada None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:43.541121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0572b-65e0-4fdc-abb9-569d8a507ada None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:43.575725 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83ed34-73aa-49e7-8947-9db09118726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:43.576519 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83ed34-73aa-49e7-8947-9db09118726e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:43.576801 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83ed34-73aa-49e7-8947-9db09118726e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:43.577071 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83ed34-73aa-49e7-8947-9db09118726e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:43.587473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83ed34-73aa-49e7-8947-9db09118726e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:43.595570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-4d83ed34-73aa-49e7-8947-9db09118726e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 10:57:43.595570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:43.595570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:43.595570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:43.595570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:43.595570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:43.595570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:43.595570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:43.595570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:43.595570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:43.595570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:43.595570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:43.595570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:43.595570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:43.595570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:43.595570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:43.596470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:43.596470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:43.596470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:43.596470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:43.596470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:43.596470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:43.596470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:43.596470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:43.596470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:43.596470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:43.596470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:43.596470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:43.596470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:43.596470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:43.596470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:43.596470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:43.597316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:43.597316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:43.597316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:43.597316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:43.597316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:43.597316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:43.597316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:43.597316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:43.597316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:43.597316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:43.597316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 10:57:43.597316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:43.601563 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 491/971] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Jun 27 10:57:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:43.603266 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b30de2-2e5e-47f9-83d0-56283626d9e8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:43.605086 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64351bb-44e2-4461-b6a3-6b1a0f187333 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:43.605387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64351bb-44e2-4461-b6a3-6b1a0f187333 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:43.605674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64351bb-44e2-4461-b6a3-6b1a0f187333 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:43.607096 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 492/972] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:43.611767 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5001847-8d51-4532-b9a2-60b4580c6362 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:43.612049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5001847-8d51-4532-b9a2-60b4580c6362 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:43.612320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5001847-8d51-4532-b9a2-60b4580c6362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:43.628869 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a5001847-8d51-4532-b9a2-60b4580c6362 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:43.630094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a5001847-8d51-4532-b9a2-60b4580c6362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:43.672989 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:43.679999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:43.702073 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 493/973] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:43.712410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b30de2-2e5e-47f9-83d0-56283626d9e8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:43.724827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5001847-8d51-4532-b9a2-60b4580c6362 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:43.750190 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104c551-6bfe-42d8-8063-0f34a756066b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:43.750851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104c551-6bfe-42d8-8063-0f34a756066b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:43.751135 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104c551-6bfe-42d8-8063-0f34a756066b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:43.751410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104c551-6bfe-42d8-8063-0f34a756066b None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:43.752151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104c551-6bfe-42d8-8063-0f34a756066b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:43.752454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104c551-6bfe-42d8-8063-0f34a756066b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:43.753857 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104c551-6bfe-42d8-8063-0f34a756066b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:43.766662 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 481/974] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Jun 27 10:57:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:43.767342 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104c551-6bfe-42d8-8063-0f34a756066b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:43.826793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5001847-8d51-4532-b9a2-60b4580c6362 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:43.860597 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc7a33-e88f-4d48-bf41-55b1bf413dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:43.861422 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc7a33-e88f-4d48-bf41-55b1bf413dca None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:43.861849 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc7a33-e88f-4d48-bf41-55b1bf413dca None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:43.861995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc7a33-e88f-4d48-bf41-55b1bf413dca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:43.862603 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc7a33-e88f-4d48-bf41-55b1bf413dca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:43.863956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc7a33-e88f-4d48-bf41-55b1bf413dca None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:43.869075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104c551-6bfe-42d8-8063-0f34a756066b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:43.880374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-6cfc7a33-e88f-4d48-bf41-55b1bf413dca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 10:57:43.880374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:43.880374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:43.880374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:43.880374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:43.880374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:43.880374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:43.880374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:43.880374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 10:57:43.880374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:43.880374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:43.880374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:43.880374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:43.880374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:43.880374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:43.880374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:43.880374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:43.881566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:43.881566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:43.881566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:43.881566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:43.881566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:43.881566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:43.881566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:43.881566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:43.881566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:43.881566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:43.881566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:43.881566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:43.881566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:43.881566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:43.881566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:43.881566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:43.882623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:43.882623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:43.882623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:43.882623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:43.882623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:43.882623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:43.882623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:43.882623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:43.882623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:43.882623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:43.882623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:43.882623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:43.882623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 10:57:43.882623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:43.884760 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 494/975] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jun 27 10:57:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:43.891153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc7a33-e88f-4d48-bf41-55b1bf413dca None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:43.898778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:43.908348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c9eed-80a6-4b21-86c5-a4eef89bd727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:43.909164 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c9eed-80a6-4b21-86c5-a4eef89bd727 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:43.909478 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c9eed-80a6-4b21-86c5-a4eef89bd727 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:43.909759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c9eed-80a6-4b21-86c5-a4eef89bd727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:43.923037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c9eed-80a6-4b21-86c5-a4eef89bd727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:43.925381 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c9eed-80a6-4b21-86c5-a4eef89bd727 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:43.938710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:43.950212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e54c9eed-80a6-4b21-86c5-a4eef89bd727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:43.950212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:43.950212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:43.950212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:43.950212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:43.950212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:43.950212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:43.950212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:43.950212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:43.950212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:43.950212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:43.950212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:43.950212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:43.950212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:43.950212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:43.951128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:43.951128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:43.951128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:43.951128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:43.951128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:43.951128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:43.951128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:43.951128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:43.951128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:43.951128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:43.951128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:43.951128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:43.951128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:43.951128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:43.951128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:43.951128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:43.951128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:43.957098 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:43.957098 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:43.957098 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:43.957098 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:43.957098 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 482/976] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:43.958226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c9eed-80a6-4b21-86c5-a4eef89bd727 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:43.996491 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc7a33-e88f-4d48-bf41-55b1bf413dca None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:44.030793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2f502-e47c-4dad-8243-acfb484be171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:44.031446 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2f502-e47c-4dad-8243-acfb484be171 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:44.031728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2f502-e47c-4dad-8243-acfb484be171 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:44.032005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2f502-e47c-4dad-8243-acfb484be171 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:44.032699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2f502-e47c-4dad-8243-acfb484be171 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:44.033001 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2f502-e47c-4dad-8243-acfb484be171 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:44.034387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2f502-e47c-4dad-8243-acfb484be171 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:44.039534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 495/977] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jun 27 10:57:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:44.044781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2f502-e47c-4dad-8243-acfb484be171 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:44.072994 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c9eed-80a6-4b21-86c5-a4eef89bd727 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:44.108414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc844a5-1d88-45e3-beb5-2775615fbeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:44.108964 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc844a5-1d88-45e3-beb5-2775615fbeec None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:44.109246 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc844a5-1d88-45e3-beb5-2775615fbeec None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:44.109549 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc844a5-1d88-45e3-beb5-2775615fbeec None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:44.110262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc844a5-1d88-45e3-beb5-2775615fbeec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:44.110573 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc844a5-1d88-45e3-beb5-2775615fbeec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:44.111913 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc844a5-1d88-45e3-beb5-2775615fbeec None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:44.123642 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 483/978] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:44.128978 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc844a5-1d88-45e3-beb5-2775615fbeec None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:44.145827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2f502-e47c-4dad-8243-acfb484be171 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:44.156134 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:44.173195 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:44.187000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6859f2d-1604-4032-9c38-97bc19dc686f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:44.187663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6859f2d-1604-4032-9c38-97bc19dc686f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:44.187942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6859f2d-1604-4032-9c38-97bc19dc686f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:44.188212 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6859f2d-1604-4032-9c38-97bc19dc686f None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:44.188909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6859f2d-1604-4032-9c38-97bc19dc686f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:44.189207 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6859f2d-1604-4032-9c38-97bc19dc686f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:44.190602 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6859f2d-1604-4032-9c38-97bc19dc686f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:44.200791 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 496/979] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jun 27 10:57:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:44.202943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6859f2d-1604-4032-9c38-97bc19dc686f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:44.240321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc844a5-1d88-45e3-beb5-2775615fbeec None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:44.276040 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d04d4-dc43-4531-b442-2f8516162046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:44.276836 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d04d4-dc43-4531-b442-2f8516162046 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:44.277117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d04d4-dc43-4531-b442-2f8516162046 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:44.277413 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d04d4-dc43-4531-b442-2f8516162046 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:44.284557 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d04d4-dc43-4531-b442-2f8516162046 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:44.286723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d04d4-dc43-4531-b442-2f8516162046 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:44.303267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-749d04d4-dc43-4531-b442-2f8516162046 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 10:57:44.303267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:44.303267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:44.303267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:44.303267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:44.303267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:44.303267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:44.303267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:44.303267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:44.303267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:44.303267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:44.303267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:44.303267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:44.303267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:44.303267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:44.303267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:44.304750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:44.306080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:44.306080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:44.306080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:44.306080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:44.306080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:44.306080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:44.306080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:44.306080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:44.306080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 10:57:44.306080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:44.306080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 484/980] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jun 27 10:57:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:44.308429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6859f2d-1604-4032-9c38-97bc19dc686f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:44.311304 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d04d4-dc43-4531-b442-2f8516162046 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:44.343600 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de9ec1-4e22-4454-b43f-5917ec593a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:44.344330 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de9ec1-4e22-4454-b43f-5917ec593a19 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:44.344685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de9ec1-4e22-4454-b43f-5917ec593a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:44.345025 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de9ec1-4e22-4454-b43f-5917ec593a19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:44.345933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de9ec1-4e22-4454-b43f-5917ec593a19 None admin] RBAC: Adding query filter params (interface=admin, service_id=ca3017841b954f509bee37db14f102e0, region_id=RegionOne) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:44.346307 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de9ec1-4e22-4454-b43f-5917ec593a19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:44.347722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de9ec1-4e22-4454-b43f-5917ec593a19 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:44.353027 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 497/981] 10.222.0.18 () {56 vars in 1249 bytes} [Mon Jun 27 10:57:44 2022] GET /identity/v3/endpoints?service_id=ca3017841b954f509bee37db14f102e0&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:44.358374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de9ec1-4e22-4454-b43f-5917ec593a19 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:44.394259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:44.417619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:44.422047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d04d4-dc43-4531-b442-2f8516162046 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:44.459043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d119a-fbd4-42cd-a43f-c1262e0d8a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:44.459704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d119a-fbd4-42cd-a43f-c1262e0d8a78 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:44.459988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d119a-fbd4-42cd-a43f-c1262e0d8a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:44.460293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d119a-fbd4-42cd-a43f-c1262e0d8a78 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:44.461175 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d119a-fbd4-42cd-a43f-c1262e0d8a78 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:44.461511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d119a-fbd4-42cd-a43f-c1262e0d8a78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:44.462994 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d119a-fbd4-42cd-a43f-c1262e0d8a78 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:44.465417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de9ec1-4e22-4454-b43f-5917ec593a19 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:44.481118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 485/982] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Jun 27 10:57:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:44.486278 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d119a-fbd4-42cd-a43f-c1262e0d8a78 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:44.504542 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3322a1-c970-455a-b23d-e47bac9f5bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:44.505445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3322a1-c970-455a-b23d-e47bac9f5bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:44.505896 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3322a1-c970-455a-b23d-e47bac9f5bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:44.506316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3322a1-c970-455a-b23d-e47bac9f5bc6 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:44.507785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3322a1-c970-455a-b23d-e47bac9f5bc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:44.509148 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3322a1-c970-455a-b23d-e47bac9f5bc6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:44.516169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 498/983] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jun 27 10:57:44 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 10:57:44.594318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d119a-fbd4-42cd-a43f-c1262e0d8a78 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:44.631741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1085dd7-6799-40b2-9938-b4a193b5e6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:44.633028 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1085dd7-6799-40b2-9938-b4a193b5e6ea None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:44.633273 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1085dd7-6799-40b2-9938-b4a193b5e6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:44.633605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1085dd7-6799-40b2-9938-b4a193b5e6ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:44.664243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:44.707443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1085dd7-6799-40b2-9938-b4a193b5e6ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:44.708891 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1085dd7-6799-40b2-9938-b4a193b5e6ea None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:44.813053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 486/984] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:57:44 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 27 10:57:44.814436 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3322a1-c970-455a-b23d-e47bac9f5bc6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:44.841429 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899665-8c98-4bab-b8d6-95d89c78e815 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:44.841782 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899665-8c98-4bab-b8d6-95d89c78e815 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:44.842053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899665-8c98-4bab-b8d6-95d89c78e815 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:44.843551 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 487/985] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:57:44.848839 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1f365-3be0-4731-a959-1079b361d3cf None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:44.849288 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1f365-3be0-4731-a959-1079b361d3cf None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:44.849646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1f365-3be0-4731-a959-1079b361d3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:44.867946 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-26a1f365-3be0-4731-a959-1079b361d3cf None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:44.869128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-26a1f365-3be0-4731-a959-1079b361d3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:44.915584 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:44.920227 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3322a1-c970-455a-b23d-e47bac9f5bc6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:44.926587 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:44.942169 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 488/986] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:44.957114 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7aad5-b9be-4c04-97e4-60ab0b97aa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:44.957928 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7aad5-b9be-4c04-97e4-60ab0b97aa75 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:44.958212 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7aad5-b9be-4c04-97e4-60ab0b97aa75 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:44.958491 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7aad5-b9be-4c04-97e4-60ab0b97aa75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:44.964564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1f365-3be0-4731-a959-1079b361d3cf None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:44.969257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7aad5-b9be-4c04-97e4-60ab0b97aa75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:44.970784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7aad5-b9be-4c04-97e4-60ab0b97aa75 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:44.988811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-dcc7aad5-b9be-4c04-97e4-60ab0b97aa75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:44.988811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:44.988811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:44.988811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:44.988811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:44.988811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:44.988811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:44.988811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:44.988811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:44.988811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:44.988811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:44.988811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:44.988811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:44.988811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:44.988811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:44.989805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:44.989805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:44.989805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:44.989805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:44.989805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:44.989805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:44.989805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:44.989805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:44.989805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:44.989805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:44.989805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:44.989805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:44.989805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:44.989805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:44.989805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:44.989805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:44.989805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:44.990697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:44.990697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:44.990697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:44.990697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:44.990697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 499/987] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:44.996015 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7aad5-b9be-4c04-97e4-60ab0b97aa75 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:45.078986 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1f365-3be0-4731-a959-1079b361d3cf None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:45.102172 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7aad5-b9be-4c04-97e4-60ab0b97aa75 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:45.114284 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349b166-4a15-46d0-bfdf-9ab9474deb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:45.115272 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349b166-4a15-46d0-bfdf-9ab9474deb92 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:45.115600 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349b166-4a15-46d0-bfdf-9ab9474deb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:45.115907 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349b166-4a15-46d0-bfdf-9ab9474deb92 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:45.116592 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349b166-4a15-46d0-bfdf-9ab9474deb92 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:45.118035 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349b166-4a15-46d0-bfdf-9ab9474deb92 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:45.129919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-1349b166-4a15-46d0-bfdf-9ab9474deb92 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 10:57:45.129919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:45.129919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:45.129919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:45.129919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:45.129919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:45.129919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:45.129919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:45.129919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 10:57:45.129919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:45.129919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:45.129919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:45.129919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:45.129919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:45.129919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:45.129919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:45.129919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:45.130926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:45.130926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:45.130926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:45.130926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:45.130926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:45.130926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:45.130926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:45.130926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:45.130926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:45.130926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:45.130926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:45.130926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:45.130926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:45.130926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:45.130926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:45.130926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:45.131993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:45.131993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:45.131993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:45.131993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:45.131993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:45.131993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:45.131993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:45.131993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:45.131993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:45.131993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:45.131993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:45.131993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:45.131993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 10:57:45.131993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:45.131993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 489/988] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:45.137062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349b166-4a15-46d0-bfdf-9ab9474deb92 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:45.141162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f23215-37dd-4e7f-9813-8596e0918775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:45.141851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f23215-37dd-4e7f-9813-8596e0918775 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:45.142129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f23215-37dd-4e7f-9813-8596e0918775 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:45.142398 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f23215-37dd-4e7f-9813-8596e0918775 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:45.143109 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f23215-37dd-4e7f-9813-8596e0918775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:45.143410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f23215-37dd-4e7f-9813-8596e0918775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:45.144756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f23215-37dd-4e7f-9813-8596e0918775 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:45.162779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 500/989] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:45.164771 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f23215-37dd-4e7f-9813-8596e0918775 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:45.186537 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:45.200265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:45.252947 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349b166-4a15-46d0-bfdf-9ab9474deb92 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:45.276242 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f23215-37dd-4e7f-9813-8596e0918775 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:45.288058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7645f-98ac-4b01-ac28-94ce118a4e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:45.289276 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7645f-98ac-4b01-ac28-94ce118a4e44 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:45.289625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7645f-98ac-4b01-ac28-94ce118a4e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:45.289934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7645f-98ac-4b01-ac28-94ce118a4e44 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:45.290672 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7645f-98ac-4b01-ac28-94ce118a4e44 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:45.290995 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7645f-98ac-4b01-ac28-94ce118a4e44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:45.292370 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7645f-98ac-4b01-ac28-94ce118a4e44 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:45.297326 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 490/990] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jun 27 10:57:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:45.302846 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7645f-98ac-4b01-ac28-94ce118a4e44 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:45.317474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb0e9b-ace4-4d9f-a1d9-1635006fcbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:45.318414 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb0e9b-ace4-4d9f-a1d9-1635006fcbaa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:45.318697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb0e9b-ace4-4d9f-a1d9-1635006fcbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:45.319312 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb0e9b-ace4-4d9f-a1d9-1635006fcbaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:45.327085 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb0e9b-ace4-4d9f-a1d9-1635006fcbaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:45.329143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb0e9b-ace4-4d9f-a1d9-1635006fcbaa None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:45.343550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f1fb0e9b-ace4-4d9f-a1d9-1635006fcbaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:45.343550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:45.343550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:45.343550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:45.343550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:45.343550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:45.343550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:45.343550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:45.343550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:45.343550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:45.343550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:45.343550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:45.343550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:45.343550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:45.343550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:45.344872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:45.344872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:45.344872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:45.344872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:45.344872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:45.344872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:45.344872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:45.344872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:45.344872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:45.344872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:45.344872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:45.344872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:45.344872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:45.344872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:45.344872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:45.344872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:45.344872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:45.346660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:45.346660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:45.346660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:45.346660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:45.346660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:45.346660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:45.346660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:45.346660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:45.346660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 501/991] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:45.350282 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb0e9b-ace4-4d9f-a1d9-1635006fcbaa None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:45.409056 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7645f-98ac-4b01-ac28-94ce118a4e44 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:45.425562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:45.429119 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:45.448419 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0995b23-48de-4042-8946-9d93645f13c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:45.449029 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0995b23-48de-4042-8946-9d93645f13c3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:45.449344 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0995b23-48de-4042-8946-9d93645f13c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:45.449690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0995b23-48de-4042-8946-9d93645f13c3 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:45.450475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0995b23-48de-4042-8946-9d93645f13c3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:45.450746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0995b23-48de-4042-8946-9d93645f13c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:45.452113 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0995b23-48de-4042-8946-9d93645f13c3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:45.457195 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 491/992] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jun 27 10:57:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:45.461768 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb0e9b-ace4-4d9f-a1d9-1635006fcbaa None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:45.463223 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0995b23-48de-4042-8946-9d93645f13c3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:45.495550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bf297-9bd8-4b8e-a358-fc9be30b8bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:45.496202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bf297-9bd8-4b8e-a358-fc9be30b8bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:45.496563 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bf297-9bd8-4b8e-a358-fc9be30b8bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:45.496836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bf297-9bd8-4b8e-a358-fc9be30b8bd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:45.497674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7bf297-9bd8-4b8e-a358-fc9be30b8bd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:45.497981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7bf297-9bd8-4b8e-a358-fc9be30b8bd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:45.499401 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7bf297-9bd8-4b8e-a358-fc9be30b8bd8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:45.512514 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 502/993] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:45.518091 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bf297-9bd8-4b8e-a358-fc9be30b8bd8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:45.573682 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0995b23-48de-4042-8946-9d93645f13c3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:45.609875 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7826a2-77d8-45bf-9c5c-63f7001949ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:45.610551 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7826a2-77d8-45bf-9c5c-63f7001949ae None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:45.610870 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7826a2-77d8-45bf-9c5c-63f7001949ae None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:45.611178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7826a2-77d8-45bf-9c5c-63f7001949ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:45.612500 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7826a2-77d8-45bf-9c5c-63f7001949ae None admin] RBAC: Adding query filter params (interface=public, service_id=8fcc4e1129524b95a6b17b7ca729b951, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:45.612817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7826a2-77d8-45bf-9c5c-63f7001949ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:45.614736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7826a2-77d8-45bf-9c5c-63f7001949ae None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:45.623135 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 492/994] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jun 27 10:57:45 2022] GET /identity/v3/endpoints?service_id=8fcc4e1129524b95a6b17b7ca729b951&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:45.627716 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7826a2-77d8-45bf-9c5c-63f7001949ae None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:45.628814 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bf297-9bd8-4b8e-a358-fc9be30b8bd8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:45.663071 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:45.669447 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b087c-af76-431f-8921-6efe64cf79b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:45.670221 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b087c-af76-431f-8921-6efe64cf79b1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:45.670502 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b087c-af76-431f-8921-6efe64cf79b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:45.670774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b087c-af76-431f-8921-6efe64cf79b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:45.671612 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b087c-af76-431f-8921-6efe64cf79b1 None admin] RBAC: Adding query filter params (role.id=f56089ab411e48aaa42f4c510bb4b1cb, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=40c6739db5404d59a6799b2ace1c7982) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:45.672043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b087c-af76-431f-8921-6efe64cf79b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:45.673644 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b087c-af76-431f-8921-6efe64cf79b1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:45.676080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:45.689395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 503/995] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:57:45 2022] GET /identity/v3/role_assignments?user.id=40c6739db5404d59a6799b2ace1c7982&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=f56089ab411e48aaa42f4c510bb4b1cb => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:45.747776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7826a2-77d8-45bf-9c5c-63f7001949ae None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:45.784948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365abb5-b2cb-4c91-b753-0ae9b7b55fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:45.785685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365abb5-b2cb-4c91-b753-0ae9b7b55fde None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:45.786007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365abb5-b2cb-4c91-b753-0ae9b7b55fde None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:45.786371 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365abb5-b2cb-4c91-b753-0ae9b7b55fde None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:45.787079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365abb5-b2cb-4c91-b753-0ae9b7b55fde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:45.788525 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365abb5-b2cb-4c91-b753-0ae9b7b55fde None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:45.795573 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 493/996] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jun 27 10:57:45 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 10:57:46.562700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842db61-db9d-4ebb-a02d-96d9eec7ec1c None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:46.563203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842db61-db9d-4ebb-a02d-96d9eec7ec1c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:46.563303 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842db61-db9d-4ebb-a02d-96d9eec7ec1c None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:46.564656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 504/997] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:46.570241 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77a603-041d-4974-a4d3-2a19a03ca934 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:46.570580 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77a603-041d-4974-a4d3-2a19a03ca934 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:46.570898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77a603-041d-4974-a4d3-2a19a03ca934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:46.587583 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8b77a603-041d-4974-a4d3-2a19a03ca934 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:46.588768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8b77a603-041d-4974-a4d3-2a19a03ca934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:46.654747 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 494/998] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:46.677376 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842db61-db9d-4ebb-a02d-96d9eec7ec1c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:46.777541 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842db61-db9d-4ebb-a02d-96d9eec7ec1c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:46.812118 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5506ac1-fb41-4348-aa71-c8efa82d5e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:46.812991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5506ac1-fb41-4348-aa71-c8efa82d5e44 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:46.813220 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5506ac1-fb41-4348-aa71-c8efa82d5e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:46.813527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5506ac1-fb41-4348-aa71-c8efa82d5e44 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:46.814187 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5506ac1-fb41-4348-aa71-c8efa82d5e44 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:46.815563 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5506ac1-fb41-4348-aa71-c8efa82d5e44 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:46.828591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-e5506ac1-fb41-4348-aa71-c8efa82d5e44 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 10:57:46.828591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:46.828591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:46.828591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:46.828591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:46.828591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:46.828591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:46.828591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:46.828591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 10:57:46.828591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:46.828591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:46.828591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:46.828591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:46.828591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:46.828591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:46.828591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:46.828591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:46.829596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:46.829596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:46.829596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:46.829596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:46.829596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:46.829596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:46.829596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:46.829596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:46.829596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:46.829596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:46.829596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:46.829596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:46.829596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:46.829596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:46.829596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:46.829596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:46.830445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:46.830445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:46.830445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:46.830445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:46.830445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:46.830445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:46.830445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:46.830445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:46.830445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:46.830445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:46.830445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:46.830445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:46.830445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 10:57:46.830445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:46.833445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 505/999] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jun 27 10:57:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:46.836048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77a603-041d-4974-a4d3-2a19a03ca934 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:46.878560 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:46.941450 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77a603-041d-4974-a4d3-2a19a03ca934 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:46.976229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef5a15-7d62-4e1b-8813-16e125ddd7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:46.976910 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef5a15-7d62-4e1b-8813-16e125ddd7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:46.977229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef5a15-7d62-4e1b-8813-16e125ddd7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:46.977565 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef5a15-7d62-4e1b-8813-16e125ddd7a6 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:46.978303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef5a15-7d62-4e1b-8813-16e125ddd7a6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:46.978639 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef5a15-7d62-4e1b-8813-16e125ddd7a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:46.980040 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef5a15-7d62-4e1b-8813-16e125ddd7a6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:46.985028 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 495/1000] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jun 27 10:57:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:46.990485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5506ac1-fb41-4348-aa71-c8efa82d5e44 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:47.049175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:47.090087 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5506ac1-fb41-4348-aa71-c8efa82d5e44 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:47.122824 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802be01-5784-4bb2-a17a-7f612c4398a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:47.123470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802be01-5784-4bb2-a17a-7f612c4398a5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:47.123752 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802be01-5784-4bb2-a17a-7f612c4398a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:47.124026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802be01-5784-4bb2-a17a-7f612c4398a5 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:47.124721 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802be01-5784-4bb2-a17a-7f612c4398a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:47.125025 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802be01-5784-4bb2-a17a-7f612c4398a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:47.126404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802be01-5784-4bb2-a17a-7f612c4398a5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:47.131257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 506/1001] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jun 27 10:57:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:47.136974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef5a15-7d62-4e1b-8813-16e125ddd7a6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:47.245124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef5a15-7d62-4e1b-8813-16e125ddd7a6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:47.246792 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:47.281168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28115d-06ce-4767-b586-3bc28a5cd07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:47.281871 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28115d-06ce-4767-b586-3bc28a5cd07d None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:47.282188 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28115d-06ce-4767-b586-3bc28a5cd07d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:47.282499 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28115d-06ce-4767-b586-3bc28a5cd07d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:47.283258 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28115d-06ce-4767-b586-3bc28a5cd07d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:47.284762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28115d-06ce-4767-b586-3bc28a5cd07d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:47.309440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 496/1002] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jun 27 10:57:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 10:57:47.733511 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ada11-ca0e-44b5-885c-d4d9ba2fe90d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:47.734054 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ada11-ca0e-44b5-885c-d4d9ba2fe90d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:47.734054 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ada11-ca0e-44b5-885c-d4d9ba2fe90d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:47.735576 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 507/1003] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:47.740453 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82994fe8-5fdc-4513-b095-12d4d164cad1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:47.740786 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82994fe8-5fdc-4513-b095-12d4d164cad1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:47.741105 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82994fe8-5fdc-4513-b095-12d4d164cad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:47.759095 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-82994fe8-5fdc-4513-b095-12d4d164cad1 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:47.760314 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-82994fe8-5fdc-4513-b095-12d4d164cad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:47.835903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 497/1004] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:47 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:47.857556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ada11-ca0e-44b5-885c-d4d9ba2fe90d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:47.865000 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d191-bfdf-448f-8392-ae5ed476d851 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:47.865506 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d191-bfdf-448f-8392-ae5ed476d851 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:47.865727 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d191-bfdf-448f-8392-ae5ed476d851 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:47.867506 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 498/1005] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:57:47.872412 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb661cc-c373-408c-993f-10359cbada3b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:47.872736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb661cc-c373-408c-993f-10359cbada3b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:47.873048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb661cc-c373-408c-993f-10359cbada3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:47.890103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5eb661cc-c373-408c-993f-10359cbada3b None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:47.891304 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5eb661cc-c373-408c-993f-10359cbada3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:47.965429 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 499/1006] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:47 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:47.965625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ada11-ca0e-44b5-885c-d4d9ba2fe90d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:47.987796 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:47.993957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb661cc-c373-408c-993f-10359cbada3b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:47.999340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c8e1b-7532-4d43-b107-9f351cce84ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:48.000129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c8e1b-7532-4d43-b107-9f351cce84ee None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:48.000459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c8e1b-7532-4d43-b107-9f351cce84ee None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:48.000733 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c8e1b-7532-4d43-b107-9f351cce84ee None admin] PATH_INFO: `/v3/services/image` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:48.001432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c8e1b-7532-4d43-b107-9f351cce84ee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:48.002807 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c8e1b-7532-4d43-b107-9f351cce84ee None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:48.013946 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:48.015499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-242c8e1b-7532-4d43-b107-9f351cce84ee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 10:57:48.015499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:48.015499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:48.015499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:48.015499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:48.015499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:48.015499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:48.015499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:48.015499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 10:57:48.015499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:48.015499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:48.015499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:48.015499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:48.015499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:48.015499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:48.015499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:48.015499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:48.016789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:48.016789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:48.016789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:48.016789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:48.016789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:48.016789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:48.016789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:48.016789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:48.016789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:48.016789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:48.016789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:48.016789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:48.016789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:48.016789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:48.016789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:48.016789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:48.018201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:48.018201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:48.018201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:48.018201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:48.018201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:48.018201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:48.018201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:48.018201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:48.018201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:48.018201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:48.018201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:48.018201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:48.018201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 10:57:48.018201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:48.018201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 508/1007] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Jun 27 10:57:47 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:48.023295 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c8e1b-7532-4d43-b107-9f351cce84ee None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:48.107789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb661cc-c373-408c-993f-10359cbada3b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:48.130944 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c8e1b-7532-4d43-b107-9f351cce84ee None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:48.144407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731355b0-67b8-4df1-beff-b8728d8252d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:48.145207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731355b0-67b8-4df1-beff-b8728d8252d5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:48.145552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731355b0-67b8-4df1-beff-b8728d8252d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:48.145869 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731355b0-67b8-4df1-beff-b8728d8252d5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:48.146545 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731355b0-67b8-4df1-beff-b8728d8252d5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:48.147989 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731355b0-67b8-4df1-beff-b8728d8252d5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:48.159648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-731355b0-67b8-4df1-beff-b8728d8252d5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 10:57:48.159648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:48.159648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:48.159648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:48.159648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:48.159648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:48.159648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:48.159648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:48.159648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 10:57:48.159648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:48.159648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:48.159648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:48.159648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:48.159648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:48.159648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:48.159648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:48.159648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:48.160619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:48.160619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:48.160619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:48.160619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:48.160619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:48.160619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:48.160619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:48.160619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:48.160619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:48.160619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:48.160619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:48.160619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:48.160619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:48.160619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:48.160619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:48.160619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:48.161511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:48.161511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:48.161511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:48.161511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:48.161511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:48.161511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:48.161511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:48.161511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:48.161511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:48.161511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:48.161511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:48.161511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:48.161511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 10:57:48.161511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:48.161511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 500/1008] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:48.166653 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731355b0-67b8-4df1-beff-b8728d8252d5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:48.168366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6386ec-1028-49d8-bffd-d09354b2de65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:48.169175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6386ec-1028-49d8-bffd-d09354b2de65 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:48.169496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6386ec-1028-49d8-bffd-d09354b2de65 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:48.169770 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6386ec-1028-49d8-bffd-d09354b2de65 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:48.171357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6386ec-1028-49d8-bffd-d09354b2de65 None admin] RBAC: Adding query filter params (name=image) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:48.171668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6386ec-1028-49d8-bffd-d09354b2de65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:48.173017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6386ec-1028-49d8-bffd-d09354b2de65 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:48.183628 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 509/1009] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:48.184833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6386ec-1028-49d8-bffd-d09354b2de65 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:48.238854 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:48.258900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:48.278203 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731355b0-67b8-4df1-beff-b8728d8252d5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:48.290049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6386ec-1028-49d8-bffd-d09354b2de65 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:48.315995 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ec25c-d997-43f6-932e-ac3e840d538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:48.316682 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ec25c-d997-43f6-932e-ac3e840d538a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:48.317001 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ec25c-d997-43f6-932e-ac3e840d538a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:48.317309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ec25c-d997-43f6-932e-ac3e840d538a None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:48.318089 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ec25c-d997-43f6-932e-ac3e840d538a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:48.318427 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ec25c-d997-43f6-932e-ac3e840d538a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:48.320494 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ec25c-d997-43f6-932e-ac3e840d538a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:48.325546 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c537b7-4cc9-4bc2-a9b9-4c15a549c9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:48.330675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 501/1010] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jun 27 10:57:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:48.330815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c537b7-4cc9-4bc2-a9b9-4c15a549c9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:48.330815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c537b7-4cc9-4bc2-a9b9-4c15a549c9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:48.330815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c537b7-4cc9-4bc2-a9b9-4c15a549c9d7 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:48.330815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c537b7-4cc9-4bc2-a9b9-4c15a549c9d7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:48.330815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c537b7-4cc9-4bc2-a9b9-4c15a549c9d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:48.330815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c537b7-4cc9-4bc2-a9b9-4c15a549c9d7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:48.331926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ec25c-d997-43f6-932e-ac3e840d538a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:48.334325 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 510/1011] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:48.449966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ec25c-d997-43f6-932e-ac3e840d538a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:48.487134 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f42f2-b12e-4bf1-bc06-af9266a8b5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:48.487813 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f42f2-b12e-4bf1-bc06-af9266a8b5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:48.488117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f42f2-b12e-4bf1-bc06-af9266a8b5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:48.488396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f42f2-b12e-4bf1-bc06-af9266a8b5c9 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:48.489166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f42f2-b12e-4bf1-bc06-af9266a8b5c9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:48.489437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f42f2-b12e-4bf1-bc06-af9266a8b5c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:48.490820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f42f2-b12e-4bf1-bc06-af9266a8b5c9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:48.496821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 502/1012] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jun 27 10:57:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:48.502637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c537b7-4cc9-4bc2-a9b9-4c15a549c9d7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:48.607197 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c537b7-4cc9-4bc2-a9b9-4c15a549c9d7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:48.623767 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:48.642512 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c06160-e86c-44ca-aefd-4f71ce02c02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:48.643162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c06160-e86c-44ca-aefd-4f71ce02c02c None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:48.643443 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c06160-e86c-44ca-aefd-4f71ce02c02c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:48.643718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c06160-e86c-44ca-aefd-4f71ce02c02c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:48.644498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c06160-e86c-44ca-aefd-4f71ce02c02c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:48.645896 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c06160-e86c-44ca-aefd-4f71ce02c02c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:48.672654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 511/1013] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jun 27 10:57:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:57:49.356137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726877cb-4dd3-4d9b-8462-ead604952d0a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:49.356644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726877cb-4dd3-4d9b-8462-ead604952d0a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:49.356749 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726877cb-4dd3-4d9b-8462-ead604952d0a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:49.358239 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 503/1014] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:49.363532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9af42-b149-454a-8846-96f3c1b93d4d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:49.363924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9af42-b149-454a-8846-96f3c1b93d4d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:49.364093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9af42-b149-454a-8846-96f3c1b93d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:49.381704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-14a9af42-b149-454a-8846-96f3c1b93d4d None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:49.382927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-14a9af42-b149-454a-8846-96f3c1b93d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:49.457131 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 512/1015] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:49 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:49.480649 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726877cb-4dd3-4d9b-8462-ead604952d0a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:49.493875 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:49.581744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726877cb-4dd3-4d9b-8462-ead604952d0a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:49.614742 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986099c-2f98-4442-9a61-85de69cedc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:49.615517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986099c-2f98-4442-9a61-85de69cedc55 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:49.615797 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986099c-2f98-4442-9a61-85de69cedc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:49.616067 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986099c-2f98-4442-9a61-85de69cedc55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:49.617243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986099c-2f98-4442-9a61-85de69cedc55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:49.618695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986099c-2f98-4442-9a61-85de69cedc55 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:49.620443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 504/1016] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:49.625940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9af42-b149-454a-8846-96f3c1b93d4d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:49.720582 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:49.724812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9af42-b149-454a-8846-96f3c1b93d4d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:49.758985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3d55c-873b-4e5f-89b5-bd3ea73004b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:49.759634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3d55c-873b-4e5f-89b5-bd3ea73004b6 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:49.759910 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3d55c-873b-4e5f-89b5-bd3ea73004b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:49.760182 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3d55c-873b-4e5f-89b5-bd3ea73004b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:49.760881 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3d55c-873b-4e5f-89b5-bd3ea73004b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:49.762575 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3d55c-873b-4e5f-89b5-bd3ea73004b6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:49.787736 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 513/1017] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jun 27 10:57:49 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:57:50.358702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3a740-82ec-4a69-9df0-d433f9520ea6 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:50.359207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3a740-82ec-4a69-9df0-d433f9520ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:50.359307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3a740-82ec-4a69-9df0-d433f9520ea6 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:50.360755 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 505/1018] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:50.365677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14ac89-ef6c-4f50-a9f7-642d36afe3af None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:50.366065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14ac89-ef6c-4f50-a9f7-642d36afe3af None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:50.366256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14ac89-ef6c-4f50-a9f7-642d36afe3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:50.382710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ec14ac89-ef6c-4f50-a9f7-642d36afe3af None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:50.383880 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ec14ac89-ef6c-4f50-a9f7-642d36afe3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:50.450681 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 514/1019] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:50 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:50.473832 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3a740-82ec-4a69-9df0-d433f9520ea6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:50.554492 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:50.579246 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3a740-82ec-4a69-9df0-d433f9520ea6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:50.614183 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf429b-41bf-4c83-8219-5ba6633327d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:50.615178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf429b-41bf-4c83-8219-5ba6633327d1 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:50.615619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf429b-41bf-4c83-8219-5ba6633327d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:50.616051 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf429b-41bf-4c83-8219-5ba6633327d1 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:50.616911 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf429b-41bf-4c83-8219-5ba6633327d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:50.618441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf429b-41bf-4c83-8219-5ba6633327d1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:50.634457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 506/1020] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jun 27 10:57:50 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:57:50.791150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674121cb-4de5-4412-97cc-6e5b86a41d41 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:50.791440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674121cb-4de5-4412-97cc-6e5b86a41d41 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:50.791714 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674121cb-4de5-4412-97cc-6e5b86a41d41 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:50.793103 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 515/1021] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:50.798470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129e2c9-c246-40ed-a851-87ed52664a5c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:50.798859 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129e2c9-c246-40ed-a851-87ed52664a5c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:50.799142 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129e2c9-c246-40ed-a851-87ed52664a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:50.815952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4129e2c9-c246-40ed-a851-87ed52664a5c None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:50.817124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4129e2c9-c246-40ed-a851-87ed52664a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:50.891234 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 507/1022] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:50.915819 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674121cb-4de5-4412-97cc-6e5b86a41d41 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:51.006136 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:51.036032 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674121cb-4de5-4412-97cc-6e5b86a41d41 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:51.070168 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f91282-0aeb-4e63-b8cb-001522fe19c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:51.070902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f91282-0aeb-4e63-b8cb-001522fe19c9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:51.071197 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f91282-0aeb-4e63-b8cb-001522fe19c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:51.071463 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f91282-0aeb-4e63-b8cb-001522fe19c9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:51.081596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f91282-0aeb-4e63-b8cb-001522fe19c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:51.089934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a5f91282-0aeb-4e63-b8cb-001522fe19c9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 10:57:51.089934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:51.089934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:51.089934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:51.089934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:51.089934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:51.089934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:51.089934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:51.089934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:51.089934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:51.089934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:51.089934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:51.089934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:51.089934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:51.089934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:51.089934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:51.090864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:51.090864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:51.090864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:51.090864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:51.090864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:51.090864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:51.090864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:51.090864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:51.090864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:51.090864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:51.090864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:51.090864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:51.090864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:51.090864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:51.090864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:51.090864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:51.091727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:51.091727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:51.091727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:51.091727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:51.091727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:51.091727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:51.091727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:51.091727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:51.091727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:51.091727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:51.091727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 10:57:51.091727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:51.093506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 516/1023] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Jun 27 10:57:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:51.097064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129e2c9-c246-40ed-a851-87ed52664a5c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:51.160078 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:51.206862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129e2c9-c246-40ed-a851-87ed52664a5c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:51.240779 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff79cca-7a43-4b27-906a-ef2866185a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:51.241982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff79cca-7a43-4b27-906a-ef2866185a08 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:51.242263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff79cca-7a43-4b27-906a-ef2866185a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:51.242529 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff79cca-7a43-4b27-906a-ef2866185a08 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:51.243268 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff79cca-7a43-4b27-906a-ef2866185a08 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:51.243567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff79cca-7a43-4b27-906a-ef2866185a08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:51.244918 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff79cca-7a43-4b27-906a-ef2866185a08 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:51.252985 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 508/1024] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Jun 27 10:57:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:51.259053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f91282-0aeb-4e63-b8cb-001522fe19c9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:51.357865 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f91282-0aeb-4e63-b8cb-001522fe19c9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:51.391931 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1c314-ced5-43e1-8fa3-600613656e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:51.392829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1c314-ced5-43e1-8fa3-600613656e28 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:51.393029 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1c314-ced5-43e1-8fa3-600613656e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:51.393258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1c314-ced5-43e1-8fa3-600613656e28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:51.406545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:51.409191 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1c314-ced5-43e1-8fa3-600613656e28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:51.410968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1c314-ced5-43e1-8fa3-600613656e28 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:51.429833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-48c1c314-ced5-43e1-8fa3-600613656e28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:51.429833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:51.429833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:51.429833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:51.429833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:51.429833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:51.429833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:51.429833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:51.429833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:51.429833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:51.429833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:51.429833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:51.429833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:51.429833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:51.429833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:51.430872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:51.430872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:51.430872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:51.430872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:51.430872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:51.430872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:51.430872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:51.430872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:51.430872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:51.430872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:51.430872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:51.430872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:51.430872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:51.430872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:51.430872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:51.430872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:51.430872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:51.431769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:51.431769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:51.431769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:51.431769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:51.435686 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 517/1025] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:51.437095 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff79cca-7a43-4b27-906a-ef2866185a08 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:51.539836 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff79cca-7a43-4b27-906a-ef2866185a08 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:51.565670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:51.574965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e2f44-6b07-4ead-8c3c-c834bbb76d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:51.575623 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e2f44-6b07-4ead-8c3c-c834bbb76d05 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:51.575903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e2f44-6b07-4ead-8c3c-c834bbb76d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:51.576175 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e2f44-6b07-4ead-8c3c-c834bbb76d05 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:51.576886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e2f44-6b07-4ead-8c3c-c834bbb76d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:51.577190 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e2f44-6b07-4ead-8c3c-c834bbb76d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:51.578604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e2f44-6b07-4ead-8c3c-c834bbb76d05 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:51.590478 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 509/1026] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:51.595903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1c314-ced5-43e1-8fa3-600613656e28 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:51.695295 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1c314-ced5-43e1-8fa3-600613656e28 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:51.728924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f1789-6077-41ce-a7c2-e9997b4a951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:51.729900 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f1789-6077-41ce-a7c2-e9997b4a951e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:51.730180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f1789-6077-41ce-a7c2-e9997b4a951e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:51.730664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f1789-6077-41ce-a7c2-e9997b4a951e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:51.738854 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f1789-6077-41ce-a7c2-e9997b4a951e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:51.740303 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f1789-6077-41ce-a7c2-e9997b4a951e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:51.755901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-091f1789-6077-41ce-a7c2-e9997b4a951e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:57:51.755901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:51.755901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:51.755901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:51.755901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:51.755901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:51.755901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:51.755901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:51.755901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:51.755901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:51.755901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:51.755901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:51.755901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:51.755901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:51.755901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:51.755901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:51.756945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:51.757940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:51.757940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:51.757940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:51.757940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:51.757940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:51.757940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:51.757940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:51.757940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:51.757940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:57:51.757940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:51.761451 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 518/1027] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jun 27 10:57:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:51.763602 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e2f44-6b07-4ead-8c3c-c834bbb76d05 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:51.859198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c443d7-24cb-433b-9ee4-05f760579f26 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:51.859486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c443d7-24cb-433b-9ee4-05f760579f26 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:51.859757 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c443d7-24cb-433b-9ee4-05f760579f26 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:51.861122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 519/1028] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:57:51.866315 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066ff05-3cea-4af7-a4b5-7f9cedd713a7 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:51.866602 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066ff05-3cea-4af7-a4b5-7f9cedd713a7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:51.866713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e2f44-6b07-4ead-8c3c-c834bbb76d05 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:51.866873 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066ff05-3cea-4af7-a4b5-7f9cedd713a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:51.883176 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9066ff05-3cea-4af7-a4b5-7f9cedd713a7 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:51.884332 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9066ff05-3cea-4af7-a4b5-7f9cedd713a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:51.905315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065662f-f34f-4b75-acb3-79e81b268f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:51.906150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065662f-f34f-4b75-acb3-79e81b268f1a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:51.906432 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065662f-f34f-4b75-acb3-79e81b268f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:51.906703 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065662f-f34f-4b75-acb3-79e81b268f1a None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:51.907536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065662f-f34f-4b75-acb3-79e81b268f1a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:51.907841 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065662f-f34f-4b75-acb3-79e81b268f1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:51.909259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065662f-f34f-4b75-acb3-79e81b268f1a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:51.927379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 510/1029] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jun 27 10:57:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:51.932924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065662f-f34f-4b75-acb3-79e81b268f1a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:51.934780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:51.957567 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 520/1030] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:51.982859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066ff05-3cea-4af7-a4b5-7f9cedd713a7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:51.985690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:52.042005 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065662f-f34f-4b75-acb3-79e81b268f1a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:52.074581 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dd449-f148-4cee-8d29-40046c508d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:52.075227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dd449-f148-4cee-8d29-40046c508d34 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:52.075506 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dd449-f148-4cee-8d29-40046c508d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:52.075775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dd449-f148-4cee-8d29-40046c508d34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:52.088160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066ff05-3cea-4af7-a4b5-7f9cedd713a7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:52.123993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637ca66-85ee-4ebb-befd-0034b2a6eeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:52.125187 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637ca66-85ee-4ebb-befd-0034b2a6eeac None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:52.125662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637ca66-85ee-4ebb-befd-0034b2a6eeac None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:52.126123 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637ca66-85ee-4ebb-befd-0034b2a6eeac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:52.127615 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637ca66-85ee-4ebb-befd-0034b2a6eeac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:52.129215 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637ca66-85ee-4ebb-befd-0034b2a6eeac None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:52.131558 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 521/1031] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:52.137385 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637ca66-85ee-4ebb-befd-0034b2a6eeac None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:52.145091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dd449-f148-4cee-8d29-40046c508d34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:52.146577 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dd449-f148-4cee-8d29-40046c508d34 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:52.191860 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:52.202723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:52.248534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637ca66-85ee-4ebb-befd-0034b2a6eeac None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:52.261780 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 511/1032] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:57:51 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 27 10:57:52.267230 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dd449-f148-4cee-8d29-40046c508d34 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:52.291839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb325b-0449-4b5e-a6f7-1deeaa88abba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:52.292510 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb325b-0449-4b5e-a6f7-1deeaa88abba None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:52.292794 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb325b-0449-4b5e-a6f7-1deeaa88abba None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:52.293074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb325b-0449-4b5e-a6f7-1deeaa88abba None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:52.293813 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb325b-0449-4b5e-a6f7-1deeaa88abba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:52.295240 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb325b-0449-4b5e-a6f7-1deeaa88abba None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:52.325390 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 522/1033] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:57:52 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:57:52.377350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dd449-f148-4cee-8d29-40046c508d34 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:52.416857 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b073c-924d-4ed9-a5f1-9ff2ae2e8d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:52.417694 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b073c-924d-4ed9-a5f1-9ff2ae2e8d01 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:52.417977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b073c-924d-4ed9-a5f1-9ff2ae2e8d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:52.418274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b073c-924d-4ed9-a5f1-9ff2ae2e8d01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:52.429301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b073c-924d-4ed9-a5f1-9ff2ae2e8d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:52.430815 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b073c-924d-4ed9-a5f1-9ff2ae2e8d01 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:52.433718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:52.451112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e76b073c-924d-4ed9-a5f1-9ff2ae2e8d01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:52.451112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:52.451112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:52.451112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:52.451112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:52.451112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:52.451112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:52.451112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:52.451112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:52.451112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:52.451112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:52.451112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:52.451112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:52.451112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:52.451112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:52.452527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:52.452527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:52.452527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:52.452527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:52.452527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:52.452527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:52.452527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:52.452527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:52.452527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:52.452527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:52.452527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:52.452527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:52.452527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:52.452527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:52.452527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:52.452527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:52.452527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:52.453440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:52.453440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:52.453440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:52.453440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:52.453440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 512/1034] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:52.458941 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb325b-0449-4b5e-a6f7-1deeaa88abba None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:52.563558 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb325b-0449-4b5e-a6f7-1deeaa88abba None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:52.573190 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:52.598913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d687e-53fb-4446-b01c-fdfb0a48e20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:52.599564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d687e-53fb-4446-b01c-fdfb0a48e20f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:52.599840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d687e-53fb-4446-b01c-fdfb0a48e20f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:52.600112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d687e-53fb-4446-b01c-fdfb0a48e20f None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:52.600857 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d687e-53fb-4446-b01c-fdfb0a48e20f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:52.601160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d687e-53fb-4446-b01c-fdfb0a48e20f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:52.602547 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d687e-53fb-4446-b01c-fdfb0a48e20f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:52.614765 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 523/1035] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:52.621029 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b073c-924d-4ed9-a5f1-9ff2ae2e8d01 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:52.678458 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f998e-7676-4677-9c93-e1c4e23ac82b None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:52.679268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f998e-7676-4677-9c93-e1c4e23ac82b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:52.679548 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f998e-7676-4677-9c93-e1c4e23ac82b None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:52.681078 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 524/1036] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:57:52.685778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e0abc-e991-4dbe-a9d1-55ac7ad9c154 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:52.686066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e0abc-e991-4dbe-a9d1-55ac7ad9c154 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:52.686345 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e0abc-e991-4dbe-a9d1-55ac7ad9c154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:52.703146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a94e0abc-e991-4dbe-a9d1-55ac7ad9c154 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:52.704322 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a94e0abc-e991-4dbe-a9d1-55ac7ad9c154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:52.724832 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b073c-924d-4ed9-a5f1-9ff2ae2e8d01 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:52.760583 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c047d5e-3bcd-4bdf-aded-091377ebf34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:52.761665 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c047d5e-3bcd-4bdf-aded-091377ebf34a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:52.761945 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c047d5e-3bcd-4bdf-aded-091377ebf34a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:52.762223 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c047d5e-3bcd-4bdf-aded-091377ebf34a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:52.769070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c047d5e-3bcd-4bdf-aded-091377ebf34a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:52.770600 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c047d5e-3bcd-4bdf-aded-091377ebf34a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:52.771883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 525/1037] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:52.784809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-7c047d5e-3bcd-4bdf-aded-091377ebf34a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:52.784809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:52.784809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:52.784809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:52.784809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:52.784809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:52.784809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:52.784809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:52.784809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:52.784809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:52.784809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:52.784809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:52.784809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:52.784809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:52.784809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:52.785753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:52.785753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:52.785753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:52.785753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:52.785753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:52.785753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:52.785753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:52.785753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:52.785753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:52.785753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:52.785753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:52.785753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:52.785753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:52.785753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:52.785753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:52.785753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:52.785753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:52.786658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:52.786658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:52.786658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:52.786658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:52.786658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:52.786658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:52.786658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:52.786658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:52.787648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 513/1038] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:52.791603 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e0abc-e991-4dbe-a9d1-55ac7ad9c154 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:52.795925 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c047d5e-3bcd-4bdf-aded-091377ebf34a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:52.852613 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:52.893914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:52.901317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e0abc-e991-4dbe-a9d1-55ac7ad9c154 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:52.901995 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c047d5e-3bcd-4bdf-aded-091377ebf34a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:52.937843 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa18c0b-66f8-46a0-98ac-5bca08c630fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:52.938179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f97ca-9415-47f4-911f-e8f488e025bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:52.938633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa18c0b-66f8-46a0-98ac-5bca08c630fa None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:52.938817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f97ca-9415-47f4-911f-e8f488e025bc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:52.938912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa18c0b-66f8-46a0-98ac-5bca08c630fa None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:52.939178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa18c0b-66f8-46a0-98ac-5bca08c630fa None admin] PATH_INFO: `/v3/services/image` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:52.939272 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f97ca-9415-47f4-911f-e8f488e025bc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:52.939656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f97ca-9415-47f4-911f-e8f488e025bc None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:52.939833 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa18c0b-66f8-46a0-98ac-5bca08c630fa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:52.940450 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f97ca-9415-47f4-911f-e8f488e025bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:52.940758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f97ca-9415-47f4-911f-e8f488e025bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:52.941205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa18c0b-66f8-46a0-98ac-5bca08c630fa None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:52.942191 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f97ca-9415-47f4-911f-e8f488e025bc None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:52.952942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-4fa18c0b-66f8-46a0-98ac-5bca08c630fa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 10:57:52.952942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:52.952942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:52.952942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:52.952942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:52.952942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:52.952942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:52.952942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:52.952942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 10:57:52.952942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:52.952942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:52.952942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:52.952942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:52.952942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:52.952942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:52.952942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:52.952942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:52.954409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:52.954409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:52.954409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:52.954409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:52.954409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:52.954409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:52.954409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:52.954409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:52.954409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:52.954409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:52.954409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:52.954409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:52.954409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:52.954409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:52.954409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:52.954409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:52.955249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:52.955249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:52.955249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:52.955249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:52.955249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:52.955249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:52.955249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:52.955249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:52.955249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:52.955249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:52.955249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:52.955249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:52.955249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 10:57:52.955249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:52.959396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 514/1039] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Jun 27 10:57:52 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:52.959979 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 526/1040] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:52.960277 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa18c0b-66f8-46a0-98ac-5bca08c630fa None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:52.960843 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f97ca-9415-47f4-911f-e8f488e025bc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:53.062495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f97ca-9415-47f4-911f-e8f488e025bc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:53.064002 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa18c0b-66f8-46a0-98ac-5bca08c630fa None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:53.083793 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:53.096730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be60c90-6650-4afe-b90f-3bb88f38f3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:53.097394 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be60c90-6650-4afe-b90f-3bb88f38f3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:53.097679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be60c90-6650-4afe-b90f-3bb88f38f3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:53.097952 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be60c90-6650-4afe-b90f-3bb88f38f3e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:53.098776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be60c90-6650-4afe-b90f-3bb88f38f3e3 None admin] RBAC: Adding query filter params (role.id=f56089ab411e48aaa42f4c510bb4b1cb, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=ed08c367a3d34207a51914ff77a93898) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:53.099086 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be60c90-6650-4afe-b90f-3bb88f38f3e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:53.100189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0689b2d-0fc1-4182-8789-659af0a1394b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:53.100995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be60c90-6650-4afe-b90f-3bb88f38f3e3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:53.101415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0689b2d-0fc1-4182-8789-659af0a1394b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:53.101685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0689b2d-0fc1-4182-8789-659af0a1394b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:53.101960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0689b2d-0fc1-4182-8789-659af0a1394b None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:53.102724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0689b2d-0fc1-4182-8789-659af0a1394b None admin] RBAC: Adding query filter params (name=image) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:53.103014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0689b2d-0fc1-4182-8789-659af0a1394b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:53.104643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0689b2d-0fc1-4182-8789-659af0a1394b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:53.107743 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 527/1041] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:57:52 2022] GET /identity/v3/role_assignments?user.id=ed08c367a3d34207a51914ff77a93898&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=f56089ab411e48aaa42f4c510bb4b1cb => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:53.119853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 515/1042] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:53.125904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be60c90-6650-4afe-b90f-3bb88f38f3e3 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:53.150673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:53.244446 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be60c90-6650-4afe-b90f-3bb88f38f3e3 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:53.279021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d33b15-84ee-4f8a-a5d6-af0bc536a1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:53.279706 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d33b15-84ee-4f8a-a5d6-af0bc536a1fa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:53.279987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d33b15-84ee-4f8a-a5d6-af0bc536a1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:53.280259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d33b15-84ee-4f8a-a5d6-af0bc536a1fa None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:53.280968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d33b15-84ee-4f8a-a5d6-af0bc536a1fa None admin] RBAC: Adding query filter params (type=image) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:53.281269 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d33b15-84ee-4f8a-a5d6-af0bc536a1fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:53.282639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d33b15-84ee-4f8a-a5d6-af0bc536a1fa None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:53.287696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 528/1043] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:53.294171 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0689b2d-0fc1-4182-8789-659af0a1394b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:53.396049 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0689b2d-0fc1-4182-8789-659af0a1394b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:53.429621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7532818-d25b-4fe1-b04d-0f2d0a7af635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:53.430273 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7532818-d25b-4fe1-b04d-0f2d0a7af635 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:53.430553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7532818-d25b-4fe1-b04d-0f2d0a7af635 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:53.430824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7532818-d25b-4fe1-b04d-0f2d0a7af635 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:53.431603 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7532818-d25b-4fe1-b04d-0f2d0a7af635 None admin] RBAC: Adding query filter params (interface=public, service_id=02f0fe76847b45bcb2fe9306171b84e1, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:53.431901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7532818-d25b-4fe1-b04d-0f2d0a7af635 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:53.433253 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7532818-d25b-4fe1-b04d-0f2d0a7af635 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:53.443061 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 516/1044] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jun 27 10:57:53 2022] GET /identity/v3/endpoints?service_id=02f0fe76847b45bcb2fe9306171b84e1&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:53.444276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d33b15-84ee-4f8a-a5d6-af0bc536a1fa None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:53.534180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:53.552774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d33b15-84ee-4f8a-a5d6-af0bc536a1fa None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:53.587069 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a728c06-a50b-4fab-8e9e-ac053e9586a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:53.587734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a728c06-a50b-4fab-8e9e-ac053e9586a1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:53.588015 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a728c06-a50b-4fab-8e9e-ac053e9586a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:53.588289 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a728c06-a50b-4fab-8e9e-ac053e9586a1 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:53.588967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a728c06-a50b-4fab-8e9e-ac053e9586a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:53.590350 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a728c06-a50b-4fab-8e9e-ac053e9586a1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:53.605660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 529/1045] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jun 27 10:57:53 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 10:57:54.430236 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f7afe-43de-4927-b75d-99682ed70dcd None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:54.430780 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f7afe-43de-4927-b75d-99682ed70dcd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:54.430780 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f7afe-43de-4927-b75d-99682ed70dcd None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:54.432276 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 517/1046] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:54.437264 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2896a9-fc1d-4bfa-ab07-c7eb76d8586d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:54.437585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2896a9-fc1d-4bfa-ab07-c7eb76d8586d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:54.437857 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2896a9-fc1d-4bfa-ab07-c7eb76d8586d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:54.454400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7a2896a9-fc1d-4bfa-ab07-c7eb76d8586d None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:54.455499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7a2896a9-fc1d-4bfa-ab07-c7eb76d8586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:54.520905 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 530/1047] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:54.544442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f7afe-43de-4927-b75d-99682ed70dcd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:54.594190 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:54.647484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f7afe-43de-4927-b75d-99682ed70dcd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:54.683738 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476f2fe-519d-4079-abf4-72197c5c8430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:54.684527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476f2fe-519d-4079-abf4-72197c5c8430 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:54.684809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476f2fe-519d-4079-abf4-72197c5c8430 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:54.685080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476f2fe-519d-4079-abf4-72197c5c8430 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:54.696118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476f2fe-519d-4079-abf4-72197c5c8430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:54.703894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a476f2fe-519d-4079-abf4-72197c5c8430 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:57:54.703894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:54.703894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:54.703894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:54.703894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:54.703894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:54.703894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:54.703894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:54.703894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:54.703894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:54.703894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:54.703894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:54.703894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:54.703894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:54.703894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:54.703894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:54.704971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:54.704971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:54.704971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:54.704971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:54.704971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:54.704971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:54.704971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:54.704971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:54.704971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:54.704971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:54.704971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:54.704971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:54.704971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:54.704971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:54.704971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:54.704971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:54.706263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:54.706263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:54.706263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:54.706263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:54.706263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:54.706263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:54.706263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:54.706263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:54.706263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:54.706263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:54.706263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:57:54.706263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:54.709440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 518/1048] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:57:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:54.711561 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2896a9-fc1d-4bfa-ab07-c7eb76d8586d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:54.787355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:54.810058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2896a9-fc1d-4bfa-ab07-c7eb76d8586d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:54.842943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3ff62-bc83-43c7-ba13-32c19bc7cff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:54.843601 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3ff62-bc83-43c7-ba13-32c19bc7cff0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:54.843879 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3ff62-bc83-43c7-ba13-32c19bc7cff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:54.844148 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3ff62-bc83-43c7-ba13-32c19bc7cff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:54.844880 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3ff62-bc83-43c7-ba13-32c19bc7cff0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:54.845177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3ff62-bc83-43c7-ba13-32c19bc7cff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:54.846560 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3ff62-bc83-43c7-ba13-32c19bc7cff0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:54.859635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 531/1049] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:57:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:54.861012 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476f2fe-519d-4079-abf4-72197c5c8430 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:54.962681 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476f2fe-519d-4079-abf4-72197c5c8430 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:54.972324 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:54.998340 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839dd55-acca-442f-9189-bdcfff3dc333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:54.999199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839dd55-acca-442f-9189-bdcfff3dc333 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:54.999480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839dd55-acca-442f-9189-bdcfff3dc333 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:54.999755 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839dd55-acca-442f-9189-bdcfff3dc333 None admin] PATH_INFO: `/v3/users/2a14858043524998a76833bc6d11d43a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:55.013952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839dd55-acca-442f-9189-bdcfff3dc333 None admin] RBAC: Authorizing `identity:get_user(user_id=2a14858043524998a76833bc6d11d43a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:55.015401 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839dd55-acca-442f-9189-bdcfff3dc333 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:55.021733 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 519/1050] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:57:54 2022] GET /identity/v3/users/2a14858043524998a76833bc6d11d43a => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:55.023445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3ff62-bc83-43c7-ba13-32c19bc7cff0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:55.115305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f4f4e-32e0-457c-9407-4cd9d9c97d25 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:55.115725 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f4f4e-32e0-457c-9407-4cd9d9c97d25 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:55.115880 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f4f4e-32e0-457c-9407-4cd9d9c97d25 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:55.117427 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 520/1051] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:57:55.122066 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e36156-c245-44d7-a9a3-12cb6234b415 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:55.122395 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e36156-c245-44d7-a9a3-12cb6234b415 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:55.122617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e36156-c245-44d7-a9a3-12cb6234b415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:55.128479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3ff62-bc83-43c7-ba13-32c19bc7cff0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:55.139271 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a7e36156-c245-44d7-a9a3-12cb6234b415 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:55.140664 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a7e36156-c245-44d7-a9a3-12cb6234b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:55.163888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b77e2-19d5-4712-b617-90650c9dbac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:55.164594 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b77e2-19d5-4712-b617-90650c9dbac8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:55.164877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b77e2-19d5-4712-b617-90650c9dbac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:55.165150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b77e2-19d5-4712-b617-90650c9dbac8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:55.176017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:55.221473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 521/1052] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:55.240172 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e36156-c245-44d7-a9a3-12cb6234b415 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:55.248429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b77e2-19d5-4712-b617-90650c9dbac8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:55.250260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b77e2-19d5-4712-b617-90650c9dbac8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:55.341611 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:55.348648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e36156-c245-44d7-a9a3-12cb6234b415 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:55.358521 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 532/1053] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:57:55 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:57:55.359382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b77e2-19d5-4712-b617-90650c9dbac8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:55.386639 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209bbb5-f755-4a95-a03a-6d7fdaf52f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:55.387448 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209bbb5-f755-4a95-a03a-6d7fdaf52f1e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:55.387728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209bbb5-f755-4a95-a03a-6d7fdaf52f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:55.388004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209bbb5-f755-4a95-a03a-6d7fdaf52f1e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:55.399749 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209bbb5-f755-4a95-a03a-6d7fdaf52f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:55.403272 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:55.408108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-7209bbb5-f755-4a95-a03a-6d7fdaf52f1e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 10:57:55.408108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:55.408108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:55.408108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:55.408108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:55.408108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:55.408108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:55.408108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:55.408108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:55.408108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:55.408108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:55.408108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:55.408108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:55.408108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:55.408108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:55.408108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:55.409103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:55.409103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:55.409103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:55.409103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:55.409103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:55.409103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:55.409103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:55.409103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:55.409103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:55.409103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:55.409103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:55.409103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:55.409103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:55.409103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:55.409103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:55.409103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:55.410732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:55.410732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:55.410732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:55.410732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:55.410732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:55.410732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:55.410732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:55.410732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:55.410732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:55.410732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:55.410732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 10:57:55.410732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:55.410732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 522/1054] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Jun 27 10:57:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:55.415215 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209bbb5-f755-4a95-a03a-6d7fdaf52f1e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:55.467815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b77e2-19d5-4712-b617-90650c9dbac8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:55.501667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8263-63c3-41e0-ba8e-1b0c7143c2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:55.502439 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8263-63c3-41e0-ba8e-1b0c7143c2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:55.502723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8263-63c3-41e0-ba8e-1b0c7143c2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:55.502998 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8263-63c3-41e0-ba8e-1b0c7143c2a0 None admin] PATH_INFO: `/v3/projects/12280dfbb64749659c9d10108b16128e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:55.504174 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e8263-63c3-41e0-ba8e-1b0c7143c2a0 None admin] RBAC: Authorizing `identity:get_project(project_id=12280dfbb64749659c9d10108b16128e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:55.505635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e8263-63c3-41e0-ba8e-1b0c7143c2a0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:55.507876 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 533/1055] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:57:55 2022] GET /identity/v3/projects/12280dfbb64749659c9d10108b16128e => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:55.513864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8263-63c3-41e0-ba8e-1b0c7143c2a0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:55.525095 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209bbb5-f755-4a95-a03a-6d7fdaf52f1e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:55.558997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335b8c9-d15a-4c00-badb-f90a452b4086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:55.559662 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335b8c9-d15a-4c00-badb-f90a452b4086 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:55.559966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335b8c9-d15a-4c00-badb-f90a452b4086 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:55.560224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335b8c9-d15a-4c00-badb-f90a452b4086 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:55.560970 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335b8c9-d15a-4c00-badb-f90a452b4086 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:55.561276 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335b8c9-d15a-4c00-badb-f90a452b4086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:55.562675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335b8c9-d15a-4c00-badb-f90a452b4086 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:55.575611 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 523/1056] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Jun 27 10:57:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:55.576456 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335b8c9-d15a-4c00-badb-f90a452b4086 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:55.595744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:55.620277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8263-63c3-41e0-ba8e-1b0c7143c2a0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:55.630410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:55.655300 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d9514-2e38-49de-8462-8a45ccc04cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:55.655944 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9514-2e38-49de-8462-8a45ccc04cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:55.656235 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9514-2e38-49de-8462-8a45ccc04cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:55.656509 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9514-2e38-49de-8462-8a45ccc04cd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:55.657338 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d9514-2e38-49de-8462-8a45ccc04cd6 None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=12280dfbb64749659c9d10108b16128e, user.id=2a14858043524998a76833bc6d11d43a) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:55.657688 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d9514-2e38-49de-8462-8a45ccc04cd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:55.659112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d9514-2e38-49de-8462-8a45ccc04cd6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:55.664488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 534/1057] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:57:55 2022] GET /identity/v3/role_assignments?user.id=2a14858043524998a76833bc6d11d43a&scope.project.id=12280dfbb64749659c9d10108b16128e&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:55.665884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6bf81-bda6-45ee-bdb0-10dc896f38e7 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:55.666175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6bf81-bda6-45ee-bdb0-10dc896f38e7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:55.666444 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6bf81-bda6-45ee-bdb0-10dc896f38e7 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:55.668010 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 535/1058] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:55.673536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdffe2f-a43a-4519-83ac-526c9cf85da6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:55.673839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdffe2f-a43a-4519-83ac-526c9cf85da6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:55.674088 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdffe2f-a43a-4519-83ac-526c9cf85da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:55.682198 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335b8c9-d15a-4c00-badb-f90a452b4086 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:55.692990 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6cdffe2f-a43a-4519-83ac-526c9cf85da6 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:55.694086 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6cdffe2f-a43a-4519-83ac-526c9cf85da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:55.724093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896676a1-bf24-4406-b47a-421324e915a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:55.725243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896676a1-bf24-4406-b47a-421324e915a0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:55.725700 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896676a1-bf24-4406-b47a-421324e915a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:55.725906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896676a1-bf24-4406-b47a-421324e915a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:55.738257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896676a1-bf24-4406-b47a-421324e915a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:55.739865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896676a1-bf24-4406-b47a-421324e915a0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:55.759323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-896676a1-bf24-4406-b47a-421324e915a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:55.759323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:55.759323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:55.759323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:55.759323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:55.759323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:55.759323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:55.759323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:55.759323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:55.759323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:55.759323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:55.759323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:55.759323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:55.759323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:55.759323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:55.760445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:55.760445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:55.760445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:55.760445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:55.760445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:55.760445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:55.760445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:55.760445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:55.760445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:55.760445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:55.760445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:55.760445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:55.760445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:55.760445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:55.760445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:55.760445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:55.760445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:55.761717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:55.761717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:55.761717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:55.761717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:55.761717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 524/1059] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:55.766603 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896676a1-bf24-4406-b47a-421324e915a0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:55.773054 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 536/1060] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:55.796085 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdffe2f-a43a-4519-83ac-526c9cf85da6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:55.844699 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:55.879780 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896676a1-bf24-4406-b47a-421324e915a0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:55.906084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdffe2f-a43a-4519-83ac-526c9cf85da6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:55.907892 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:55.918171 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afc00b-561c-48ab-aca2-b8686747621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:55.918785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afc00b-561c-48ab-aca2-b8686747621a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:55.919072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afc00b-561c-48ab-aca2-b8686747621a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:55.919350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afc00b-561c-48ab-aca2-b8686747621a None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:55.920077 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afc00b-561c-48ab-aca2-b8686747621a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:55.920552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afc00b-561c-48ab-aca2-b8686747621a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:55.921881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afc00b-561c-48ab-aca2-b8686747621a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:55.934915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 525/1061] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:55.940402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afc00b-561c-48ab-aca2-b8686747621a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:55.945497 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a68ab-53ae-42bc-9247-d8ff9307503c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:55.946281 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a68ab-53ae-42bc-9247-d8ff9307503c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:55.946556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a68ab-53ae-42bc-9247-d8ff9307503c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:55.946852 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a68ab-53ae-42bc-9247-d8ff9307503c None admin] PATH_INFO: `/v3/services/image` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:55.947475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a68ab-53ae-42bc-9247-d8ff9307503c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:55.948837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a68ab-53ae-42bc-9247-d8ff9307503c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:55.961753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-7d7a68ab-53ae-42bc-9247-d8ff9307503c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 10:57:55.961753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:55.961753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 10:57:55.961753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 10:57:55.961753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 10:57:55.961753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 10:57:55.961753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 10:57:55.961753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:55.961753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 10:57:55.961753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:55.961753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:57:55.961753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:55.961753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:55.961753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:55.961753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:55.961753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:55.961753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:55.962889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:55.962889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:55.962889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:55.962889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:55.962889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:55.962889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:55.962889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 10:57:55.962889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 10:57:55.962889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 10:57:55.962889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 10:57:55.962889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:55.962889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:55.962889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:55.962889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:55.962889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:55.962889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:55.963728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:55.963728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:55.963728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:55.963728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:55.963728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:55.963728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:55.963728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:55.963728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:55.963728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:55.963728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:55.963728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 10:57:55.963728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 10:57:55.963728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 10:57:55.963728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:55.963728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 537/1062] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Jun 27 10:57:55 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:55.968691 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a68ab-53ae-42bc-9247-d8ff9307503c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:56.048625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afc00b-561c-48ab-aca2-b8686747621a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:56.074152 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a68ab-53ae-42bc-9247-d8ff9307503c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:56.078829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:56.085860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb168b-85b8-4ab6-8bfa-dc4c50e1b634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:56.086836 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb168b-85b8-4ab6-8bfa-dc4c50e1b634 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:56.087278 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb168b-85b8-4ab6-8bfa-dc4c50e1b634 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:56.087690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb168b-85b8-4ab6-8bfa-dc4c50e1b634 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:56.095262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb168b-85b8-4ab6-8bfa-dc4c50e1b634 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:56.096707 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb168b-85b8-4ab6-8bfa-dc4c50e1b634 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:56.111527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb8647-50db-4778-b5d5-06c8c1ad4b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:56.112185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb8647-50db-4778-b5d5-06c8c1ad4b39 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:56.112465 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb8647-50db-4778-b5d5-06c8c1ad4b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:56.112739 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb8647-50db-4778-b5d5-06c8c1ad4b39 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:56.112854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-cdbb168b-85b8-4ab6-8bfa-dc4c50e1b634 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:57:56.112854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:56.112854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:56.112854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:56.112854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:56.112854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:56.112854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:56.112854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:56.112854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:56.112854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:56.112854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:56.112854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:56.112854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:57:56.112854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:57:56.112854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:57:56.112854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:56.113763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:56.120275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:56.120275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:56.120275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:57:56.120275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:57:56.120275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:57:56.120275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:57:56.120275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:57:56.120275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:57:56.120275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:57:56.120275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:56.120816 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb8647-50db-4778-b5d5-06c8c1ad4b39 None admin] RBAC: Adding query filter params (name=image) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:56.120816 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb8647-50db-4778-b5d5-06c8c1ad4b39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:56.120944 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 526/1063] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jun 27 10:57:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:56.121020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb8647-50db-4778-b5d5-06c8c1ad4b39 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:56.121089 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb168b-85b8-4ab6-8bfa-dc4c50e1b634 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:56.124912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 538/1064] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:56.130672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb8647-50db-4778-b5d5-06c8c1ad4b39 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:56.161592 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:56.233319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb168b-85b8-4ab6-8bfa-dc4c50e1b634 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:56.246485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb8647-50db-4778-b5d5-06c8c1ad4b39 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:56.269649 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41439846-6aa3-4034-8a96-38f1f8ec5b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:56.270316 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41439846-6aa3-4034-8a96-38f1f8ec5b9c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:56.270598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41439846-6aa3-4034-8a96-38f1f8ec5b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:56.270871 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41439846-6aa3-4034-8a96-38f1f8ec5b9c None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:56.271746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41439846-6aa3-4034-8a96-38f1f8ec5b9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:56.272053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41439846-6aa3-4034-8a96-38f1f8ec5b9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:56.273538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41439846-6aa3-4034-8a96-38f1f8ec5b9c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:56.281555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e9dff-5ad2-44e1-9e4a-0e7207004e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:56.282211 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e9dff-5ad2-44e1-9e4a-0e7207004e11 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:56.282518 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e9dff-5ad2-44e1-9e4a-0e7207004e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:56.282799 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e9dff-5ad2-44e1-9e4a-0e7207004e11 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:56.283491 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e9dff-5ad2-44e1-9e4a-0e7207004e11 None admin] RBAC: Adding query filter params (type=image) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:56.283796 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e9dff-5ad2-44e1-9e4a-0e7207004e11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:56.285171 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e9dff-5ad2-44e1-9e4a-0e7207004e11 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:56.295228 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 539/1065] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:56.295393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 527/1066] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jun 27 10:57:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:56.296839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e9dff-5ad2-44e1-9e4a-0e7207004e11 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:56.297421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41439846-6aa3-4034-8a96-38f1f8ec5b9c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:56.355319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:56.395633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:56.403430 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e9dff-5ad2-44e1-9e4a-0e7207004e11 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:56.411259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41439846-6aa3-4034-8a96-38f1f8ec5b9c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:56.437951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d1f9a-3ac1-4a70-99eb-8c8dac8b9082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:56.438608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d1f9a-3ac1-4a70-99eb-8c8dac8b9082 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:56.438892 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d1f9a-3ac1-4a70-99eb-8c8dac8b9082 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:56.439167 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d1f9a-3ac1-4a70-99eb-8c8dac8b9082 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:56.439899 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d1f9a-3ac1-4a70-99eb-8c8dac8b9082 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:56.441264 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d1f9a-3ac1-4a70-99eb-8c8dac8b9082 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:56.447110 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55644c-770b-45b1-b0c6-981d827f5744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:56.448093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55644c-770b-45b1-b0c6-981d827f5744 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:56.448555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55644c-770b-45b1-b0c6-981d827f5744 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:56.449007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55644c-770b-45b1-b0c6-981d827f5744 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:56.469394 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 540/1067] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jun 27 10:57:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 10:57:56.469652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55644c-770b-45b1-b0c6-981d827f5744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:56.469652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55644c-770b-45b1-b0c6-981d827f5744 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:56.484136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-1e55644c-770b-45b1-b0c6-981d827f5744 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:56.484136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:56.484136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:56.484136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:56.484136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:56.484136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:56.484136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:56.484136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:56.484136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:56.484136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:56.484136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:56.484136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:56.484136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:56.484136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:56.484136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:56.485153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:56.485153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:56.485153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:56.485153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:56.485153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:56.485153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:56.485153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:56.485153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:56.485153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:56.485153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:56.485153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:56.485153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:56.485153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:56.485153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:56.485153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:56.485153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:56.485153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:56.490857 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:56.490857 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:56.490857 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:56.490857 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:56.490857 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 528/1068] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:56.492794 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d1f9a-3ac1-4a70-99eb-8c8dac8b9082 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:56.607048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d1f9a-3ac1-4a70-99eb-8c8dac8b9082 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:56.641562 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08828d-ae00-442d-b750-9f870bf2b176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:56.642222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08828d-ae00-442d-b750-9f870bf2b176 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:56.642500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08828d-ae00-442d-b750-9f870bf2b176 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:56.642773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08828d-ae00-442d-b750-9f870bf2b176 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:56.643482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08828d-ae00-442d-b750-9f870bf2b176 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:56.643786 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08828d-ae00-442d-b750-9f870bf2b176 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:56.645138 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08828d-ae00-442d-b750-9f870bf2b176 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:56.658604 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 541/1069] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:56.664369 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55644c-770b-45b1-b0c6-981d827f5744 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:56.771222 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:56.774799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55644c-770b-45b1-b0c6-981d827f5744 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:56.809655 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e1172-3cf8-4c57-9fdf-05a672ef7cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:56.810446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e1172-3cf8-4c57-9fdf-05a672ef7cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:56.810730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e1172-3cf8-4c57-9fdf-05a672ef7cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:56.811003 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e1172-3cf8-4c57-9fdf-05a672ef7cc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:56.817784 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e1172-3cf8-4c57-9fdf-05a672ef7cc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:56.819766 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e1172-3cf8-4c57-9fdf-05a672ef7cc8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:56.833484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6f1e1172-3cf8-4c57-9fdf-05a672ef7cc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:56.833484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:56.833484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:56.833484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:56.833484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:56.833484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:56.833484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:56.833484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:56.833484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:56.833484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:56.833484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:56.833484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:56.833484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:57:56.833484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:57:56.833484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:57:56.834367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:57:56.834367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:56.834367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:56.834367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:56.834367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:56.834367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:56.834367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:56.834367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:56.834367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:56.834367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:56.834367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:56.834367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:56.834367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:56.834367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:56.834367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:56.834367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:56.834367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:56.836521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:57:56.836521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:57:56.836521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:57:56.836521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:57:56.836521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:57:56.836521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:57:56.836521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:57:56.836521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:56.836521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 529/1070] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:57:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:56.840858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08828d-ae00-442d-b750-9f870bf2b176 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:56.849924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:56.941417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08828d-ae00-442d-b750-9f870bf2b176 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:56.978564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db1f0d-cf77-4790-b62c-0cc6b19d19ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:56.979573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db1f0d-cf77-4790-b62c-0cc6b19d19ee None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:56.980080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db1f0d-cf77-4790-b62c-0cc6b19d19ee None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:56.980558 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db1f0d-cf77-4790-b62c-0cc6b19d19ee None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:56.981560 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db1f0d-cf77-4790-b62c-0cc6b19d19ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:56.982065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db1f0d-cf77-4790-b62c-0cc6b19d19ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:56.983671 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db1f0d-cf77-4790-b62c-0cc6b19d19ee None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:56.995602 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 542/1071] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:57:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:57.001162 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e1172-3cf8-4c57-9fdf-05a672ef7cc8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:57.100470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e1172-3cf8-4c57-9fdf-05a672ef7cc8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:57.134494 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112f677-fc70-4058-8c96-23416f08c095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:57.135382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112f677-fc70-4058-8c96-23416f08c095 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:57.135664 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112f677-fc70-4058-8c96-23416f08c095 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:57.135931 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112f677-fc70-4058-8c96-23416f08c095 None admin] PATH_INFO: `/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/ed08c367a3d34207a51914ff77a93898/roles/f56089ab411e48aaa42f4c510bb4b1cb` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:57.138425 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112f677-fc70-4058-8c96-23416f08c095 None admin] RBAC: Authorizing `identity:create_grant(project_id=6543a66af8ba48c391ce686f6d82276b, user_id=ed08c367a3d34207a51914ff77a93898, role_id=f56089ab411e48aaa42f4c510bb4b1cb)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:57.139852 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112f677-fc70-4058-8c96-23416f08c095 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:57.156145 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 530/1072] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:57:57 2022] PUT /identity/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/ed08c367a3d34207a51914ff77a93898/roles/f56089ab411e48aaa42f4c510bb4b1cb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:57:57.691817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd4a19-6a7d-4515-9b4e-a3b0b859f22e None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:57.692111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd4a19-6a7d-4515-9b4e-a3b0b859f22e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:57.692389 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd4a19-6a7d-4515-9b4e-a3b0b859f22e None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:57.694073 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 543/1073] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:57.699638 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf406be4-a8de-4559-a03e-44753c4e1b5f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:57.700094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf406be4-a8de-4559-a03e-44753c4e1b5f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:57.700235 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf406be4-a8de-4559-a03e-44753c4e1b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:57.717305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cf406be4-a8de-4559-a03e-44753c4e1b5f None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:57.718510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cf406be4-a8de-4559-a03e-44753c4e1b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:57.733964 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:57.789002 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 531/1074] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:57.811689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd4a19-6a7d-4515-9b4e-a3b0b859f22e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:57.877881 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:57.915856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd4a19-6a7d-4515-9b4e-a3b0b859f22e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:57.948220 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184d813-2421-4d93-8855-fe87e9ead668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:57.948936 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184d813-2421-4d93-8855-fe87e9ead668 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:57.949212 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184d813-2421-4d93-8855-fe87e9ead668 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:57.949509 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184d813-2421-4d93-8855-fe87e9ead668 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:57.961003 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184d813-2421-4d93-8855-fe87e9ead668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:57.968534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f184d813-2421-4d93-8855-fe87e9ead668 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:57:57.968534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:57.968534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:57.968534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:57.968534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:57.968534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:57.968534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:57.968534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:57.968534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:57.968534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:57.968534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:57.968534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:57.968534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:57.968534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:57.968534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:57.968534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:57.969737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:57.969737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:57.969737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:57.969737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:57.969737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:57.969737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:57.969737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:57.969737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:57.969737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:57.969737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:57.969737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:57.969737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:57.969737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:57.969737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:57.969737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:57.969737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:57.970606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:57.970606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:57.970606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:57.970606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:57.970606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:57.970606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:57.970606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:57.970606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:57.970606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:57.970606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:57.970606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:57:57.970606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:57:57.973462 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 544/1075] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:57:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:57.976492 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf406be4-a8de-4559-a03e-44753c4e1b5f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:58.084160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf406be4-a8de-4559-a03e-44753c4e1b5f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:58.119225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e31d92-9360-40ce-b621-303dbbd08780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:58.119896 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e31d92-9360-40ce-b621-303dbbd08780 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:58.120181 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e31d92-9360-40ce-b621-303dbbd08780 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:58.120460 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e31d92-9360-40ce-b621-303dbbd08780 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:58.121206 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e31d92-9360-40ce-b621-303dbbd08780 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:58.121542 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e31d92-9360-40ce-b621-303dbbd08780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:58.122915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e31d92-9360-40ce-b621-303dbbd08780 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:58.136544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 532/1076] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:57:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:58.137789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184d813-2421-4d93-8855-fe87e9ead668 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:58.245956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184d813-2421-4d93-8855-fe87e9ead668 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:58.273662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:58.283075 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5844061-647a-4d5d-9d68-c1ed4fdc6b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:58.283940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5844061-647a-4d5d-9d68-c1ed4fdc6b46 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:58.284220 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5844061-647a-4d5d-9d68-c1ed4fdc6b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:58.284491 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5844061-647a-4d5d-9d68-c1ed4fdc6b46 None admin] PATH_INFO: `/v3/users/2a14858043524998a76833bc6d11d43a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:58.285705 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5844061-647a-4d5d-9d68-c1ed4fdc6b46 None admin] RBAC: Authorizing `identity:get_user(user_id=2a14858043524998a76833bc6d11d43a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:58.287120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5844061-647a-4d5d-9d68-c1ed4fdc6b46 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:58.289520 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 545/1077] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:57:58 2022] GET /identity/v3/users/2a14858043524998a76833bc6d11d43a => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:58.294944 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e31d92-9360-40ce-b621-303dbbd08780 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:58.311343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:58.397759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e31d92-9360-40ce-b621-303dbbd08780 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:58.432008 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1665f67-ec24-4402-a375-0fd8689031aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:58.432866 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1665f67-ec24-4402-a375-0fd8689031aa None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:58.433145 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1665f67-ec24-4402-a375-0fd8689031aa None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:58.433442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1665f67-ec24-4402-a375-0fd8689031aa None admin] PATH_INFO: `/v3/projects/12280dfbb64749659c9d10108b16128e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:58.434608 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1665f67-ec24-4402-a375-0fd8689031aa None admin] RBAC: Authorizing `identity:get_project(project_id=12280dfbb64749659c9d10108b16128e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:58.436037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1665f67-ec24-4402-a375-0fd8689031aa None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:58.437961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 533/1078] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:57:58 2022] GET /identity/v3/projects/12280dfbb64749659c9d10108b16128e => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:58.443521 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5844061-647a-4d5d-9d68-c1ed4fdc6b46 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:58.543232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5844061-647a-4d5d-9d68-c1ed4fdc6b46 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:58.547481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25b300-0fe6-4e30-b112-49160688f4c7 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:58.547763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25b300-0fe6-4e30-b112-49160688f4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:58.548097 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25b300-0fe6-4e30-b112-49160688f4c7 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:58.549622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 534/1079] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:57:58.555092 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71c28a-c7b3-409b-8be4-b3fec65999c0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:58.555382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71c28a-c7b3-409b-8be4-b3fec65999c0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:58.555659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71c28a-c7b3-409b-8be4-b3fec65999c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:58.572094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ff71c28a-c7b3-409b-8be4-b3fec65999c0 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:58.573257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ff71c28a-c7b3-409b-8be4-b3fec65999c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:58.579043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6a56c-6c26-4299-8945-e877ebce47cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:58.580132 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6a56c-6c26-4299-8945-e877ebce47cd None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:58.581024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6a56c-6c26-4299-8945-e877ebce47cd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:58.581514 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6a56c-6c26-4299-8945-e877ebce47cd None admin] PATH_INFO: `/v3/projects/12280dfbb64749659c9d10108b16128e/users/2a14858043524998a76833bc6d11d43a/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:58.584329 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6a56c-6c26-4299-8945-e877ebce47cd None admin] RBAC: Authorizing `identity:create_grant(project_id=12280dfbb64749659c9d10108b16128e, user_id=2a14858043524998a76833bc6d11d43a, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:58.586896 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6a56c-6c26-4299-8945-e877ebce47cd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:58.605119 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 546/1080] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:57:58 2022] PUT /identity/v3/projects/12280dfbb64749659c9d10108b16128e/users/2a14858043524998a76833bc6d11d43a/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 10:57:58.659540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 535/1081] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:57:58.682640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6a56c-6c26-4299-8945-e877ebce47cd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:58.744822 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:58.798017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6a56c-6c26-4299-8945-e877ebce47cd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:58.831821 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ec56-071c-405f-b69d-a1decf8ad086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:58.832470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ec56-071c-405f-b69d-a1decf8ad086 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:58.832748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ec56-071c-405f-b69d-a1decf8ad086 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:58.833020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ec56-071c-405f-b69d-a1decf8ad086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:58.900705 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99ec56-071c-405f-b69d-a1decf8ad086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:58.902175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99ec56-071c-405f-b69d-a1decf8ad086 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:58.955491 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:59.001270 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 547/1082] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:57:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:57:59.007967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71c28a-c7b3-409b-8be4-b3fec65999c0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:59.019741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:59.108287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71c28a-c7b3-409b-8be4-b3fec65999c0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:59.142739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0b6e8-64a5-48cb-abf6-b7403130914c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:59.143526 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0b6e8-64a5-48cb-abf6-b7403130914c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:59.143806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0b6e8-64a5-48cb-abf6-b7403130914c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:59.144077 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0b6e8-64a5-48cb-abf6-b7403130914c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:59.154982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0b6e8-64a5-48cb-abf6-b7403130914c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:59.156413 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0b6e8-64a5-48cb-abf6-b7403130914c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:59.173768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9dc0b6e8-64a5-48cb-abf6-b7403130914c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:59.173768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:59.173768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:59.173768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:59.173768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:59.173768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:59.173768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:59.173768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:59.173768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:59.173768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:59.173768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:59.173768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:59.173768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:59.173768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:59.173768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:59.174663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:59.174663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:59.174663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:59.174663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:59.174663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:59.174663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:59.174663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:59.174663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:59.174663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:59.174663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:59.174663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:59.174663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:59.174663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:59.174663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:59.174663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:59.174663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:59.174663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:59.175562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:59.175562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:59.175562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:59.175562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:59.177681 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 536/1083] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:59.178483 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9ab01-5584-48f8-85ef-de87463c507a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:59.178778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9ab01-5584-48f8-85ef-de87463c507a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:59.179052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9ab01-5584-48f8-85ef-de87463c507a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:59.180443 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 548/1084] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:57:59.185053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9ab01-5584-48f8-85ef-de87463c507a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:59.185646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b09182-6122-469f-a1c7-ed3db92ea2f2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:59.185936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b09182-6122-469f-a1c7-ed3db92ea2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:59.186244 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b09182-6122-469f-a1c7-ed3db92ea2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:59.203451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-52b09182-6122-469f-a1c7-ed3db92ea2f2 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:57:59.204624 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-52b09182-6122-469f-a1c7-ed3db92ea2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:57:59.265073 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:59.277066 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 537/1085] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:57:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:57:59.295858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9ab01-5584-48f8-85ef-de87463c507a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:59.300055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b09182-6122-469f-a1c7-ed3db92ea2f2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:59.331468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef7137-72ed-4748-969e-5b5439e5aae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:59.332127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef7137-72ed-4748-969e-5b5439e5aae1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:59.332407 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef7137-72ed-4748-969e-5b5439e5aae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:59.332677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef7137-72ed-4748-969e-5b5439e5aae1 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:59.333418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef7137-72ed-4748-969e-5b5439e5aae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:59.333723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef7137-72ed-4748-969e-5b5439e5aae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:59.335100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef7137-72ed-4748-969e-5b5439e5aae1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:59.346534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 549/1086] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:59.418048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b09182-6122-469f-a1c7-ed3db92ea2f2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:59.454146 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719e19e-b5f9-4fc1-958c-742f86d44948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:59.454971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719e19e-b5f9-4fc1-958c-742f86d44948 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:59.455248 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719e19e-b5f9-4fc1-958c-742f86d44948 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:59.455518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719e19e-b5f9-4fc1-958c-742f86d44948 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:59.467140 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719e19e-b5f9-4fc1-958c-742f86d44948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:57:59.475469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5719e19e-b5f9-4fc1-958c-742f86d44948 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 10:57:59.475469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:59.475469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:59.475469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:59.475469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:59.475469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:59.475469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:59.475469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:59.475469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:59.475469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:59.475469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:59.475469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:59.475469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:57:59.475469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:57:59.475469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:57:59.475469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:57:59.476455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:57:59.476455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:57:59.476455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:57:59.476455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:57:59.476455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:59.476455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:59.476455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:59.476455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:59.476455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:59.476455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:59.476455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:59.476455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:59.476455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:59.476455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:59.476455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:59.476455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:59.482185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:59.482185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:59.482185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:59.482185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:59.482185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:57:59.482185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:57:59.482185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:57:59.482185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:57:59.482185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:57:59.482185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:57:59.482185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 10:57:59.482185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:59.482185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 538/1087] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Jun 27 10:57:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:57:59.484368 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef7137-72ed-4748-969e-5b5439e5aae1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:59.501165 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:59.593841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef7137-72ed-4748-969e-5b5439e5aae1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:59.628386 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcf815-b186-4240-aff5-70378088b8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:59.629056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcf815-b186-4240-aff5-70378088b8be None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:59.629337 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcf815-b186-4240-aff5-70378088b8be None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:59.629639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcf815-b186-4240-aff5-70378088b8be None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:59.630387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcf815-b186-4240-aff5-70378088b8be None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:59.630690 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcf815-b186-4240-aff5-70378088b8be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:59.632618 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcf815-b186-4240-aff5-70378088b8be None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:59.640973 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 550/1088] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Jun 27 10:57:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:57:59.646741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719e19e-b5f9-4fc1-958c-742f86d44948 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:59.699187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:59.748381 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719e19e-b5f9-4fc1-958c-742f86d44948 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:59.780646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf5a7f-305d-47dd-b2d2-1fd2fd59535f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:59.781453 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf5a7f-305d-47dd-b2d2-1fd2fd59535f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:59.781740 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf5a7f-305d-47dd-b2d2-1fd2fd59535f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:59.782014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf5a7f-305d-47dd-b2d2-1fd2fd59535f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:59.792642 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf5a7f-305d-47dd-b2d2-1fd2fd59535f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:59.794109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf5a7f-305d-47dd-b2d2-1fd2fd59535f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:59.810951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-1fdf5a7f-305d-47dd-b2d2-1fd2fd59535f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:59.810951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:57:59.810951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:57:59.810951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:57:59.810951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:57:59.810951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:57:59.810951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:57:59.810951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:57:59.810951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:57:59.810951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:57:59.810951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:57:59.810951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:57:59.810951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:57:59.810951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:57:59.810951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:57:59.811826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:57:59.811826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:57:59.811826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:57:59.811826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:57:59.811826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:57:59.811826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:57:59.811826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:57:59.811826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:57:59.811826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:57:59.811826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:57:59.811826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:57:59.811826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:57:59.811826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:57:59.811826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:57:59.811826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:57:59.811826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:57:59.811826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:57:59.812718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:57:59.812718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:57:59.812718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:57:59.812718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:57:59.812718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 539/1089] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:57:59.817741 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcf815-b186-4240-aff5-70378088b8be None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:57:59.891029 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:57:59.912460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcf815-b186-4240-aff5-70378088b8be None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:57:59.944437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab87006-4cdc-4a23-adc8-d93d0fb52f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:57:59.945074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab87006-4cdc-4a23-adc8-d93d0fb52f94 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:57:59.945351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab87006-4cdc-4a23-adc8-d93d0fb52f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:57:59.945662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab87006-4cdc-4a23-adc8-d93d0fb52f94 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:57:59.946366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab87006-4cdc-4a23-adc8-d93d0fb52f94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:57:59.946666 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab87006-4cdc-4a23-adc8-d93d0fb52f94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:57:59.948004 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab87006-4cdc-4a23-adc8-d93d0fb52f94 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:57:59.959431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 551/1090] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:57:59.964827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf5a7f-305d-47dd-b2d2-1fd2fd59535f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:00.062635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf5a7f-305d-47dd-b2d2-1fd2fd59535f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:00.064959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:00.096329 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebd313-e361-45dd-9f69-74c99b0ce8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:00.097105 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebd313-e361-45dd-9f69-74c99b0ce8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:00.097411 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebd313-e361-45dd-9f69-74c99b0ce8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:00.097690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebd313-e361-45dd-9f69-74c99b0ce8c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:00.105517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebd313-e361-45dd-9f69-74c99b0ce8c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:00.106952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebd313-e361-45dd-9f69-74c99b0ce8c8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:00.120476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-23ebd313-e361-45dd-9f69-74c99b0ce8c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:58:00.120476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:58:00.120476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:58:00.120476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:58:00.120476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:58:00.120476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:58:00.120476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:58:00.120476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:58:00.120476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:58:00.120476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:58:00.120476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:58:00.120476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:58:00.120476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:58:00.120476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:58:00.120476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:58:00.120476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:58:00.121454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:58:00.122403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:58:00.122403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:58:00.122403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:58:00.122403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:58:00.122403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:58:00.122403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:58:00.122403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:58:00.122403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:58:00.122403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 10:58:00.122403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:58:00.122403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 540/1091] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jun 27 10:57:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:58:00.127287 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab87006-4cdc-4a23-adc8-d93d0fb52f94 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:00.223941 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab87006-4cdc-4a23-adc8-d93d0fb52f94 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:00.256850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb932e25-0d70-4716-a326-a7944ece02bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:00.257546 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb932e25-0d70-4716-a326-a7944ece02bc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:00.257828 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb932e25-0d70-4716-a326-a7944ece02bc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:00.258103 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb932e25-0d70-4716-a326-a7944ece02bc None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:00.258933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb932e25-0d70-4716-a326-a7944ece02bc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:00.259236 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb932e25-0d70-4716-a326-a7944ece02bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:00.260655 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb932e25-0d70-4716-a326-a7944ece02bc None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:00.263387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:00.279333 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 552/1092] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jun 27 10:58:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:00.284899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebd313-e361-45dd-9f69-74c99b0ce8c8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:00.380229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebd313-e361-45dd-9f69-74c99b0ce8c8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:00.412534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86901c52-45a5-40b9-a294-86b139a3a9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:00.413789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86901c52-45a5-40b9-a294-86b139a3a9ce None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:00.414068 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86901c52-45a5-40b9-a294-86b139a3a9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:00.414340 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86901c52-45a5-40b9-a294-86b139a3a9ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:00.443079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:00.479041 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86901c52-45a5-40b9-a294-86b139a3a9ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:00.480408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86901c52-45a5-40b9-a294-86b139a3a9ce None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:00.576021 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 541/1093] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:58:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:58:00.581709 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb932e25-0d70-4716-a326-a7944ece02bc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:00.639484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015630-148e-46fd-86bd-06708a050fd4 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:00.639774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015630-148e-46fd-86bd-06708a050fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:00.640046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015630-148e-46fd-86bd-06708a050fd4 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:00.641447 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 542/1094] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:58:00.646153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976894f-1d58-47bf-bf47-0b91a5671862 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:00.646435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976894f-1d58-47bf-bf47-0b91a5671862 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:00.646706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976894f-1d58-47bf-bf47-0b91a5671862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:00.663148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2976894f-1d58-47bf-bf47-0b91a5671862 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:58:00.664311 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2976894f-1d58-47bf-bf47-0b91a5671862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:58:00.678589 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb932e25-0d70-4716-a326-a7944ece02bc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:00.712330 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da63112-4939-4a23-b3b8-6b3c506960c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:00.713101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da63112-4939-4a23-b3b8-6b3c506960c8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:00.713388 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da63112-4939-4a23-b3b8-6b3c506960c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:00.713667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da63112-4939-4a23-b3b8-6b3c506960c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:00.722216 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:00.723525 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da63112-4939-4a23-b3b8-6b3c506960c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:00.724962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da63112-4939-4a23-b3b8-6b3c506960c8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:00.731093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 543/1095] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:58:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:58:00.741914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-6da63112-4939-4a23-b3b8-6b3c506960c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:58:00.741914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:58:00.741914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:58:00.741914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:58:00.741914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:58:00.741914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:58:00.741914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:58:00.741914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:58:00.741914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:58:00.741914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:58:00.741914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:58:00.741914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:58:00.741914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:58:00.741914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:58:00.741914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:58:00.743059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:58:00.743059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:58:00.743059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:58:00.743059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:58:00.743059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:58:00.743059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:58:00.743059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:58:00.743059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:58:00.743059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:58:00.743059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:58:00.743059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:58:00.743059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:58:00.743059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:58:00.743059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:58:00.743059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:58:00.743059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:58:00.743059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:58:00.744140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:58:00.744140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:58:00.744140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:58:00.744140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:58:00.745618 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 553/1096] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:58:00.748447 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976894f-1d58-47bf-bf47-0b91a5671862 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:00.753871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da63112-4939-4a23-b3b8-6b3c506960c8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:00.798500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:00.847618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976894f-1d58-47bf-bf47-0b91a5671862 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:00.851301 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da63112-4939-4a23-b3b8-6b3c506960c8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:00.880509 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48aa6c4-f9bc-4992-b6c5-325b53430b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:00.881159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48aa6c4-f9bc-4992-b6c5-325b53430b78 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:00.881469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48aa6c4-f9bc-4992-b6c5-325b53430b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:00.882347 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48aa6c4-f9bc-4992-b6c5-325b53430b78 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:00.883064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48aa6c4-f9bc-4992-b6c5-325b53430b78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:00.883376 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48aa6c4-f9bc-4992-b6c5-325b53430b78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:00.884735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48aa6c4-f9bc-4992-b6c5-325b53430b78 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:00.884859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ee781-2f29-4062-8a1e-0dc5dfbd5556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:00.885650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ee781-2f29-4062-8a1e-0dc5dfbd5556 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:00.885932 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ee781-2f29-4062-8a1e-0dc5dfbd5556 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:00.886465 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ee781-2f29-4062-8a1e-0dc5dfbd5556 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:00.896025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 544/1097] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:58:00.896206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ee781-2f29-4062-8a1e-0dc5dfbd5556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:58:00.901517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48aa6c4-f9bc-4992-b6c5-325b53430b78 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:00.903759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a96ee781-2f29-4062-8a1e-0dc5dfbd5556 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:58:00.903759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:58:00.903759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:58:00.903759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:58:00.903759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:58:00.903759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:58:00.903759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:58:00.903759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:58:00.903759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:58:00.903759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:58:00.903759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:58:00.903759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:58:00.903759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:58:00.903759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:58:00.903759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:58:00.903759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:58:00.904698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:58:00.904698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:58:00.904698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:58:00.904698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:58:00.904698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:58:00.904698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:58:00.904698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:58:00.904698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:58:00.904698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:58:00.904698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:58:00.904698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:58:00.904698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:58:00.904698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:58:00.904698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:58:00.904698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:58:00.904698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:58:00.905573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:58:00.905573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:58:00.905573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:58:00.905573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:58:00.905573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:58:00.905573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:58:00.905573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:58:00.905573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:58:00.905573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:58:00.905573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:58:00.905573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:58:00.905573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:58:00.905573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 554/1098] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:58:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:58:00.910560 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ee781-2f29-4062-8a1e-0dc5dfbd5556 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:00.958956 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:01.006009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48aa6c4-f9bc-4992-b6c5-325b53430b78 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:01.014587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ee781-2f29-4062-8a1e-0dc5dfbd5556 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:01.021405 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:01.040716 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3887cf0-3e12-452f-9eac-45123ec34457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:01.041532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3887cf0-3e12-452f-9eac-45123ec34457 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:01.041814 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3887cf0-3e12-452f-9eac-45123ec34457 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:01.042087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3887cf0-3e12-452f-9eac-45123ec34457 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:01.048715 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3887cf0-3e12-452f-9eac-45123ec34457 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:01.050189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3887cf0-3e12-452f-9eac-45123ec34457 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:01.051320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24db69-4d1f-4ae5-9c3c-a91deb7a1e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:01.051978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24db69-4d1f-4ae5-9c3c-a91deb7a1e94 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:01.052256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24db69-4d1f-4ae5-9c3c-a91deb7a1e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:01.052537 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24db69-4d1f-4ae5-9c3c-a91deb7a1e94 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:01.053270 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24db69-4d1f-4ae5-9c3c-a91deb7a1e94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:01.054110 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24db69-4d1f-4ae5-9c3c-a91deb7a1e94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:01.055458 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24db69-4d1f-4ae5-9c3c-a91deb7a1e94 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:01.063321 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 555/1099] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:58:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:58:01.064486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e3887cf0-3e12-452f-9eac-45123ec34457 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:58:01.064486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:58:01.064486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:58:01.064486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:58:01.064486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:58:01.064486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:58:01.064486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:58:01.064486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:58:01.064486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:58:01.064486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:58:01.064486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:58:01.064486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:58:01.064486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:58:01.064486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:58:01.064486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:58:01.065838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:58:01.065838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:58:01.065838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:58:01.065838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:58:01.065838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:58:01.065838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:58:01.065838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:58:01.065838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:58:01.065838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:58:01.065838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:58:01.065838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:58:01.065838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:58:01.065838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:58:01.065838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:58:01.065838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:58:01.065838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:58:01.065838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:58:01.066744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:58:01.066744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:58:01.066744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:58:01.066744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:58:01.066744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:58:01.066744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:58:01.066744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:58:01.066744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:58:01.066744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 545/1100] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:58:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:58:01.068961 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24db69-4d1f-4ae5-9c3c-a91deb7a1e94 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:01.071875 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3887cf0-3e12-452f-9eac-45123ec34457 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:01.166093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24db69-4d1f-4ae5-9c3c-a91deb7a1e94 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:01.167744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3887cf0-3e12-452f-9eac-45123ec34457 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:01.182433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:01.202119 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056159df-ccb7-49ea-9ed5-b1589481dab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:01.203232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056159df-ccb7-49ea-9ed5-b1589481dab1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:01.203232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056159df-ccb7-49ea-9ed5-b1589481dab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:01.203503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056159df-ccb7-49ea-9ed5-b1589481dab1 None admin] PATH_INFO: `/v3/users/2a14858043524998a76833bc6d11d43a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:01.204699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056159df-ccb7-49ea-9ed5-b1589481dab1 None admin] RBAC: Authorizing `identity:get_user(user_id=2a14858043524998a76833bc6d11d43a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:01.206179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056159df-ccb7-49ea-9ed5-b1589481dab1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:01.207543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbaa4af-7729-4723-820f-081d3c0215a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:01.207810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 556/1101] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:58:01 2022] GET /identity/v3/users/2a14858043524998a76833bc6d11d43a => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:01.208198 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbaa4af-7729-4723-820f-081d3c0215a5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:01.208490 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbaa4af-7729-4723-820f-081d3c0215a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:01.208767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbaa4af-7729-4723-820f-081d3c0215a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:01.209589 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbaa4af-7729-4723-820f-081d3c0215a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:01.209959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbaa4af-7729-4723-820f-081d3c0215a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:01.211383 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbaa4af-7729-4723-820f-081d3c0215a5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:01.213326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056159df-ccb7-49ea-9ed5-b1589481dab1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:01.223050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 546/1102] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:58:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:58:01.229118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbaa4af-7729-4723-820f-081d3c0215a5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:01.248649 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:01.311264 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056159df-ccb7-49ea-9ed5-b1589481dab1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:01.330613 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbaa4af-7729-4723-820f-081d3c0215a5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:01.343568 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2199289-e44b-40f3-b356-15a5c7ee8d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:01.344202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2199289-e44b-40f3-b356-15a5c7ee8d85 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:01.344478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2199289-e44b-40f3-b356-15a5c7ee8d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:01.344751 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2199289-e44b-40f3-b356-15a5c7ee8d85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:01.363889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6fe04-2ddb-43f8-bf8b-8cd52a4124d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:01.364530 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6fe04-2ddb-43f8-bf8b-8cd52a4124d7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:01.364810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6fe04-2ddb-43f8-bf8b-8cd52a4124d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:01.365083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6fe04-2ddb-43f8-bf8b-8cd52a4124d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:01.366548 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6fe04-2ddb-43f8-bf8b-8cd52a4124d7 None admin] RBAC: Adding query filter params (role.id=f56089ab411e48aaa42f4c510bb4b1cb, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=ed08c367a3d34207a51914ff77a93898) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:01.366878 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6fe04-2ddb-43f8-bf8b-8cd52a4124d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:01.368302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6fe04-2ddb-43f8-bf8b-8cd52a4124d7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:01.374132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 547/1103] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:58:01 2022] GET /identity/v3/role_assignments?user.id=ed08c367a3d34207a51914ff77a93898&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=f56089ab411e48aaa42f4c510bb4b1cb => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:58:01.418006 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2199289-e44b-40f3-b356-15a5c7ee8d85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:01.419476 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2199289-e44b-40f3-b356-15a5c7ee8d85 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:01.455207 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:01.522036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 557/1104] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:58:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:58:01.527851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6fe04-2ddb-43f8-bf8b-8cd52a4124d7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:01.570428 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:01.631586 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6fe04-2ddb-43f8-bf8b-8cd52a4124d7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:01.666353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cea3cb-0bc8-4767-a05d-5b0d41fb354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:01.667221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cea3cb-0bc8-4767-a05d-5b0d41fb354d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:01.667501 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cea3cb-0bc8-4767-a05d-5b0d41fb354d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:01.667771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cea3cb-0bc8-4767-a05d-5b0d41fb354d None admin] PATH_INFO: `/v3/projects/12280dfbb64749659c9d10108b16128e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:01.668992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cea3cb-0bc8-4767-a05d-5b0d41fb354d None admin] RBAC: Authorizing `identity:get_project(project_id=12280dfbb64749659c9d10108b16128e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:01.670462 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cea3cb-0bc8-4767-a05d-5b0d41fb354d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:01.672166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 548/1105] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:58:01 2022] GET /identity/v3/projects/12280dfbb64749659c9d10108b16128e => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:01.678185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2199289-e44b-40f3-b356-15a5c7ee8d85 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:01.779438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2199289-e44b-40f3-b356-15a5c7ee8d85 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:01.813107 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383034ef-4a05-43b5-af2f-eee54443a773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:01.813790 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383034ef-4a05-43b5-af2f-eee54443a773 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:01.814070 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383034ef-4a05-43b5-af2f-eee54443a773 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:01.814343 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383034ef-4a05-43b5-af2f-eee54443a773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:01.815174 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383034ef-4a05-43b5-af2f-eee54443a773 None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=12280dfbb64749659c9d10108b16128e, user.id=2a14858043524998a76833bc6d11d43a) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:01.815484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383034ef-4a05-43b5-af2f-eee54443a773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:01.816911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383034ef-4a05-43b5-af2f-eee54443a773 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:01.820384 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:01.824206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 558/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:58:01 2022] GET /identity/v3/role_assignments?user.id=2a14858043524998a76833bc6d11d43a&scope.project.id=12280dfbb64749659c9d10108b16128e&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:03.854608 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d6685-ee94-47b4-8e3a-4406dec38193 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:03.855157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d6685-ee94-47b4-8e3a-4406dec38193 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:03.855157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d6685-ee94-47b4-8e3a-4406dec38193 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:03.856516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 549/1107] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:58:03.861688 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e0b3-c8b3-483a-adbb-6b24ed74ce8a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:03.862049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e0b3-c8b3-483a-adbb-6b24ed74ce8a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:03.862247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e0b3-c8b3-483a-adbb-6b24ed74ce8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:03.878540 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6e15e0b3-c8b3-483a-adbb-6b24ed74ce8a None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:58:03.879696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6e15e0b3-c8b3-483a-adbb-6b24ed74ce8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:58:03.942276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 559/1108] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:58:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:58:03.966987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d6685-ee94-47b4-8e3a-4406dec38193 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:04.064692 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d6685-ee94-47b4-8e3a-4406dec38193 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:04.071305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:04.097714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921b6c6-07d5-4e22-9026-b4088223da40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:04.098483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921b6c6-07d5-4e22-9026-b4088223da40 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:04.098765 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921b6c6-07d5-4e22-9026-b4088223da40 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:04.099039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921b6c6-07d5-4e22-9026-b4088223da40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:04.100212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921b6c6-07d5-4e22-9026-b4088223da40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:04.102173 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921b6c6-07d5-4e22-9026-b4088223da40 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:04.103748 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 550/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:58:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:04.109251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15e0b3-c8b3-483a-adbb-6b24ed74ce8a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:04.202967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15e0b3-c8b3-483a-adbb-6b24ed74ce8a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:04.230249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:04.236278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39797026-1071-4c53-9359-e1c172d41b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:04.236936 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39797026-1071-4c53-9359-e1c172d41b28 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:04.237216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39797026-1071-4c53-9359-e1c172d41b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:04.237529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39797026-1071-4c53-9359-e1c172d41b28 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:04.238235 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39797026-1071-4c53-9359-e1c172d41b28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:04.239675 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39797026-1071-4c53-9359-e1c172d41b28 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:04.259318 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 560/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:58:04 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:58:06.273044 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240f45f-0238-4cd1-8998-8ee8a8f8d457 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:06.273544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240f45f-0238-4cd1-8998-8ee8a8f8d457 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:06.273651 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240f45f-0238-4cd1-8998-8ee8a8f8d457 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:06.274968 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 551/1111] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:58:06.279947 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a126d09-4021-4347-af51-7fef633a346b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:06.280311 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a126d09-4021-4347-af51-7fef633a346b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:06.280493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a126d09-4021-4347-af51-7fef633a346b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:06.296688 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6a126d09-4021-4347-af51-7fef633a346b None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:58:06.297880 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6a126d09-4021-4347-af51-7fef633a346b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:58:06.362726 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 561/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:58:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:58:06.387035 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240f45f-0238-4cd1-8998-8ee8a8f8d457 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:06.484860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240f45f-0238-4cd1-8998-8ee8a8f8d457 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:06.517707 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa000f9-22dd-4e08-b5f7-20fd5648b7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:06.518539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa000f9-22dd-4e08-b5f7-20fd5648b7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:06.518825 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa000f9-22dd-4e08-b5f7-20fd5648b7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:06.519100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa000f9-22dd-4e08-b5f7-20fd5648b7a7 None admin] PATH_INFO: `/v3/roles/d6dae1fcff6641fcb71c0203d9c4e161` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:06.520564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa000f9-22dd-4e08-b5f7-20fd5648b7a7 None admin] RBAC: Authorizing `identity:get_role(role_id=d6dae1fcff6641fcb71c0203d9c4e161)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:06.521958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa000f9-22dd-4e08-b5f7-20fd5648b7a7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:06.523341 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 552/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:58:06 2022] GET /identity/v3/roles/d6dae1fcff6641fcb71c0203d9c4e161 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:06.528835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a126d09-4021-4347-af51-7fef633a346b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:06.623782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a126d09-4021-4347-af51-7fef633a346b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:06.640270 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:06.657691 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e0ece-8282-4821-b12e-db401ac29b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:06.658543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e0ece-8282-4821-b12e-db401ac29b3b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:06.658821 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e0ece-8282-4821-b12e-db401ac29b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:06.659094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e0ece-8282-4821-b12e-db401ac29b3b None admin] PATH_INFO: `/v3/users/4bc9a0bb40da43d799005ac4cc3be018` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:06.675344 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e0ece-8282-4821-b12e-db401ac29b3b None admin] RBAC: Authorizing `identity:get_user(user_id=4bc9a0bb40da43d799005ac4cc3be018)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:06.676773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e0ece-8282-4821-b12e-db401ac29b3b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:06.679102 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 562/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:58:06 2022] GET /identity/v3/users/4bc9a0bb40da43d799005ac4cc3be018 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:06.684794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa000f9-22dd-4e08-b5f7-20fd5648b7a7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:06.726862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:06.780129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa000f9-22dd-4e08-b5f7-20fd5648b7a7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:06.812884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2711f-ac99-453a-ab3a-ef33e3b3c8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:06.813542 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2711f-ac99-453a-ab3a-ef33e3b3c8dd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:06.813823 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2711f-ac99-453a-ab3a-ef33e3b3c8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:06.814096 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2711f-ac99-453a-ab3a-ef33e3b3c8dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:06.877511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2711f-ac99-453a-ab3a-ef33e3b3c8dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:06.878930 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2711f-ac99-453a-ab3a-ef33e3b3c8dd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:06.918630 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:06.974293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 553/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:58:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:58:06.980711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e0ece-8282-4821-b12e-db401ac29b3b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:07.077615 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e0ece-8282-4821-b12e-db401ac29b3b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:07.110531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc82531-6e17-490d-9bdb-84e5d67d301b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:07.111369 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc82531-6e17-490d-9bdb-84e5d67d301b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:07.111649 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc82531-6e17-490d-9bdb-84e5d67d301b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:07.111917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc82531-6e17-490d-9bdb-84e5d67d301b None admin] PATH_INFO: `/v3/projects/12280dfbb64749659c9d10108b16128e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:07.113076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc82531-6e17-490d-9bdb-84e5d67d301b None admin] RBAC: Authorizing `identity:get_project(project_id=12280dfbb64749659c9d10108b16128e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:07.114516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc82531-6e17-490d-9bdb-84e5d67d301b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:07.116205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 563/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:58:06 2022] GET /identity/v3/projects/12280dfbb64749659c9d10108b16128e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:07.122324 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2711f-ac99-453a-ab3a-ef33e3b3c8dd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:07.219612 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2711f-ac99-453a-ab3a-ef33e3b3c8dd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:07.251561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd8567-6fe0-4995-8a84-dfbbb6be5be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:07.252198 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd8567-6fe0-4995-8a84-dfbbb6be5be9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:07.252479 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd8567-6fe0-4995-8a84-dfbbb6be5be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:07.252753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd8567-6fe0-4995-8a84-dfbbb6be5be9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:07.253601 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd8567-6fe0-4995-8a84-dfbbb6be5be9 None admin] RBAC: Adding query filter params (role.id=d6dae1fcff6641fcb71c0203d9c4e161, scope.project.id=12280dfbb64749659c9d10108b16128e, user.id=4bc9a0bb40da43d799005ac4cc3be018) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:07.253909 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd8567-6fe0-4995-8a84-dfbbb6be5be9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:07.255431 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd8567-6fe0-4995-8a84-dfbbb6be5be9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:07.261441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 554/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:58:07 2022] GET /identity/v3/role_assignments?user.id=4bc9a0bb40da43d799005ac4cc3be018&scope.project.id=12280dfbb64749659c9d10108b16128e&role.id=d6dae1fcff6641fcb71c0203d9c4e161 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:09.250972 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd9e2-bb96-47cd-9589-0576935efcb4 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:09.251480 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd9e2-bb96-47cd-9589-0576935efcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:09.251577 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd9e2-bb96-47cd-9589-0576935efcb4 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:09.252893 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 564/1118] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:58:09.258343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c384e11-8aed-4654-8e02-8abbd23eb90b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:09.258796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c384e11-8aed-4654-8e02-8abbd23eb90b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:09.258906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c384e11-8aed-4654-8e02-8abbd23eb90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:09.269954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:09.276833 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3c384e11-8aed-4654-8e02-8abbd23eb90b None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:58:09.278030 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3c384e11-8aed-4654-8e02-8abbd23eb90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:58:09.341957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 555/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:58:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:58:09.364743 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cd9e2-bb96-47cd-9589-0576935efcb4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:09.407107 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:09.462017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cd9e2-bb96-47cd-9589-0576935efcb4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:09.495922 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878262a1-df5f-4de8-9b54-f91a807fdd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:09.496746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878262a1-df5f-4de8-9b54-f91a807fdd49 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:09.497025 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878262a1-df5f-4de8-9b54-f91a807fdd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:09.497294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878262a1-df5f-4de8-9b54-f91a807fdd49 None admin] PATH_INFO: `/v3/roles/d6dae1fcff6641fcb71c0203d9c4e161` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:09.498761 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878262a1-df5f-4de8-9b54-f91a807fdd49 None admin] RBAC: Authorizing `identity:get_role(role_id=d6dae1fcff6641fcb71c0203d9c4e161)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:09.500111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878262a1-df5f-4de8-9b54-f91a807fdd49 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:09.501483 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 565/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:58:09 2022] GET /identity/v3/roles/d6dae1fcff6641fcb71c0203d9c4e161 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:09.508079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c384e11-8aed-4654-8e02-8abbd23eb90b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:09.602516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c384e11-8aed-4654-8e02-8abbd23eb90b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:09.635518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e8a98-8bf4-46e0-a72e-941d628f7dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:09.636620 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e8a98-8bf4-46e0-a72e-941d628f7dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:09.636896 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e8a98-8bf4-46e0-a72e-941d628f7dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:09.637166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e8a98-8bf4-46e0-a72e-941d628f7dd4 None admin] PATH_INFO: `/v3/users/4bc9a0bb40da43d799005ac4cc3be018` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:09.638346 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e8a98-8bf4-46e0-a72e-941d628f7dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=4bc9a0bb40da43d799005ac4cc3be018)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:09.639762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e8a98-8bf4-46e0-a72e-941d628f7dd4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:09.641336 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 556/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:58:09 2022] GET /identity/v3/users/4bc9a0bb40da43d799005ac4cc3be018 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:09.647664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878262a1-df5f-4de8-9b54-f91a807fdd49 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:09.740844 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878262a1-df5f-4de8-9b54-f91a807fdd49 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:09.750797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:09.774563 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba7903-28ec-41ce-99a5-accf87cc2d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:09.775391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba7903-28ec-41ce-99a5-accf87cc2d38 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:09.775669 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba7903-28ec-41ce-99a5-accf87cc2d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:09.775943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba7903-28ec-41ce-99a5-accf87cc2d38 None admin] PATH_INFO: `/v3/projects/12280dfbb64749659c9d10108b16128e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:09.777084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba7903-28ec-41ce-99a5-accf87cc2d38 None admin] RBAC: Authorizing `identity:get_project(project_id=12280dfbb64749659c9d10108b16128e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:09.778517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba7903-28ec-41ce-99a5-accf87cc2d38 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:09.780250 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 566/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:58:09 2022] GET /identity/v3/projects/12280dfbb64749659c9d10108b16128e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:09.786011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e8a98-8bf4-46e0-a72e-941d628f7dd4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:09.789682 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:09.881154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e8a98-8bf4-46e0-a72e-941d628f7dd4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:09.913566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbeee6e-1123-4b6a-8286-7fc9debd7851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:09.914426 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbeee6e-1123-4b6a-8286-7fc9debd7851 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:09.914704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbeee6e-1123-4b6a-8286-7fc9debd7851 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:09.914974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbeee6e-1123-4b6a-8286-7fc9debd7851 None admin] PATH_INFO: `/v3/projects/12280dfbb64749659c9d10108b16128e/users/4bc9a0bb40da43d799005ac4cc3be018/roles/d6dae1fcff6641fcb71c0203d9c4e161` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:09.917120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbeee6e-1123-4b6a-8286-7fc9debd7851 None admin] RBAC: Authorizing `identity:create_grant(project_id=12280dfbb64749659c9d10108b16128e, user_id=4bc9a0bb40da43d799005ac4cc3be018, role_id=d6dae1fcff6641fcb71c0203d9c4e161)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:09.918569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbeee6e-1123-4b6a-8286-7fc9debd7851 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:09.930924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 557/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:58:09 2022] PUT /identity/v3/projects/12280dfbb64749659c9d10108b16128e/users/4bc9a0bb40da43d799005ac4cc3be018/roles/d6dae1fcff6641fcb71c0203d9c4e161 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:58:11.898080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9be95d-66a6-4e01-9d00-9f8e51ef869f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:11.898642 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9be95d-66a6-4e01-9d00-9f8e51ef869f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:11.898642 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9be95d-66a6-4e01-9d00-9f8e51ef869f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:11.899985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 567/1124] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:58:11.905254 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbf0ad-c8de-473d-819f-dc7bc338d197 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:11.905728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbf0ad-c8de-473d-819f-dc7bc338d197 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:11.905837 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbf0ad-c8de-473d-819f-dc7bc338d197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:11.922168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7dfbf0ad-c8de-473d-819f-dc7bc338d197 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:58:11.923333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7dfbf0ad-c8de-473d-819f-dc7bc338d197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:58:11.979897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:11.988849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 558/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:58:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:58:12.012519 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9be95d-66a6-4e01-9d00-9f8e51ef869f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:12.109321 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9be95d-66a6-4e01-9d00-9f8e51ef869f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:12.142676 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13eb40c-1faf-4b80-b68e-73c02dc9de44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:12.143508 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eb40c-1faf-4b80-b68e-73c02dc9de44 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:12.143792 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eb40c-1faf-4b80-b68e-73c02dc9de44 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:12.144074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eb40c-1faf-4b80-b68e-73c02dc9de44 None admin] PATH_INFO: `/v3/roles/d6dae1fcff6641fcb71c0203d9c4e161` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:12.145557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13eb40c-1faf-4b80-b68e-73c02dc9de44 None admin] RBAC: Authorizing `identity:get_role(role_id=d6dae1fcff6641fcb71c0203d9c4e161)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:12.146916 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13eb40c-1faf-4b80-b68e-73c02dc9de44 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:12.148317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 568/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:58:12 2022] GET /identity/v3/roles/d6dae1fcff6641fcb71c0203d9c4e161 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:12.153756 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbf0ad-c8de-473d-819f-dc7bc338d197 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:12.249039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbf0ad-c8de-473d-819f-dc7bc338d197 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:12.281916 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dd4e1-86e5-4a27-9230-69225b83b5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:12.282769 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dd4e1-86e5-4a27-9230-69225b83b5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:12.283051 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dd4e1-86e5-4a27-9230-69225b83b5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:12.283331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dd4e1-86e5-4a27-9230-69225b83b5e8 None admin] PATH_INFO: `/v3/users/4bc9a0bb40da43d799005ac4cc3be018` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:12.284490 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dd4e1-86e5-4a27-9230-69225b83b5e8 None admin] RBAC: Authorizing `identity:get_user(user_id=4bc9a0bb40da43d799005ac4cc3be018)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:12.285949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dd4e1-86e5-4a27-9230-69225b83b5e8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:12.287552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 559/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:58:12 2022] GET /identity/v3/users/4bc9a0bb40da43d799005ac4cc3be018 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:12.293131 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13eb40c-1faf-4b80-b68e-73c02dc9de44 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:12.338544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:12.389590 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13eb40c-1faf-4b80-b68e-73c02dc9de44 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:12.421754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0175ddd-1600-4032-bcdd-0e2790da67e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:12.422332 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0175ddd-1600-4032-bcdd-0e2790da67e3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:12.422611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0175ddd-1600-4032-bcdd-0e2790da67e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:12.422885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0175ddd-1600-4032-bcdd-0e2790da67e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:12.486756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0175ddd-1600-4032-bcdd-0e2790da67e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:12.488176 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0175ddd-1600-4032-bcdd-0e2790da67e3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:12.530395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:12.581432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 569/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:58:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:58:12.587237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dd4e1-86e5-4a27-9230-69225b83b5e8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:12.647363 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:12.685050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dd4e1-86e5-4a27-9230-69225b83b5e8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:12.716696 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb65853-c76f-4c13-be15-2f043f91f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:12.717550 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb65853-c76f-4c13-be15-2f043f91f8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:12.717833 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb65853-c76f-4c13-be15-2f043f91f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:12.718108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb65853-c76f-4c13-be15-2f043f91f8c6 None admin] PATH_INFO: `/v3/projects/12280dfbb64749659c9d10108b16128e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:12.719263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb65853-c76f-4c13-be15-2f043f91f8c6 None admin] RBAC: Authorizing `identity:get_project(project_id=12280dfbb64749659c9d10108b16128e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:12.720684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb65853-c76f-4c13-be15-2f043f91f8c6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:12.722360 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 560/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:58:12 2022] GET /identity/v3/projects/12280dfbb64749659c9d10108b16128e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:12.728668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0175ddd-1600-4032-bcdd-0e2790da67e3 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:12.821884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0175ddd-1600-4032-bcdd-0e2790da67e3 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:12.854408 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4341e0-411e-40e2-b162-6c1aaee6128c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:12.855038 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4341e0-411e-40e2-b162-6c1aaee6128c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:12.855318 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4341e0-411e-40e2-b162-6c1aaee6128c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:12.855591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4341e0-411e-40e2-b162-6c1aaee6128c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:12.856402 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4341e0-411e-40e2-b162-6c1aaee6128c None admin] RBAC: Adding query filter params (role.id=d6dae1fcff6641fcb71c0203d9c4e161, scope.project.id=12280dfbb64749659c9d10108b16128e, user.id=4bc9a0bb40da43d799005ac4cc3be018) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:12.856710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4341e0-411e-40e2-b162-6c1aaee6128c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:12.858137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4341e0-411e-40e2-b162-6c1aaee6128c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:12.863681 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 570/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:58:12 2022] GET /identity/v3/role_assignments?user.id=4bc9a0bb40da43d799005ac4cc3be018&scope.project.id=12280dfbb64749659c9d10108b16128e&role.id=d6dae1fcff6641fcb71c0203d9c4e161 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:14.883419 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2044b6-aa2f-484a-906e-ddb086c76ad3 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:14.883961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2044b6-aa2f-484a-906e-ddb086c76ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:14.883961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2044b6-aa2f-484a-906e-ddb086c76ad3 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:14.885396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 561/1131] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:58:14.891223 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935f1a6-0318-4128-bdc7-38b109e83ef7 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:14.891651 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935f1a6-0318-4128-bdc7-38b109e83ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:14.891776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935f1a6-0318-4128-bdc7-38b109e83ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:14.908248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9935f1a6-0318-4128-bdc7-38b109e83ef7 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:58:14.909447 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9935f1a6-0318-4128-bdc7-38b109e83ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:58:14.912108 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:14.973572 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 571/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:58:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:58:14.997737 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2044b6-aa2f-484a-906e-ddb086c76ad3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:15.097627 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2044b6-aa2f-484a-906e-ddb086c76ad3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:15.125302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:15.131986 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd5c6c-56f7-4e84-b18b-29d096c7787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:15.132762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd5c6c-56f7-4e84-b18b-29d096c7787b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:15.133040 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd5c6c-56f7-4e84-b18b-29d096c7787b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:15.133314 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd5c6c-56f7-4e84-b18b-29d096c7787b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:15.134545 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd5c6c-56f7-4e84-b18b-29d096c7787b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:15.136001 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd5c6c-56f7-4e84-b18b-29d096c7787b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:15.138203 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 562/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:58:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:15.144174 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935f1a6-0318-4128-bdc7-38b109e83ef7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:15.238503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935f1a6-0318-4128-bdc7-38b109e83ef7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:15.271632 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9446a-75e1-4773-8c84-8eee57b264c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:15.272303 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9446a-75e1-4773-8c84-8eee57b264c7 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:15.272581 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9446a-75e1-4773-8c84-8eee57b264c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:15.272854 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9446a-75e1-4773-8c84-8eee57b264c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:15.273741 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9446a-75e1-4773-8c84-8eee57b264c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:15.275166 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9446a-75e1-4773-8c84-8eee57b264c7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:15.284479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:15.298877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 572/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jun 27 10:58:15 2022] POST /identity/v3/projects => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:58:17.307625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe17e0a-0cd2-4fe1-a3d3-c01a0fc696cc None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:17.308124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe17e0a-0cd2-4fe1-a3d3-c01a0fc696cc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:17.308220 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe17e0a-0cd2-4fe1-a3d3-c01a0fc696cc None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:17.309581 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 563/1135] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:58:17.314754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63482035-baf1-40a0-8ef9-c6035db225b1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:17.315124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63482035-baf1-40a0-8ef9-c6035db225b1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:17.315311 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63482035-baf1-40a0-8ef9-c6035db225b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:17.331601 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-63482035-baf1-40a0-8ef9-c6035db225b1 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:58:17.332765 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-63482035-baf1-40a0-8ef9-c6035db225b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:58:17.396667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 573/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:58:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:58:17.422009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe17e0a-0cd2-4fe1-a3d3-c01a0fc696cc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:17.519408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe17e0a-0cd2-4fe1-a3d3-c01a0fc696cc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:17.552290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761295f9-d228-4458-a0a8-99cdca99ed38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:17.553076 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761295f9-d228-4458-a0a8-99cdca99ed38 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:17.553385 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761295f9-d228-4458-a0a8-99cdca99ed38 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:17.553664 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761295f9-d228-4458-a0a8-99cdca99ed38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:17.554815 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761295f9-d228-4458-a0a8-99cdca99ed38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:17.556239 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761295f9-d228-4458-a0a8-99cdca99ed38 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:17.557843 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 564/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:58:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:17.563195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63482035-baf1-40a0-8ef9-c6035db225b1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:17.656859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63482035-baf1-40a0-8ef9-c6035db225b1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:17.679245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:17.692556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2598d-b846-46ef-943d-dab8603b974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:17.693207 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2598d-b846-46ef-943d-dab8603b974b None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:17.693518 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2598d-b846-46ef-943d-dab8603b974b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:17.694302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2598d-b846-46ef-943d-dab8603b974b None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:17.694994 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2598d-b846-46ef-943d-dab8603b974b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:17.696416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2598d-b846-46ef-943d-dab8603b974b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:17.715717 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 574/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:58:17 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:58:19.736824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0f49d-55ba-4714-ac72-47235322ce31 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:19.737348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0f49d-55ba-4714-ac72-47235322ce31 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:19.737348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0f49d-55ba-4714-ac72-47235322ce31 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:19.738763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 565/1139] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:58:19.744376 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85863b-c7a8-4344-a53b-4d203dcdc7b6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:19.744761 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85863b-c7a8-4344-a53b-4d203dcdc7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:19.744918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85863b-c7a8-4344-a53b-4d203dcdc7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:19.761962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-db85863b-c7a8-4344-a53b-4d203dcdc7b6 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:58:19.763117 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-db85863b-c7a8-4344-a53b-4d203dcdc7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:58:19.826402 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 575/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:58:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:58:19.849370 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0f49d-55ba-4714-ac72-47235322ce31 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:19.914353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:19.948435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0f49d-55ba-4714-ac72-47235322ce31 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:19.980768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c4f64-b0b4-48bb-b7aa-9c49a8ea30a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:19.981564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c4f64-b0b4-48bb-b7aa-9c49a8ea30a8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:19.981849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c4f64-b0b4-48bb-b7aa-9c49a8ea30a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:19.982124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c4f64-b0b4-48bb-b7aa-9c49a8ea30a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:19.992470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c4f64-b0b4-48bb-b7aa-9c49a8ea30a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:58:19.999977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6c7c4f64-b0b4-48bb-b7aa-9c49a8ea30a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:58:19.999977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:58:19.999977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:58:19.999977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:58:19.999977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:58:19.999977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:58:19.999977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:58:19.999977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:58:19.999977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:58:19.999977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:58:19.999977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:58:19.999977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:58:19.999977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:58:19.999977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:58:19.999977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:58:19.999977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:58:20.001128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:58:20.001128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:58:20.001128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:58:20.001128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:58:20.001128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:58:20.001128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:58:20.001128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:58:20.001128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:58:20.001128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:58:20.001128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:58:20.001128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:58:20.001128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:58:20.001128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:58:20.001128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:58:20.001128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:58:20.001128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:58:20.002275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:58:20.002275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:58:20.002275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:58:20.002275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:58:20.002275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:58:20.002275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:58:20.002275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:58:20.002275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:58:20.002275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:58:20.002275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:58:20.002275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:58:20.002275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:58:20.002275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 566/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:58:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:58:20.007021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85863b-c7a8-4344-a53b-4d203dcdc7b6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:20.099631 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85863b-c7a8-4344-a53b-4d203dcdc7b6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:20.108730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:20.133454 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99f6c5-2a56-4a38-b6d0-16c1c3a7037b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:20.134098 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99f6c5-2a56-4a38-b6d0-16c1c3a7037b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:20.134379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99f6c5-2a56-4a38-b6d0-16c1c3a7037b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:20.134648 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99f6c5-2a56-4a38-b6d0-16c1c3a7037b None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:20.135375 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99f6c5-2a56-4a38-b6d0-16c1c3a7037b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:20.135673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99f6c5-2a56-4a38-b6d0-16c1c3a7037b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:20.137273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99f6c5-2a56-4a38-b6d0-16c1c3a7037b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:20.144885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 576/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:58:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:20.150440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c4f64-b0b4-48bb-b7aa-9c49a8ea30a8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:20.247036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c4f64-b0b4-48bb-b7aa-9c49a8ea30a8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:20.270649 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:20.279861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e397a7-e7de-40f2-b2ea-fe7353195c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:20.280713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e397a7-e7de-40f2-b2ea-fe7353195c52 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:20.280992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e397a7-e7de-40f2-b2ea-fe7353195c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:20.281264 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e397a7-e7de-40f2-b2ea-fe7353195c52 None admin] PATH_INFO: `/v3/users/d42f78268be54601a25818ea11dac9e4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:20.294505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e397a7-e7de-40f2-b2ea-fe7353195c52 None admin] RBAC: Authorizing `identity:get_user(user_id=d42f78268be54601a25818ea11dac9e4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:20.295940 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e397a7-e7de-40f2-b2ea-fe7353195c52 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:20.297588 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 567/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:58:20 2022] GET /identity/v3/users/d42f78268be54601a25818ea11dac9e4 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:20.303916 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99f6c5-2a56-4a38-b6d0-16c1c3a7037b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:20.399604 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99f6c5-2a56-4a38-b6d0-16c1c3a7037b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:20.431694 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a6fcc-3dbc-477e-9af1-fca393c84bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:20.432320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a6fcc-3dbc-477e-9af1-fca393c84bed None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:20.432598 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a6fcc-3dbc-477e-9af1-fca393c84bed None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:20.432871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a6fcc-3dbc-477e-9af1-fca393c84bed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:20.469423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:20.496780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a6fcc-3dbc-477e-9af1-fca393c84bed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:20.498276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a6fcc-3dbc-477e-9af1-fca393c84bed None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:20.589934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 577/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:58:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:58:20.595669 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e397a7-e7de-40f2-b2ea-fe7353195c52 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:20.691518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e397a7-e7de-40f2-b2ea-fe7353195c52 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:20.725113 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80a79c-ed91-40eb-829d-1705542a391d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:20.725974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80a79c-ed91-40eb-829d-1705542a391d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:20.726257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80a79c-ed91-40eb-829d-1705542a391d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:20.726531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80a79c-ed91-40eb-829d-1705542a391d None admin] PATH_INFO: `/v3/projects/eb2bf5d0e283452b8677812e109b533d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:20.727685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80a79c-ed91-40eb-829d-1705542a391d None admin] RBAC: Authorizing `identity:get_project(project_id=eb2bf5d0e283452b8677812e109b533d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:20.729104 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80a79c-ed91-40eb-829d-1705542a391d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:20.730773 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 568/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:58:20 2022] GET /identity/v3/projects/eb2bf5d0e283452b8677812e109b533d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:20.736529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a6fcc-3dbc-477e-9af1-fca393c84bed None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:20.802114 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:20.832143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a6fcc-3dbc-477e-9af1-fca393c84bed None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:20.864400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad1a45-4c05-46c9-9250-962562826b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:20.865027 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad1a45-4c05-46c9-9250-962562826b3d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:20.865307 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad1a45-4c05-46c9-9250-962562826b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:20.865635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad1a45-4c05-46c9-9250-962562826b3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:20.866451 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad1a45-4c05-46c9-9250-962562826b3d None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=eb2bf5d0e283452b8677812e109b533d, user.id=d42f78268be54601a25818ea11dac9e4) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:20.866757 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad1a45-4c05-46c9-9250-962562826b3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:20.868165 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad1a45-4c05-46c9-9250-962562826b3d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:20.873350 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 578/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:58:20 2022] GET /identity/v3/role_assignments?user.id=d42f78268be54601a25818ea11dac9e4&scope.project.id=eb2bf5d0e283452b8677812e109b533d&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:22.859788 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963b207-47b1-4f97-9e45-e20cfe3ae777 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:22.860368 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963b207-47b1-4f97-9e45-e20cfe3ae777 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:22.860368 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963b207-47b1-4f97-9e45-e20cfe3ae777 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:22.861848 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 569/1147] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:58:22.867328 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51543c4-fc17-4eda-9288-939b7e632866 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:22.867705 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51543c4-fc17-4eda-9288-939b7e632866 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:22.867871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51543c4-fc17-4eda-9288-939b7e632866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:22.885264 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a51543c4-fc17-4eda-9288-939b7e632866 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:58:22.886703 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a51543c4-fc17-4eda-9288-939b7e632866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:58:22.949345 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 579/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:58:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:58:22.971434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963b207-47b1-4f97-9e45-e20cfe3ae777 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:23.023908 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:23.074486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963b207-47b1-4f97-9e45-e20cfe3ae777 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:23.107391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3c164-9c54-40cf-9dab-9c40b3dcb5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:23.108164 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3c164-9c54-40cf-9dab-9c40b3dcb5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:23.108445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3c164-9c54-40cf-9dab-9c40b3dcb5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:23.108718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3c164-9c54-40cf-9dab-9c40b3dcb5c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:23.119330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3c164-9c54-40cf-9dab-9c40b3dcb5c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:58:23.126844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-2fa3c164-9c54-40cf-9dab-9c40b3dcb5c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:58:23.126844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:58:23.126844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:58:23.126844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:58:23.126844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:58:23.126844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:58:23.126844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:58:23.126844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:58:23.126844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:58:23.126844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:58:23.126844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:58:23.126844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:58:23.126844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:58:23.126844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:58:23.126844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:58:23.126844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:58:23.127912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:58:23.127912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:58:23.127912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:58:23.127912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:58:23.127912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:58:23.127912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:58:23.127912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:58:23.127912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:58:23.127912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:58:23.127912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:58:23.127912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:58:23.127912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:58:23.127912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:58:23.127912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:58:23.127912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:58:23.127912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:58:23.129091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:58:23.129091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:58:23.129091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:58:23.129091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:58:23.129091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:58:23.129091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:58:23.129091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:58:23.129091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:58:23.129091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:58:23.129091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:58:23.129091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:58:23.129091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:58:23.129091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 570/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:58:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:58:23.134167 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51543c4-fc17-4eda-9288-939b7e632866 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:23.192354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:23.227761 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51543c4-fc17-4eda-9288-939b7e632866 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:23.259535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4f407-2dd8-49ec-bda7-5ab201c47258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:23.260179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4f407-2dd8-49ec-bda7-5ab201c47258 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:23.260453 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4f407-2dd8-49ec-bda7-5ab201c47258 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:23.260720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4f407-2dd8-49ec-bda7-5ab201c47258 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:23.261744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4f407-2dd8-49ec-bda7-5ab201c47258 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:23.262042 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4f407-2dd8-49ec-bda7-5ab201c47258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:23.263387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4f407-2dd8-49ec-bda7-5ab201c47258 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:23.271000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 580/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:58:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:23.276647 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3c164-9c54-40cf-9dab-9c40b3dcb5c0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:23.374770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3c164-9c54-40cf-9dab-9c40b3dcb5c0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:23.388691 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:23.409434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff2ea8-59b1-4c1c-96e7-9a6d17b222b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:23.410290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff2ea8-59b1-4c1c-96e7-9a6d17b222b7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:23.410573 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff2ea8-59b1-4c1c-96e7-9a6d17b222b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:23.410849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff2ea8-59b1-4c1c-96e7-9a6d17b222b7 None admin] PATH_INFO: `/v3/users/d42f78268be54601a25818ea11dac9e4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:23.412016 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff2ea8-59b1-4c1c-96e7-9a6d17b222b7 None admin] RBAC: Authorizing `identity:get_user(user_id=d42f78268be54601a25818ea11dac9e4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:23.414050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff2ea8-59b1-4c1c-96e7-9a6d17b222b7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:23.415666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 571/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:58:23 2022] GET /identity/v3/users/d42f78268be54601a25818ea11dac9e4 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:23.421557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4f407-2dd8-49ec-bda7-5ab201c47258 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:23.516560 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4f407-2dd8-49ec-bda7-5ab201c47258 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:23.541142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:23.550093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da43653-43fe-44a5-9874-b34a3bb4abc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:23.550932 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da43653-43fe-44a5-9874-b34a3bb4abc0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:23.551210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da43653-43fe-44a5-9874-b34a3bb4abc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:23.551482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da43653-43fe-44a5-9874-b34a3bb4abc0 None admin] PATH_INFO: `/v3/projects/eb2bf5d0e283452b8677812e109b533d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:23.552624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da43653-43fe-44a5-9874-b34a3bb4abc0 None admin] RBAC: Authorizing `identity:get_project(project_id=eb2bf5d0e283452b8677812e109b533d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:23.554064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da43653-43fe-44a5-9874-b34a3bb4abc0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:23.555713 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 581/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:58:23 2022] GET /identity/v3/projects/eb2bf5d0e283452b8677812e109b533d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:23.561516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff2ea8-59b1-4c1c-96e7-9a6d17b222b7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:23.658097 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff2ea8-59b1-4c1c-96e7-9a6d17b222b7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:23.690522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9482329-25a7-4af8-a376-77c6fdacd2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:23.691392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9482329-25a7-4af8-a376-77c6fdacd2cd None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:23.691672 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9482329-25a7-4af8-a376-77c6fdacd2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:23.691947 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9482329-25a7-4af8-a376-77c6fdacd2cd None admin] PATH_INFO: `/v3/projects/eb2bf5d0e283452b8677812e109b533d/users/d42f78268be54601a25818ea11dac9e4/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:23.694414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9482329-25a7-4af8-a376-77c6fdacd2cd None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2bf5d0e283452b8677812e109b533d, user_id=d42f78268be54601a25818ea11dac9e4, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:23.695838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9482329-25a7-4af8-a376-77c6fdacd2cd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:23.708710 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 572/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:58:23 2022] PUT /identity/v3/projects/eb2bf5d0e283452b8677812e109b533d/users/d42f78268be54601a25818ea11dac9e4/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:58:25.688689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e43f2-ee60-4564-b253-c45d126dbb31 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:25.689204 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e43f2-ee60-4564-b253-c45d126dbb31 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:25.689294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e43f2-ee60-4564-b253-c45d126dbb31 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:25.690626 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 582/1154] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:58:25.695663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4866ab-eb32-4044-b1af-6e704454ce18 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:25.696092 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4866ab-eb32-4044-b1af-6e704454ce18 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:25.696217 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4866ab-eb32-4044-b1af-6e704454ce18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:25.713081 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ea4866ab-eb32-4044-b1af-6e704454ce18 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:58:25.714291 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ea4866ab-eb32-4044-b1af-6e704454ce18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:58:25.747285 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:25.780722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 573/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:58:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:58:25.804067 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e43f2-ee60-4564-b253-c45d126dbb31 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:25.900541 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e43f2-ee60-4564-b253-c45d126dbb31 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:25.932315 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477a114-1774-4074-8661-443bfbed485b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:25.933073 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477a114-1774-4074-8661-443bfbed485b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:25.933348 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477a114-1774-4074-8661-443bfbed485b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:25.933642 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477a114-1774-4074-8661-443bfbed485b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:25.944428 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477a114-1774-4074-8661-443bfbed485b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:58:25.951808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-2477a114-1774-4074-8661-443bfbed485b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:58:25.951808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:58:25.951808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:58:25.951808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:58:25.951808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:58:25.951808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:58:25.951808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:58:25.951808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:58:25.951808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:58:25.951808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:58:25.951808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:58:25.951808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:58:25.951808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:58:25.951808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:58:25.951808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:58:25.951808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:58:25.952884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:58:25.952884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:58:25.952884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:58:25.952884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:58:25.952884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:58:25.952884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:58:25.952884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:58:25.952884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:58:25.952884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:58:25.952884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:58:25.952884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:58:25.952884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:58:25.952884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:58:25.952884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:58:25.952884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:58:25.952884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:58:25.953957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:58:25.953957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:58:25.953957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:58:25.953957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:58:25.953957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:58:25.953957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:58:25.953957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:58:25.953957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:58:25.953957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:58:25.953957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:58:25.953957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:58:25.953957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:58:25.953957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 583/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:58:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:58:25.959679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4866ab-eb32-4044-b1af-6e704454ce18 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:26.054758 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4866ab-eb32-4044-b1af-6e704454ce18 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:26.087906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407384a-8743-49ec-94dd-8165166cd4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:26.088550 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407384a-8743-49ec-94dd-8165166cd4cd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:26.088830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407384a-8743-49ec-94dd-8165166cd4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:26.089099 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407384a-8743-49ec-94dd-8165166cd4cd None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:26.089868 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407384a-8743-49ec-94dd-8165166cd4cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:26.090170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407384a-8743-49ec-94dd-8165166cd4cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:26.091536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407384a-8743-49ec-94dd-8165166cd4cd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:26.099206 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 574/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:58:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:26.104785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477a114-1774-4074-8661-443bfbed485b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:26.158059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:26.200690 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477a114-1774-4074-8661-443bfbed485b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:26.233129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5707f4-2d2a-481d-a37d-9a40271b44eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:26.234001 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5707f4-2d2a-481d-a37d-9a40271b44eb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:26.234281 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5707f4-2d2a-481d-a37d-9a40271b44eb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:26.234553 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5707f4-2d2a-481d-a37d-9a40271b44eb None admin] PATH_INFO: `/v3/users/d42f78268be54601a25818ea11dac9e4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:26.235699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5707f4-2d2a-481d-a37d-9a40271b44eb None admin] RBAC: Authorizing `identity:get_user(user_id=d42f78268be54601a25818ea11dac9e4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:26.237112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5707f4-2d2a-481d-a37d-9a40271b44eb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:26.238734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 584/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:58:26 2022] GET /identity/v3/users/d42f78268be54601a25818ea11dac9e4 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:58:26.244365 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407384a-8743-49ec-94dd-8165166cd4cd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:26.275605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:26.341465 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407384a-8743-49ec-94dd-8165166cd4cd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:26.373063 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b15dd5-88e9-4453-b413-86d18634939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:26.373710 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15dd5-88e9-4453-b413-86d18634939d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:26.373990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15dd5-88e9-4453-b413-86d18634939d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:26.374258 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15dd5-88e9-4453-b413-86d18634939d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:26.437835 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b15dd5-88e9-4453-b413-86d18634939d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:26.439266 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b15dd5-88e9-4453-b413-86d18634939d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:26.467418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:26.532646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 575/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:58:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:58:26.538436 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5707f4-2d2a-481d-a37d-9a40271b44eb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:26.633318 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5707f4-2d2a-481d-a37d-9a40271b44eb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:26.655799 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:26.667632 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489bdfe-f7dc-40a4-bddf-b08fdab8c250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:26.668488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489bdfe-f7dc-40a4-bddf-b08fdab8c250 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:26.668767 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489bdfe-f7dc-40a4-bddf-b08fdab8c250 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:26.669038 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489bdfe-f7dc-40a4-bddf-b08fdab8c250 None admin] PATH_INFO: `/v3/projects/eb2bf5d0e283452b8677812e109b533d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:26.670227 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489bdfe-f7dc-40a4-bddf-b08fdab8c250 None admin] RBAC: Authorizing `identity:get_project(project_id=eb2bf5d0e283452b8677812e109b533d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:26.671623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489bdfe-f7dc-40a4-bddf-b08fdab8c250 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:26.673279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 585/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:58:26 2022] GET /identity/v3/projects/eb2bf5d0e283452b8677812e109b533d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:26.679855 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b15dd5-88e9-4453-b413-86d18634939d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:26.774477 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b15dd5-88e9-4453-b413-86d18634939d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:26.802433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:26.808233 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebf0be-1958-49d2-a7dc-ad09e45e4565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:26.808868 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebf0be-1958-49d2-a7dc-ad09e45e4565 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:26.809150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebf0be-1958-49d2-a7dc-ad09e45e4565 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:26.809447 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebf0be-1958-49d2-a7dc-ad09e45e4565 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:26.810278 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebf0be-1958-49d2-a7dc-ad09e45e4565 None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=eb2bf5d0e283452b8677812e109b533d, user.id=d42f78268be54601a25818ea11dac9e4) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:26.810586 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebf0be-1958-49d2-a7dc-ad09e45e4565 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:26.812002 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebf0be-1958-49d2-a7dc-ad09e45e4565 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:26.817707 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 576/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:58:26 2022] GET /identity/v3/role_assignments?user.id=d42f78268be54601a25818ea11dac9e4&scope.project.id=eb2bf5d0e283452b8677812e109b533d&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:28.823455 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2c92a-dc78-47c3-a1a8-01a534156889 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:28.823999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2c92a-dc78-47c3-a1a8-01a534156889 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:28.823999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2c92a-dc78-47c3-a1a8-01a534156889 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:28.825344 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 586/1162] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:58:28.830485 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ff6fb-eb4a-45a3-8ab4-6bdbb25f22cd None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:28.830886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ff6fb-eb4a-45a3-8ab4-6bdbb25f22cd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:28.831041 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ff6fb-eb4a-45a3-8ab4-6bdbb25f22cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:28.847794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c73ff6fb-eb4a-45a3-8ab4-6bdbb25f22cd None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:58:28.848953 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c73ff6fb-eb4a-45a3-8ab4-6bdbb25f22cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:58:28.914009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 577/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:58:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:58:28.936034 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2c92a-dc78-47c3-a1a8-01a534156889 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:29.032230 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2c92a-dc78-47c3-a1a8-01a534156889 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:29.063433 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bddfd-eb0d-4225-9360-697e4737244b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:29.064056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bddfd-eb0d-4225-9360-697e4737244b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:29.064332 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bddfd-eb0d-4225-9360-697e4737244b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:29.064601 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bddfd-eb0d-4225-9360-697e4737244b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:29.118283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:29.128418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7bddfd-eb0d-4225-9360-697e4737244b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:29.129885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7bddfd-eb0d-4225-9360-697e4737244b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:29.223519 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 587/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:58:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:58:29.229656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ff6fb-eb4a-45a3-8ab4-6bdbb25f22cd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:29.326373 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ff6fb-eb4a-45a3-8ab4-6bdbb25f22cd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:29.350433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:29.359192 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95148d17-214a-4db0-842d-0a2922ddb0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:29.359979 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95148d17-214a-4db0-842d-0a2922ddb0bb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:29.360260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95148d17-214a-4db0-842d-0a2922ddb0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:29.360534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95148d17-214a-4db0-842d-0a2922ddb0bb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:29.367519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95148d17-214a-4db0-842d-0a2922ddb0bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:29.368997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95148d17-214a-4db0-842d-0a2922ddb0bb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:29.383350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-95148d17-214a-4db0-842d-0a2922ddb0bb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 27 10:58:29.383350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:58:29.383350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 27 10:58:29.383350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 27 10:58:29.383350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:58:29.383350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:58:29.383350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:58:29.383350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:58:29.383350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 27 10:58:29.383350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:58:29.383350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 10:58:29.383350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:58:29.383350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:58:29.383350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:58:29.383350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:58:29.383350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:58:29.383350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:58:29.384528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:58:29.384528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:58:29.384528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:58:29.384528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:58:29.384528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:58:29.384528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:58:29.384528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:58:29.384528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:58:29.384528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:58:29.384528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:58:29.384528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:58:29.384528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:58:29.384528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:58:29.384528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:58:29.384528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:58:29.384528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:58:29.385609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:58:29.385609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:58:29.385609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:58:29.385609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:58:29.385609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:58:29.385609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:58:29.385609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:58:29.385609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:58:29.385609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:58:29.385609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:58:29.385609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 27 10:58:29.385609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:58:29.385609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 27 10:58:29.385609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:58:29.385609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 578/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jun 27 10:58:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:58:29.390858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bddfd-eb0d-4225-9360-697e4737244b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:29.474820 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:29.484272 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bddfd-eb0d-4225-9360-697e4737244b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:29.517275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3fd29-f95b-45a4-8aba-bbe1fd262603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:29.517944 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3fd29-f95b-45a4-8aba-bbe1fd262603 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:29.518224 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3fd29-f95b-45a4-8aba-bbe1fd262603 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:29.518498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3fd29-f95b-45a4-8aba-bbe1fd262603 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:29.519210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3fd29-f95b-45a4-8aba-bbe1fd262603 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:29.519512 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3fd29-f95b-45a4-8aba-bbe1fd262603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:29.520867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3fd29-f95b-45a4-8aba-bbe1fd262603 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:29.527785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 588/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Jun 27 10:58:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:31.478543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba91b7-f0a2-4684-a045-42f183e087b6 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:31.479033 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba91b7-f0a2-4684-a045-42f183e087b6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:31.479033 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba91b7-f0a2-4684-a045-42f183e087b6 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:31.480378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 579/1167] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:58:31.485531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88398e2a-0636-4414-b162-41c051f5f66a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:31.485902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88398e2a-0636-4414-b162-41c051f5f66a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:31.486087 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88398e2a-0636-4414-b162-41c051f5f66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:31.502874 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-88398e2a-0636-4414-b162-41c051f5f66a None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:58:31.504038 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-88398e2a-0636-4414-b162-41c051f5f66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:58:31.567409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 589/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:58:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 10:58:31.590040 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba91b7-f0a2-4684-a045-42f183e087b6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:31.688801 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba91b7-f0a2-4684-a045-42f183e087b6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:31.720513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5120d20-7aa8-4a83-af49-6aa462d2d3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:31.721150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5120d20-7aa8-4a83-af49-6aa462d2d3f5 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:31.721462 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5120d20-7aa8-4a83-af49-6aa462d2d3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:31.721739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5120d20-7aa8-4a83-af49-6aa462d2d3f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:31.722464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5120d20-7aa8-4a83-af49-6aa462d2d3f5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:31.723821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5120d20-7aa8-4a83-af49-6aa462d2d3f5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:31.738610 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 580/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Mon Jun 27 10:58:31 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:58:33.751243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb447c-e309-4609-bbc0-1fa2f7026cdc None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:33.751881 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb447c-e309-4609-bbc0-1fa2f7026cdc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:33.751881 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb447c-e309-4609-bbc0-1fa2f7026cdc None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:33.753160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 590/1170] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:58:33.758741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231c7f7-c93a-4651-9724-86da18671cdb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:33.759132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231c7f7-c93a-4651-9724-86da18671cdb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:33.759327 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231c7f7-c93a-4651-9724-86da18671cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:33.777034 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8231c7f7-c93a-4651-9724-86da18671cdb None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:58:33.778248 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8231c7f7-c93a-4651-9724-86da18671cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:58:33.818166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:33.843624 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 581/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:58:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:58:33.866976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb447c-e309-4609-bbc0-1fa2f7026cdc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:33.948037 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:33.964537 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb447c-e309-4609-bbc0-1fa2f7026cdc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:33.996708 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e484d-f011-4472-a81d-bb4336d96c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:33.997572 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e484d-f011-4472-a81d-bb4336d96c00 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:33.997854 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e484d-f011-4472-a81d-bb4336d96c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:33.998128 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e484d-f011-4472-a81d-bb4336d96c00 None admin] PATH_INFO: `/v3/domains/4c2f2e9bfa1a41ca925e6110b14ef80b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:34.008775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e484d-f011-4472-a81d-bb4336d96c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4c2f2e9bfa1a41ca925e6110b14ef80b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:34.010174 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e484d-f011-4472-a81d-bb4336d96c00 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:34.012047 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 591/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Mon Jun 27 10:58:33 2022] GET /identity/v3/domains/4c2f2e9bfa1a41ca925e6110b14ef80b => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:34.017818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231c7f7-c93a-4651-9724-86da18671cdb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:34.111434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231c7f7-c93a-4651-9724-86da18671cdb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:34.144563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc0abf-f622-4fc4-bcb4-b3e5b765dac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:34.145202 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc0abf-f622-4fc4-bcb4-b3e5b765dac1 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:34.145513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc0abf-f622-4fc4-bcb4-b3e5b765dac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:34.145791 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc0abf-f622-4fc4-bcb4-b3e5b765dac1 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:34.146520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc0abf-f622-4fc4-bcb4-b3e5b765dac1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:34.147933 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc0abf-f622-4fc4-bcb4-b3e5b765dac1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:34.173080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 582/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jun 27 10:58:34 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:58:36.203687 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6d4f9-e041-42a8-8798-28c0e785e1fe None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:36.204075 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6d4f9-e041-42a8-8798-28c0e785e1fe None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:36.204229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6d4f9-e041-42a8-8798-28c0e785e1fe None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:36.205632 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 592/1174] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:58:36.210796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fe87f-0d1a-4fe2-a726-d68178418714 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:36.211222 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fe87f-0d1a-4fe2-a726-d68178418714 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:36.211364 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fe87f-0d1a-4fe2-a726-d68178418714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:36.227758 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-207fe87f-0d1a-4fe2-a726-d68178418714 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:58:36.228995 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-207fe87f-0d1a-4fe2-a726-d68178418714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:58:36.251566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:36.294931 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 583/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:58:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:58:36.320416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6d4f9-e041-42a8-8798-28c0e785e1fe None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:36.417052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6d4f9-e041-42a8-8798-28c0e785e1fe None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:36.448514 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d6638-2436-442d-b2e1-1bcff376db92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:36.449338 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d6638-2436-442d-b2e1-1bcff376db92 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:36.449642 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d6638-2436-442d-b2e1-1bcff376db92 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:36.449909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d6638-2436-442d-b2e1-1bcff376db92 None admin] PATH_INFO: `/v3/domains/4c2f2e9bfa1a41ca925e6110b14ef80b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:36.451049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d6638-2436-442d-b2e1-1bcff376db92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4c2f2e9bfa1a41ca925e6110b14ef80b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:36.452507 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d6638-2436-442d-b2e1-1bcff376db92 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:36.454060 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 593/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Mon Jun 27 10:58:36 2022] GET /identity/v3/domains/4c2f2e9bfa1a41ca925e6110b14ef80b => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:36.459534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fe87f-0d1a-4fe2-a726-d68178418714 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:36.554773 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fe87f-0d1a-4fe2-a726-d68178418714 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:36.586893 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ef558-02d5-451c-b871-3349f4fdf0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:36.587541 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ef558-02d5-451c-b871-3349f4fdf0c4 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:36.587826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ef558-02d5-451c-b871-3349f4fdf0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:36.588105 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ef558-02d5-451c-b871-3349f4fdf0c4 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:36.588797 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ef558-02d5-451c-b871-3349f4fdf0c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:36.590248 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ef558-02d5-451c-b871-3349f4fdf0c4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:36.609845 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 584/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:58:36 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:58:38.639907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092c2ce-72eb-4056-9c1f-746f3569af59 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:38.640454 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092c2ce-72eb-4056-9c1f-746f3569af59 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:38.640454 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092c2ce-72eb-4056-9c1f-746f3569af59 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:38.641857 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 594/1178] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:58:38.647440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d45d4-7a8b-4ac7-b12b-9888b1e5d3d7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:38.647864 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d45d4-7a8b-4ac7-b12b-9888b1e5d3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:38.647962 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d45d4-7a8b-4ac7-b12b-9888b1e5d3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:38.666521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d56d45d4-7a8b-4ac7-b12b-9888b1e5d3d7 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:58:38.667675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d56d45d4-7a8b-4ac7-b12b-9888b1e5d3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:58:38.676731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:38.732696 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 585/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:58:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:58:38.756719 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092c2ce-72eb-4056-9c1f-746f3569af59 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:38.772539 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:38.854183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092c2ce-72eb-4056-9c1f-746f3569af59 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:38.885591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86064eb-f302-4339-a648-6c53bbfcaef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:38.886617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86064eb-f302-4339-a648-6c53bbfcaef9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:38.886892 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86064eb-f302-4339-a648-6c53bbfcaef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:38.887163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86064eb-f302-4339-a648-6c53bbfcaef9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:38.897802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86064eb-f302-4339-a648-6c53bbfcaef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:58:38.905188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a86064eb-f302-4339-a648-6c53bbfcaef9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:58:38.905188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:58:38.905188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:58:38.905188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:58:38.905188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:58:38.905188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:58:38.905188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:58:38.905188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:58:38.905188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:58:38.905188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:58:38.905188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:58:38.905188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:58:38.905188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:58:38.905188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:58:38.905188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:58:38.905188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:58:38.906400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:58:38.906400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:58:38.906400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:58:38.906400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:58:38.906400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:58:38.906400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:58:38.906400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:58:38.906400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:58:38.906400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:58:38.906400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:58:38.906400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:58:38.906400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:58:38.906400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:58:38.906400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:58:38.906400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:58:38.906400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:58:38.907327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:58:38.907327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:58:38.907327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:58:38.907327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:58:38.907327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:58:38.907327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:58:38.907327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:58:38.907327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:58:38.907327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:58:38.907327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:58:38.907327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:58:38.907327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:58:38.907327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 595/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:58:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:58:38.912266 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d45d4-7a8b-4ac7-b12b-9888b1e5d3d7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:39.009582 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d45d4-7a8b-4ac7-b12b-9888b1e5d3d7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:39.042062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88605b-6e9e-4f14-bfd8-afc0b4decaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:39.042709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88605b-6e9e-4f14-bfd8-afc0b4decaca None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:39.042988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88605b-6e9e-4f14-bfd8-afc0b4decaca None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:39.043261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88605b-6e9e-4f14-bfd8-afc0b4decaca None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:39.043999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88605b-6e9e-4f14-bfd8-afc0b4decaca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:39.044299 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88605b-6e9e-4f14-bfd8-afc0b4decaca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:39.045682 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88605b-6e9e-4f14-bfd8-afc0b4decaca None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:39.053890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 586/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:58:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:39.059553 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86064eb-f302-4339-a648-6c53bbfcaef9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:39.126927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:39.155517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86064eb-f302-4339-a648-6c53bbfcaef9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:39.188429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9664e-874f-4b72-9204-163cc8cd81ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:39.189280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9664e-874f-4b72-9204-163cc8cd81ab None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:39.189584 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9664e-874f-4b72-9204-163cc8cd81ab None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:39.189854 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9664e-874f-4b72-9204-163cc8cd81ab None admin] PATH_INFO: `/v3/users/5c643d298e1f4ede817fa8a41199ce1e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:39.203256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9664e-874f-4b72-9204-163cc8cd81ab None admin] RBAC: Authorizing `identity:get_user(user_id=5c643d298e1f4ede817fa8a41199ce1e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:39.204682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9664e-874f-4b72-9204-163cc8cd81ab None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:39.206366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 596/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:58:39 2022] GET /identity/v3/users/5c643d298e1f4ede817fa8a41199ce1e => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:39.212005 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88605b-6e9e-4f14-bfd8-afc0b4decaca None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:39.221762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:39.311785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88605b-6e9e-4f14-bfd8-afc0b4decaca None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:39.343977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423ccf6-be01-42f0-bbd8-41f9a7e5b92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:39.344609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423ccf6-be01-42f0-bbd8-41f9a7e5b92c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:39.344888 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423ccf6-be01-42f0-bbd8-41f9a7e5b92c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:39.345159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423ccf6-be01-42f0-bbd8-41f9a7e5b92c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:39.409383 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423ccf6-be01-42f0-bbd8-41f9a7e5b92c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:39.410758 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423ccf6-be01-42f0-bbd8-41f9a7e5b92c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:39.418433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:39.504142 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 587/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:58:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:58:39.509969 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9664e-874f-4b72-9204-163cc8cd81ab None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:39.604870 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9664e-874f-4b72-9204-163cc8cd81ab None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:39.632216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:39.638358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc644b8-cd2c-4fc3-8760-7932a5f535aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:39.639198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc644b8-cd2c-4fc3-8760-7932a5f535aa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:39.639477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc644b8-cd2c-4fc3-8760-7932a5f535aa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:39.639749 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc644b8-cd2c-4fc3-8760-7932a5f535aa None admin] PATH_INFO: `/v3/projects/3545f0768ac94b4fb04f45f53e271320` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:39.640900 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc644b8-cd2c-4fc3-8760-7932a5f535aa None admin] RBAC: Authorizing `identity:get_project(project_id=3545f0768ac94b4fb04f45f53e271320)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:39.642352 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc644b8-cd2c-4fc3-8760-7932a5f535aa None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:39.644032 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 597/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:58:39 2022] GET /identity/v3/projects/3545f0768ac94b4fb04f45f53e271320 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:39.650094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423ccf6-be01-42f0-bbd8-41f9a7e5b92c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:39.745315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423ccf6-be01-42f0-bbd8-41f9a7e5b92c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:39.752295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:39.778194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdcef5-791e-4834-94fc-d3de759eab83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:39.778830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdcef5-791e-4834-94fc-d3de759eab83 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:39.779111 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdcef5-791e-4834-94fc-d3de759eab83 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:39.779391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdcef5-791e-4834-94fc-d3de759eab83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:39.780218 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdcef5-791e-4834-94fc-d3de759eab83 None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=3545f0768ac94b4fb04f45f53e271320, user.id=5c643d298e1f4ede817fa8a41199ce1e) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:39.780528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdcef5-791e-4834-94fc-d3de759eab83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:39.781984 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdcef5-791e-4834-94fc-d3de759eab83 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:39.787760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 588/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:58:39 2022] GET /identity/v3/role_assignments?user.id=5c643d298e1f4ede817fa8a41199ce1e&scope.project.id=3545f0768ac94b4fb04f45f53e271320&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:41.744445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a698a-57b6-49ff-ae0f-1d4a826b609a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:41.745000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a698a-57b6-49ff-ae0f-1d4a826b609a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:41.745000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a698a-57b6-49ff-ae0f-1d4a826b609a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:41.746372 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 598/1186] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:58:41.751432 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd23a6-bcc6-45ae-b98c-df6288cb8374 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:41.751796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd23a6-bcc6-45ae-b98c-df6288cb8374 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:41.751989 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd23a6-bcc6-45ae-b98c-df6288cb8374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:41.769057 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6ccd23a6-bcc6-45ae-b98c-df6288cb8374 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:58:41.770275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6ccd23a6-bcc6-45ae-b98c-df6288cb8374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:58:41.834716 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 589/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:58:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:58:41.856487 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a698a-57b6-49ff-ae0f-1d4a826b609a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:41.952730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a698a-57b6-49ff-ae0f-1d4a826b609a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:41.984615 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc21de-de20-476c-a1c1-a69926bc2c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:41.985397 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc21de-de20-476c-a1c1-a69926bc2c69 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:41.985687 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc21de-de20-476c-a1c1-a69926bc2c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:41.985956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc21de-de20-476c-a1c1-a69926bc2c69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:41.995592 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc21de-de20-476c-a1c1-a69926bc2c69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:58:42.003049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-91cc21de-de20-476c-a1c1-a69926bc2c69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:58:42.003049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:58:42.003049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:58:42.003049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:58:42.003049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:58:42.003049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:58:42.003049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:58:42.003049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:58:42.003049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:58:42.003049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:58:42.003049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:58:42.003049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:58:42.003049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:58:42.003049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:58:42.003049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:58:42.003049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:58:42.004051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:58:42.004051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:58:42.004051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:58:42.004051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:58:42.004051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:58:42.004051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:58:42.004051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:58:42.004051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:58:42.004051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:58:42.004051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:58:42.004051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:58:42.004051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:58:42.004051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:58:42.004051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:58:42.004051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:58:42.004051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:58:42.004918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:58:42.004918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:58:42.004918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:58:42.004918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:58:42.004918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:58:42.004918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:58:42.004918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:58:42.004918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:58:42.004918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:58:42.004918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:58:42.004918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:58:42.004918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:58:42.004918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 599/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:58:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:58:42.010743 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd23a6-bcc6-45ae-b98c-df6288cb8374 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:42.102697 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:42.105543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd23a6-bcc6-45ae-b98c-df6288cb8374 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:42.139679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59985fd8-60e0-40db-849d-992edb00b435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:42.140323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59985fd8-60e0-40db-849d-992edb00b435 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:42.140601 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59985fd8-60e0-40db-849d-992edb00b435 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:42.140869 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59985fd8-60e0-40db-849d-992edb00b435 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:42.141625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59985fd8-60e0-40db-849d-992edb00b435 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:42.141929 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59985fd8-60e0-40db-849d-992edb00b435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:42.143283 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59985fd8-60e0-40db-849d-992edb00b435 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:42.151004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 590/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:58:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:42.156543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc21de-de20-476c-a1c1-a69926bc2c69 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:42.213794 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:42.253684 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc21de-de20-476c-a1c1-a69926bc2c69 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:42.285716 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219ce4d-d5cd-4c65-9a12-bd98bc90e842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:42.286560 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219ce4d-d5cd-4c65-9a12-bd98bc90e842 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:42.286858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219ce4d-d5cd-4c65-9a12-bd98bc90e842 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:42.287129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219ce4d-d5cd-4c65-9a12-bd98bc90e842 None admin] PATH_INFO: `/v3/users/5c643d298e1f4ede817fa8a41199ce1e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:42.288270 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219ce4d-d5cd-4c65-9a12-bd98bc90e842 None admin] RBAC: Authorizing `identity:get_user(user_id=5c643d298e1f4ede817fa8a41199ce1e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:42.289698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219ce4d-d5cd-4c65-9a12-bd98bc90e842 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:42.291288 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 600/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:58:42 2022] GET /identity/v3/users/5c643d298e1f4ede817fa8a41199ce1e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:42.297084 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59985fd8-60e0-40db-849d-992edb00b435 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:42.394009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59985fd8-60e0-40db-849d-992edb00b435 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:42.426307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a2cb3-5f7e-4ef9-9f61-c75a8612d4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:42.427144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a2cb3-5f7e-4ef9-9f61-c75a8612d4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:42.427954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a2cb3-5f7e-4ef9-9f61-c75a8612d4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:42.428225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a2cb3-5f7e-4ef9-9f61-c75a8612d4b1 None admin] PATH_INFO: `/v3/projects/3545f0768ac94b4fb04f45f53e271320` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:42.429388 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a2cb3-5f7e-4ef9-9f61-c75a8612d4b1 None admin] RBAC: Authorizing `identity:get_project(project_id=3545f0768ac94b4fb04f45f53e271320)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:42.430805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a2cb3-5f7e-4ef9-9f61-c75a8612d4b1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:42.432436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 591/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:58:42 2022] GET /identity/v3/projects/3545f0768ac94b4fb04f45f53e271320 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:42.438128 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219ce4d-d5cd-4c65-9a12-bd98bc90e842 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:42.530820 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219ce4d-d5cd-4c65-9a12-bd98bc90e842 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:42.555049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:42.563586 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be122d2f-4a0c-4634-94f9-f4fe289e61af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:42.564443 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be122d2f-4a0c-4634-94f9-f4fe289e61af None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:42.564720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be122d2f-4a0c-4634-94f9-f4fe289e61af None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:42.564990 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be122d2f-4a0c-4634-94f9-f4fe289e61af None admin] PATH_INFO: `/v3/projects/3545f0768ac94b4fb04f45f53e271320/users/5c643d298e1f4ede817fa8a41199ce1e/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:42.566915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be122d2f-4a0c-4634-94f9-f4fe289e61af None admin] RBAC: Authorizing `identity:create_grant(project_id=3545f0768ac94b4fb04f45f53e271320, user_id=5c643d298e1f4ede817fa8a41199ce1e, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:42.568340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be122d2f-4a0c-4634-94f9-f4fe289e61af None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:42.580274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 601/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:58:42 2022] PUT /identity/v3/projects/3545f0768ac94b4fb04f45f53e271320/users/5c643d298e1f4ede817fa8a41199ce1e/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 10:58:44.535393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf604d-9349-4069-8086-328efb4fc17b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:44.535885 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf604d-9349-4069-8086-328efb4fc17b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:44.535971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf604d-9349-4069-8086-328efb4fc17b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:44.537970 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 592/1193] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:58:44.543265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f9e65-f145-4a96-8703-b93771d25d8c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:44.543624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f9e65-f145-4a96-8703-b93771d25d8c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:44.543815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f9e65-f145-4a96-8703-b93771d25d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:44.560008 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-706f9e65-f145-4a96-8703-b93771d25d8c None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:58:44.561162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-706f9e65-f145-4a96-8703-b93771d25d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:58:44.625345 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 602/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:58:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:58:44.649308 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf604d-9349-4069-8086-328efb4fc17b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:44.679347 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:44.747124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf604d-9349-4069-8086-328efb4fc17b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:44.779645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb520216-2e2e-48f2-a5b7-9301d6df2886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:44.780414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb520216-2e2e-48f2-a5b7-9301d6df2886 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:44.780691 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb520216-2e2e-48f2-a5b7-9301d6df2886 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:44.780958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb520216-2e2e-48f2-a5b7-9301d6df2886 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:44.791094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb520216-2e2e-48f2-a5b7-9301d6df2886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:58:44.798508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-cb520216-2e2e-48f2-a5b7-9301d6df2886 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:58:44.798508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:58:44.798508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:58:44.798508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:58:44.798508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:58:44.798508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:58:44.798508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:58:44.798508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:58:44.798508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:58:44.798508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:58:44.798508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:58:44.798508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:58:44.798508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:58:44.798508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:58:44.798508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:58:44.798508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:58:44.799593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:58:44.799593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:58:44.799593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:58:44.799593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:58:44.799593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:58:44.799593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:58:44.799593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:58:44.799593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:58:44.799593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:58:44.799593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:58:44.799593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:58:44.799593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:58:44.799593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:58:44.799593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:58:44.799593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:58:44.799593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:58:44.800563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:58:44.800563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:58:44.800563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:58:44.800563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:58:44.800563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:58:44.800563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:58:44.800563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:58:44.800563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:58:44.800563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:58:44.800563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:58:44.800563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:58:44.800563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:58:44.800563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 593/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:58:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:58:44.805672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f9e65-f145-4a96-8703-b93771d25d8c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:44.899421 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f9e65-f145-4a96-8703-b93771d25d8c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:44.915130 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:44.932939 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47f874-4c6c-4b99-beb5-0e359b9c99b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:44.933740 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47f874-4c6c-4b99-beb5-0e359b9c99b0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:44.934024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47f874-4c6c-4b99-beb5-0e359b9c99b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:44.934312 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47f874-4c6c-4b99-beb5-0e359b9c99b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:44.935040 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47f874-4c6c-4b99-beb5-0e359b9c99b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:44.935346 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47f874-4c6c-4b99-beb5-0e359b9c99b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:44.936714 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47f874-4c6c-4b99-beb5-0e359b9c99b0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:44.944913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 603/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:58:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:44.950547 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb520216-2e2e-48f2-a5b7-9301d6df2886 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:45.037307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:45.046959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb520216-2e2e-48f2-a5b7-9301d6df2886 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:45.080362 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37173c71-5310-44d1-a0fe-966eb4d015d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:45.081208 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37173c71-5310-44d1-a0fe-966eb4d015d9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:45.081522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37173c71-5310-44d1-a0fe-966eb4d015d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:45.081794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37173c71-5310-44d1-a0fe-966eb4d015d9 None admin] PATH_INFO: `/v3/users/5c643d298e1f4ede817fa8a41199ce1e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:45.082948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37173c71-5310-44d1-a0fe-966eb4d015d9 None admin] RBAC: Authorizing `identity:get_user(user_id=5c643d298e1f4ede817fa8a41199ce1e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:45.084386 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37173c71-5310-44d1-a0fe-966eb4d015d9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:45.086009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 594/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jun 27 10:58:44 2022] GET /identity/v3/users/5c643d298e1f4ede817fa8a41199ce1e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:45.091717 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47f874-4c6c-4b99-beb5-0e359b9c99b0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:45.185941 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47f874-4c6c-4b99-beb5-0e359b9c99b0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:45.218418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c621d-5465-4324-9c0f-f8856877386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:45.219052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c621d-5465-4324-9c0f-f8856877386a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:45.219329 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c621d-5465-4324-9c0f-f8856877386a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:45.219601 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c621d-5465-4324-9c0f-f8856877386a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:45.263087 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:45.283857 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c621d-5465-4324-9c0f-f8856877386a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:45.285283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c621d-5465-4324-9c0f-f8856877386a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:45.377951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 604/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:58:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:58:45.384372 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37173c71-5310-44d1-a0fe-966eb4d015d9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:45.479517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37173c71-5310-44d1-a0fe-966eb4d015d9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:45.512408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fccf7a-25e0-4e7a-901b-4ab08c141057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:45.513243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fccf7a-25e0-4e7a-901b-4ab08c141057 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:45.513551 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fccf7a-25e0-4e7a-901b-4ab08c141057 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:45.513824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fccf7a-25e0-4e7a-901b-4ab08c141057 None admin] PATH_INFO: `/v3/projects/3545f0768ac94b4fb04f45f53e271320` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:45.514975 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fccf7a-25e0-4e7a-901b-4ab08c141057 None admin] RBAC: Authorizing `identity:get_project(project_id=3545f0768ac94b4fb04f45f53e271320)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:45.516384 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fccf7a-25e0-4e7a-901b-4ab08c141057 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:45.518064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 595/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jun 27 10:58:45 2022] GET /identity/v3/projects/3545f0768ac94b4fb04f45f53e271320 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:45.523827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c621d-5465-4324-9c0f-f8856877386a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:58:45.596878 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:45.618260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c621d-5465-4324-9c0f-f8856877386a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:58:45.650232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef51fbd-ef3d-4d45-8bc2-a7938ece997f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:58:45.650810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef51fbd-ef3d-4d45-8bc2-a7938ece997f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:58:45.651091 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef51fbd-ef3d-4d45-8bc2-a7938ece997f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:58:45.651363 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef51fbd-ef3d-4d45-8bc2-a7938ece997f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:58:45.652186 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef51fbd-ef3d-4d45-8bc2-a7938ece997f None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=3545f0768ac94b4fb04f45f53e271320, user.id=5c643d298e1f4ede817fa8a41199ce1e) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:58:45.652492 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef51fbd-ef3d-4d45-8bc2-a7938ece997f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:58:45.653956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef51fbd-ef3d-4d45-8bc2-a7938ece997f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:58:45.659540 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 605/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:58:45 2022] GET /identity/v3/role_assignments?user.id=5c643d298e1f4ede817fa8a41199ce1e&scope.project.id=3545f0768ac94b4fb04f45f53e271320&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:58:55.508172 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=87 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:58:55.656957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=29 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:40.116161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f0d45-adea-45b4-8e4a-a5187a319256 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:40.116766 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f0d45-adea-45b4-8e4a-a5187a319256 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:40.116766 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f0d45-adea-45b4-8e4a-a5187a319256 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:40.118624 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 596/1201] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:59:40.124569 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5564fb-9fc3-4b3d-b321-dc47db0fc056 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:40.125068 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5564fb-9fc3-4b3d-b321-dc47db0fc056 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:40.125184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5564fb-9fc3-4b3d-b321-dc47db0fc056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:40.150635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ea5564fb-9fc3-4b3d-b321-dc47db0fc056 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:59:40.153093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ea5564fb-9fc3-4b3d-b321-dc47db0fc056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:59:40.237948 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 606/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:59:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:59:40.263927 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f0d45-adea-45b4-8e4a-a5187a319256 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:40.404113 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f0d45-adea-45b4-8e4a-a5187a319256 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:40.461013 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb724f7-0242-4452-9a68-364b54ab48d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:40.461954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb724f7-0242-4452-9a68-364b54ab48d9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:40.462247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb724f7-0242-4452-9a68-364b54ab48d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:40.462527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb724f7-0242-4452-9a68-364b54ab48d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:40.475558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb724f7-0242-4452-9a68-364b54ab48d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:40.477547 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb724f7-0242-4452-9a68-364b54ab48d9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:40.499375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ebb724f7-0242-4452-9a68-364b54ab48d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:40.499375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:40.499375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:40.499375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:40.499375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:40.499375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:40.499375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:40.499375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:40.499375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:40.499375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:40.499375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:40.499375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:40.499375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:59:40.499375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:59:40.499375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:59:40.500510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:59:40.500510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:40.500510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:40.500510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:40.500510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:40.500510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:40.500510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:40.500510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:40.500510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:40.500510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:40.500510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:40.500510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:40.500510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:40.500510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:40.500510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:40.500510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:40.500510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:40.501515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:59:40.501515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:59:40.501515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:40.501515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:59:40.501515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 597/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:59:40.508063 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5564fb-9fc3-4b3d-b321-dc47db0fc056 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:40.647668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5564fb-9fc3-4b3d-b321-dc47db0fc056 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:40.693532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:40.700093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108e7c4-fb8e-40b0-8295-99b0b4d11932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:40.700725 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108e7c4-fb8e-40b0-8295-99b0b4d11932 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:40.701004 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108e7c4-fb8e-40b0-8295-99b0b4d11932 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:40.701275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108e7c4-fb8e-40b0-8295-99b0b4d11932 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:40.702038 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108e7c4-fb8e-40b0-8295-99b0b4d11932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:40.702336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108e7c4-fb8e-40b0-8295-99b0b4d11932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:40.703734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108e7c4-fb8e-40b0-8295-99b0b4d11932 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:40.719150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 607/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:40.725635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb724f7-0242-4452-9a68-364b54ab48d9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:40.803681 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:40.864567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb724f7-0242-4452-9a68-364b54ab48d9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:40.906884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb6d7a-874e-4d65-9713-17177f223559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:40.907657 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb6d7a-874e-4d65-9713-17177f223559 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:40.908018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb6d7a-874e-4d65-9713-17177f223559 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:40.908356 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb6d7a-874e-4d65-9713-17177f223559 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:40.909068 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb6d7a-874e-4d65-9713-17177f223559 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:40.911371 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb6d7a-874e-4d65-9713-17177f223559 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:40.938056 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 598/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jun 27 10:59:40 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 10:59:43.113519 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e12af-b21b-4411-ab6e-8a9a330f641a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:43.114099 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e12af-b21b-4411-ab6e-8a9a330f641a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:43.114099 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e12af-b21b-4411-ab6e-8a9a330f641a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:43.115604 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 608/1206] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:59:43.120970 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434c518-d028-468c-80de-9f38af89e161 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:43.121416 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434c518-d028-468c-80de-9f38af89e161 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:43.121577 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434c518-d028-468c-80de-9f38af89e161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:43.143877 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6434c518-d028-468c-80de-9f38af89e161 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:59:43.145698 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6434c518-d028-468c-80de-9f38af89e161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:59:43.228392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 599/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:59:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:59:43.251041 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e12af-b21b-4411-ab6e-8a9a330f641a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:43.363832 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e12af-b21b-4411-ab6e-8a9a330f641a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:43.401684 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e518b-4e85-4d07-9652-78624a377cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:43.402475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e518b-4e85-4d07-9652-78624a377cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:43.402757 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e518b-4e85-4d07-9652-78624a377cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:43.403036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e518b-4e85-4d07-9652-78624a377cb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:43.413875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e518b-4e85-4d07-9652-78624a377cb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:59:43.423419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-d07e518b-4e85-4d07-9652-78624a377cb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:59:43.423419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:43.423419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:43.423419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:43.423419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:43.423419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:43.423419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:43.423419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:43.423419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:43.423419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:43.423419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:43.423419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:43.423419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:59:43.423419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:59:43.423419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:59:43.423419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:59:43.424396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:59:43.424396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:59:43.424396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:59:43.424396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:59:43.424396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:43.424396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:43.424396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:43.424396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:43.424396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:43.424396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:43.424396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:43.424396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:43.424396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:43.424396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:43.424396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:43.424396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:43.425956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:43.425956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:43.425956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:43.425956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:43.425956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:59:43.425956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:59:43.425956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:59:43.425956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:59:43.425956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:59:43.425956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:59:43.425956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:59:43.425956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:59:43.425956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 609/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:59:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:59:43.430643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434c518-d028-468c-80de-9f38af89e161 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:43.478135 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:43.554763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434c518-d028-468c-80de-9f38af89e161 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:43.596409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f66a0-086e-43c4-b028-184822f83bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:43.597143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f66a0-086e-43c4-b028-184822f83bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:43.597488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f66a0-086e-43c4-b028-184822f83bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:43.597767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f66a0-086e-43c4-b028-184822f83bf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:43.598518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f66a0-086e-43c4-b028-184822f83bf2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:43.598827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f66a0-086e-43c4-b028-184822f83bf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:43.600204 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f66a0-086e-43c4-b028-184822f83bf2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:43.608727 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 600/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:59:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:59:43.615371 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e518b-4e85-4d07-9652-78624a377cb6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:43.684026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:43.752375 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e518b-4e85-4d07-9652-78624a377cb6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:43.790024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca39ca-1afe-43ed-8414-e4ce9d848c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:43.790811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca39ca-1afe-43ed-8414-e4ce9d848c12 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:43.791088 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca39ca-1afe-43ed-8414-e4ce9d848c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:43.791362 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca39ca-1afe-43ed-8414-e4ce9d848c12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:43.802578 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca39ca-1afe-43ed-8414-e4ce9d848c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:43.804140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca39ca-1afe-43ed-8414-e4ce9d848c12 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:43.824395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-c7ca39ca-1afe-43ed-8414-e4ce9d848c12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:43.824395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:43.824395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:43.824395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:43.824395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:43.824395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:43.824395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:43.824395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:43.824395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:43.824395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:43.824395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:43.824395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:43.824395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:59:43.824395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:59:43.824395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:59:43.825571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:59:43.825571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:43.825571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:43.825571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:43.825571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:43.825571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:43.825571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:43.825571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:43.825571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:43.825571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:43.825571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:43.825571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:43.825571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:43.825571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:43.825571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:43.825571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:43.825571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:43.826498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:59:43.826498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:59:43.826498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:43.826498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:59:43.826498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 610/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:59:43.831721 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f66a0-086e-43c4-b028-184822f83bf2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:43.943554 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:43.947398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f66a0-086e-43c4-b028-184822f83bf2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:43.990550 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f0e86-2ac4-4636-a4e4-b3d56e8c22f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:43.991581 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f0e86-2ac4-4636-a4e4-b3d56e8c22f3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:43.992088 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f0e86-2ac4-4636-a4e4-b3d56e8c22f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:43.992571 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f0e86-2ac4-4636-a4e4-b3d56e8c22f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:43.993508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f0e86-2ac4-4636-a4e4-b3d56e8c22f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:43.993988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f0e86-2ac4-4636-a4e4-b3d56e8c22f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:43.995366 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f0e86-2ac4-4636-a4e4-b3d56e8c22f3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:44.011185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 601/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:44.017880 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca39ca-1afe-43ed-8414-e4ce9d848c12 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:44.129168 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca39ca-1afe-43ed-8414-e4ce9d848c12 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:44.130734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:44.165854 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b03672-be25-4052-a9e3-b3b503dd4ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:44.166679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b03672-be25-4052-a9e3-b3b503dd4ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:44.166948 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b03672-be25-4052-a9e3-b3b503dd4ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:44.167233 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b03672-be25-4052-a9e3-b3b503dd4ce7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:44.174661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b03672-be25-4052-a9e3-b3b503dd4ce7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:44.176814 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b03672-be25-4052-a9e3-b3b503dd4ce7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:44.192039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-38b03672-be25-4052-a9e3-b3b503dd4ce7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 10:59:44.192039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:44.192039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:44.192039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:44.192039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:44.192039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:44.192039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:44.192039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:44.192039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:44.192039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:44.192039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:44.192039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:44.192039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:59:44.192039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:59:44.192039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:59:44.192039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:44.193380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:44.198641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:44.198641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:44.198641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:59:44.198641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:59:44.198641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:59:44.198641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:59:44.198641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:59:44.198641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:59:44.198641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 10:59:44.198641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:59:44.198641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 611/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:59:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:59:44.199297 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f0e86-2ac4-4636-a4e4-b3d56e8c22f3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:44.311146 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f0e86-2ac4-4636-a4e4-b3d56e8c22f3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:44.351358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f1f3f-aca4-4045-84e6-08d202e60fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:44.352035 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f1f3f-aca4-4045-84e6-08d202e60fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:44.352318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f1f3f-aca4-4045-84e6-08d202e60fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:44.352593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f1f3f-aca4-4045-84e6-08d202e60fd3 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:44.353471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f1f3f-aca4-4045-84e6-08d202e60fd3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:44.353783 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f1f3f-aca4-4045-84e6-08d202e60fd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:44.355216 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f1f3f-aca4-4045-84e6-08d202e60fd3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:44.375777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 602/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jun 27 10:59:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:44.381773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b03672-be25-4052-a9e3-b3b503dd4ce7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:44.490055 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b03672-be25-4052-a9e3-b3b503dd4ce7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:44.529837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c0f6c-2076-469c-a4df-f31b376696db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:44.530557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c0f6c-2076-469c-a4df-f31b376696db None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:44.530864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c0f6c-2076-469c-a4df-f31b376696db None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:44.531180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c0f6c-2076-469c-a4df-f31b376696db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:44.571391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:44.611456 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c0f6c-2076-469c-a4df-f31b376696db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:44.613026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c0f6c-2076-469c-a4df-f31b376696db None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:44.731278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 612/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:59:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 27 10:59:44.737252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f1f3f-aca4-4045-84e6-08d202e60fd3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:44.758730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:44.850213 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f1f3f-aca4-4045-84e6-08d202e60fd3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:44.889802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f9aea-6924-424a-b82d-e2d393255470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:44.890964 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f9aea-6924-424a-b82d-e2d393255470 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:44.891248 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f9aea-6924-424a-b82d-e2d393255470 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:44.891538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f9aea-6924-424a-b82d-e2d393255470 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:44.904766 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f9aea-6924-424a-b82d-e2d393255470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:44.906536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f9aea-6924-424a-b82d-e2d393255470 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:44.928287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-451f9aea-6924-424a-b82d-e2d393255470 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:44.928287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:44.928287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:44.928287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:44.928287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:44.928287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:44.928287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:44.928287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:44.928287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:44.928287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:44.928287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:44.928287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:44.928287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:59:44.928287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:59:44.928287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:59:44.929553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:59:44.929553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:44.929553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:44.929553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:44.929553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:44.929553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:44.929553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:44.929553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:44.929553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:44.929553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:44.929553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:44.929553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:44.929553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:44.929553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:44.929553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:44.929553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:44.929553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:44.930948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:59:44.930948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:59:44.930948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:44.930948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:59:44.930948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 603/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:59:44.936016 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c0f6c-2076-469c-a4df-f31b376696db None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:45.024099 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:45.072750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c0f6c-2076-469c-a4df-f31b376696db None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:45.122120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9736b-a797-4579-a966-6b8576f60555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:45.123202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9736b-a797-4579-a966-6b8576f60555 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:45.123434 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9736b-a797-4579-a966-6b8576f60555 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:45.123783 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9736b-a797-4579-a966-6b8576f60555 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:45.124561 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9736b-a797-4579-a966-6b8576f60555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:45.124863 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9736b-a797-4579-a966-6b8576f60555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:45.126262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9736b-a797-4579-a966-6b8576f60555 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:45.140987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 613/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:45.146584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f9aea-6924-424a-b82d-e2d393255470 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:45.232906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:45.273759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f9aea-6924-424a-b82d-e2d393255470 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:45.314933 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b8c8c-2fb2-4ec0-bece-e28b9a076e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:45.315797 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b8c8c-2fb2-4ec0-bece-e28b9a076e48 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:45.316674 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b8c8c-2fb2-4ec0-bece-e28b9a076e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:45.317005 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b8c8c-2fb2-4ec0-bece-e28b9a076e48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:45.324355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b8c8c-2fb2-4ec0-bece-e28b9a076e48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:45.325911 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b8c8c-2fb2-4ec0-bece-e28b9a076e48 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:45.340635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d77b8c8c-2fb2-4ec0-bece-e28b9a076e48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:59:45.340635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:45.340635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:45.340635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:45.340635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:45.340635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:45.340635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:45.340635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:45.340635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:45.340635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:45.340635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:45.340635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:45.340635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:59:45.340635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:59:45.340635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:59:45.341652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:59:45.341652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:45.341652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:45.341652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:45.341652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:45.341652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:45.341652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:45.341652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:45.341652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:45.341652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:45.341652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:45.341652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:45.341652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:45.341652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:45.341652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:45.341652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:45.341652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:45.342590 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:59:45.342590 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:59:45.342590 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:59:45.342590 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:59:45.342590 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:59:45.342590 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:59:45.342590 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:59:45.342590 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:59:45.342590 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 604/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:59:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:59:45.348118 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9736b-a797-4579-a966-6b8576f60555 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:45.463788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9736b-a797-4579-a966-6b8576f60555 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:45.491205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:45.505252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032887f-8193-4600-9124-8fdd18b3c8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:45.506090 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032887f-8193-4600-9124-8fdd18b3c8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:45.506499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032887f-8193-4600-9124-8fdd18b3c8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:45.506902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032887f-8193-4600-9124-8fdd18b3c8d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:45.507795 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032887f-8193-4600-9124-8fdd18b3c8d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:45.508236 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032887f-8193-4600-9124-8fdd18b3c8d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:45.509924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032887f-8193-4600-9124-8fdd18b3c8d5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:45.524006 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 614/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:59:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:59:45.530442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b8c8c-2fb2-4ec0-bece-e28b9a076e48 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:45.643284 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b8c8c-2fb2-4ec0-bece-e28b9a076e48 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:45.674359 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:45.682134 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7370e05-c5ff-459e-b5a5-624ba39a46b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:45.683000 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7370e05-c5ff-459e-b5a5-624ba39a46b6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:45.683416 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7370e05-c5ff-459e-b5a5-624ba39a46b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:45.683778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7370e05-c5ff-459e-b5a5-624ba39a46b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:45.684716 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7370e05-c5ff-459e-b5a5-624ba39a46b6 None admin] RBAC: Adding query filter params (role.id=e053e0425eb744e2a3e3316222e208f3, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=d8673c91abf14c0b9a237f0499fdf20e) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:45.685144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7370e05-c5ff-459e-b5a5-624ba39a46b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:45.686826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7370e05-c5ff-459e-b5a5-624ba39a46b6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:45.693109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 605/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:59:45 2022] GET /identity/v3/role_assignments?user.id=d8673c91abf14c0b9a237f0499fdf20e&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=e053e0425eb744e2a3e3316222e208f3 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:47.720484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422039f-6a06-4c8e-8444-eb8d7b02db4a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:47.721082 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422039f-6a06-4c8e-8444-eb8d7b02db4a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:47.721082 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422039f-6a06-4c8e-8444-eb8d7b02db4a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:47.723100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 615/1220] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:59:47.728142 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03a8f7-8118-4e0b-ab8d-dd51a0285e5a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:47.728576 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03a8f7-8118-4e0b-ab8d-dd51a0285e5a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:47.728694 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03a8f7-8118-4e0b-ab8d-dd51a0285e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:47.746279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2f03a8f7-8118-4e0b-ab8d-dd51a0285e5a None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:59:47.747456 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2f03a8f7-8118-4e0b-ab8d-dd51a0285e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:59:47.813771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 606/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:59:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:59:47.836074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422039f-6a06-4c8e-8444-eb8d7b02db4a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:47.943527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422039f-6a06-4c8e-8444-eb8d7b02db4a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:47.984951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980947a5-2e19-493d-b805-2cb7af47a479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:47.985999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980947a5-2e19-493d-b805-2cb7af47a479 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:47.986162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980947a5-2e19-493d-b805-2cb7af47a479 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:47.986492 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980947a5-2e19-493d-b805-2cb7af47a479 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:48.000152 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980947a5-2e19-493d-b805-2cb7af47a479 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:59:48.010472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-980947a5-2e19-493d-b805-2cb7af47a479 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:59:48.010472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:48.010472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:48.010472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:48.010472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:48.010472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:48.010472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:48.010472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:48.010472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:48.010472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:48.010472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:48.010472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:48.010472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:59:48.010472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:59:48.010472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:59:48.010472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:59:48.012555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:59:48.012555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:59:48.012555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:59:48.012555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:59:48.012555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:48.012555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:48.012555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:48.012555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:48.012555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:48.012555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:48.012555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:48.012555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:48.012555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:48.012555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:48.012555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:48.012555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:48.014246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:48.014246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:48.014246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:48.014246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:48.014246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:59:48.014246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:59:48.014246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:59:48.014246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:59:48.014246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:59:48.014246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:59:48.014246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:59:48.014246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:59:48.014246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 616/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:59:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:59:48.018078 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03a8f7-8118-4e0b-ab8d-dd51a0285e5a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:48.130350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03a8f7-8118-4e0b-ab8d-dd51a0285e5a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:48.155062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:48.167837 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfceee5-ce6e-43f0-be50-8b65f359605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:48.168520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfceee5-ce6e-43f0-be50-8b65f359605f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:48.168871 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfceee5-ce6e-43f0-be50-8b65f359605f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:48.169151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfceee5-ce6e-43f0-be50-8b65f359605f None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:48.169989 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfceee5-ce6e-43f0-be50-8b65f359605f None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:48.170355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfceee5-ce6e-43f0-be50-8b65f359605f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:48.172002 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfceee5-ce6e-43f0-be50-8b65f359605f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:48.181143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 607/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:59:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:48.186925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980947a5-2e19-493d-b805-2cb7af47a479 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:48.236235 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:48.296828 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980947a5-2e19-493d-b805-2cb7af47a479 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:48.330943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cc419-b35e-4f71-9902-e05715603098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:48.332380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cc419-b35e-4f71-9902-e05715603098 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:48.332716 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cc419-b35e-4f71-9902-e05715603098 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:48.333083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cc419-b35e-4f71-9902-e05715603098 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:48.345341 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37cc419-b35e-4f71-9902-e05715603098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:48.347217 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37cc419-b35e-4f71-9902-e05715603098 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:48.367169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-d37cc419-b35e-4f71-9902-e05715603098 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:48.367169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:48.367169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:48.367169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:48.367169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:48.367169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:48.367169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:48.367169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:48.367169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:48.367169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:48.367169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:48.367169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:48.367169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:59:48.367169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:59:48.367169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:59:48.368127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:59:48.368127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:48.368127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:48.368127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:48.368127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:48.368127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:48.368127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:48.368127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:48.368127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:48.368127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:48.368127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:48.368127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:48.368127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:48.368127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:48.368127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:48.368127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:48.368127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:48.369034 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:59:48.369034 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:59:48.369034 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:48.369034 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:59:48.369034 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 617/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:59:48.375372 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfceee5-ce6e-43f0-be50-8b65f359605f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:48.491907 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfceee5-ce6e-43f0-be50-8b65f359605f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:48.526946 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd880f-2f06-4b59-a5ca-4a8d9ffbc02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:48.527653 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd880f-2f06-4b59-a5ca-4a8d9ffbc02b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:48.527971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd880f-2f06-4b59-a5ca-4a8d9ffbc02b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:48.528232 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd880f-2f06-4b59-a5ca-4a8d9ffbc02b None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:48.529052 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd880f-2f06-4b59-a5ca-4a8d9ffbc02b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:48.529405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd880f-2f06-4b59-a5ca-4a8d9ffbc02b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:48.530871 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd880f-2f06-4b59-a5ca-4a8d9ffbc02b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:48.543867 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 608/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:48.549993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cc419-b35e-4f71-9902-e05715603098 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:48.655043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:48.662250 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cc419-b35e-4f71-9902-e05715603098 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:48.699600 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de41b83-8e30-4a20-aaa4-6a923b5d557f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:48.700587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de41b83-8e30-4a20-aaa4-6a923b5d557f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:48.700880 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de41b83-8e30-4a20-aaa4-6a923b5d557f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:48.701159 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de41b83-8e30-4a20-aaa4-6a923b5d557f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:48.710708 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de41b83-8e30-4a20-aaa4-6a923b5d557f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:48.712436 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de41b83-8e30-4a20-aaa4-6a923b5d557f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:48.730017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-1de41b83-8e30-4a20-aaa4-6a923b5d557f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 10:59:48.730017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:48.730017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:48.730017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:48.730017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:48.730017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:48.730017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:48.730017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:48.730017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:48.730017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:48.730017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:48.730017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:48.730017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:59:48.730017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:59:48.730017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:59:48.730017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:48.731486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:48.732425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:48.732425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:48.732425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:59:48.732425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:59:48.732425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:59:48.732425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:59:48.732425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:59:48.732425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:59:48.732425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 10:59:48.732425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:59:48.732425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 618/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:59:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:59:48.737289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd880f-2f06-4b59-a5ca-4a8d9ffbc02b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:48.786825 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:48.847614 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd880f-2f06-4b59-a5ca-4a8d9ffbc02b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:48.884889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2089df5-d6ae-4fee-bd17-b93a7dd2ce3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:48.885719 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2089df5-d6ae-4fee-bd17-b93a7dd2ce3f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:48.886002 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2089df5-d6ae-4fee-bd17-b93a7dd2ce3f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:48.886274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2089df5-d6ae-4fee-bd17-b93a7dd2ce3f None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:48.887347 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2089df5-d6ae-4fee-bd17-b93a7dd2ce3f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:48.887649 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2089df5-d6ae-4fee-bd17-b93a7dd2ce3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:48.889060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2089df5-d6ae-4fee-bd17-b93a7dd2ce3f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:48.906861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 609/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jun 27 10:59:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:48.913129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de41b83-8e30-4a20-aaa4-6a923b5d557f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:49.037724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de41b83-8e30-4a20-aaa4-6a923b5d557f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:49.071609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49feef4f-bcb6-4de6-8680-5ab3a7e33da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:49.072399 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49feef4f-bcb6-4de6-8680-5ab3a7e33da1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:49.072681 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49feef4f-bcb6-4de6-8680-5ab3a7e33da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:49.072956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49feef4f-bcb6-4de6-8680-5ab3a7e33da1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:49.084279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49feef4f-bcb6-4de6-8680-5ab3a7e33da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:49.085742 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49feef4f-bcb6-4de6-8680-5ab3a7e33da1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:49.103625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-49feef4f-bcb6-4de6-8680-5ab3a7e33da1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:49.103625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:49.103625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:49.103625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:49.103625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:49.103625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:49.103625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:49.103625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:49.103625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:49.103625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:49.103625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:49.103625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:49.103625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:59:49.103625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:59:49.103625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:59:49.104775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:59:49.104775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:49.104775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:49.104775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:49.104775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:49.104775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:49.104775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:49.104775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:49.104775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:49.104775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:49.104775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:49.104775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:49.104775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:49.104775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:49.104775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:49.104775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:49.104775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:49.105915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:59:49.105915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:59:49.105915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:49.105915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:59:49.106724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 619/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:59:49.113347 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2089df5-d6ae-4fee-bd17-b93a7dd2ce3f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:49.218290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2089df5-d6ae-4fee-bd17-b93a7dd2ce3f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:49.220626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:49.255794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f6351-e6a2-4eea-ac34-c1ad31e1a14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:49.256548 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f6351-e6a2-4eea-ac34-c1ad31e1a14e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:49.256827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f6351-e6a2-4eea-ac34-c1ad31e1a14e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:49.257146 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f6351-e6a2-4eea-ac34-c1ad31e1a14e None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:49.257899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f6351-e6a2-4eea-ac34-c1ad31e1a14e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:49.258198 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f6351-e6a2-4eea-ac34-c1ad31e1a14e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:49.259660 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f6351-e6a2-4eea-ac34-c1ad31e1a14e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:49.271601 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 610/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:49.277742 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49feef4f-bcb6-4de6-8680-5ab3a7e33da1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:49.288038 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:49.389183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49feef4f-bcb6-4de6-8680-5ab3a7e33da1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:49.426417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceef8d1-78f4-4a6e-9c10-d0c0ecdf00e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:49.427204 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceef8d1-78f4-4a6e-9c10-d0c0ecdf00e6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:49.427484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceef8d1-78f4-4a6e-9c10-d0c0ecdf00e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:49.427785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceef8d1-78f4-4a6e-9c10-d0c0ecdf00e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:49.434584 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceef8d1-78f4-4a6e-9c10-d0c0ecdf00e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:49.436083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceef8d1-78f4-4a6e-9c10-d0c0ecdf00e6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:49.450437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-1ceef8d1-78f4-4a6e-9c10-d0c0ecdf00e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:59:49.450437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:49.450437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:49.450437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:49.450437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:49.450437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:49.450437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:49.450437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:49.450437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:49.450437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:49.450437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:49.450437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:49.450437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:59:49.450437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:59:49.450437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:59:49.451587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:59:49.451587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:49.451587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:49.451587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:49.451587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:49.451587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:49.451587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:49.451587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:49.451587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:49.451587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:49.451587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:49.451587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:49.451587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:49.451587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:49.451587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:49.451587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:49.451587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:49.452516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:59:49.452516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:59:49.452516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:59:49.452516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:59:49.452516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:59:49.452516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:59:49.452516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:59:49.452516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:59:49.452516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 620/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:59:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:59:49.458440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f6351-e6a2-4eea-ac34-c1ad31e1a14e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:49.571835 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f6351-e6a2-4eea-ac34-c1ad31e1a14e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:49.607474 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d93fe-d4d8-4f4e-baf7-7372b7a666bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:49.608125 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d93fe-d4d8-4f4e-baf7-7372b7a666bc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:49.608407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d93fe-d4d8-4f4e-baf7-7372b7a666bc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:49.608701 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d93fe-d4d8-4f4e-baf7-7372b7a666bc None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:49.609510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d93fe-d4d8-4f4e-baf7-7372b7a666bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:49.609816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d93fe-d4d8-4f4e-baf7-7372b7a666bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:49.611379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d93fe-d4d8-4f4e-baf7-7372b7a666bc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:49.623729 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 611/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:49.629887 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceef8d1-78f4-4a6e-9c10-d0c0ecdf00e6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:49.700652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:49.743429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceef8d1-78f4-4a6e-9c10-d0c0ecdf00e6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:49.779373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd56b59-b0b3-4767-8710-33d99dadc40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:49.780358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd56b59-b0b3-4767-8710-33d99dadc40e None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:49.780682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd56b59-b0b3-4767-8710-33d99dadc40e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:49.781018 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd56b59-b0b3-4767-8710-33d99dadc40e None admin] PATH_INFO: `/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/d8673c91abf14c0b9a237f0499fdf20e/roles/e053e0425eb744e2a3e3316222e208f3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:49.796379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd56b59-b0b3-4767-8710-33d99dadc40e None admin] RBAC: Authorizing `identity:create_grant(project_id=6543a66af8ba48c391ce686f6d82276b, user_id=d8673c91abf14c0b9a237f0499fdf20e, role_id=e053e0425eb744e2a3e3316222e208f3)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:49.797840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd56b59-b0b3-4767-8710-33d99dadc40e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:49.809731 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 621/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 10:59:49 2022] PUT /identity/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/d8673c91abf14c0b9a237f0499fdf20e/roles/e053e0425eb744e2a3e3316222e208f3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 10:59:51.837702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dc66c-1501-4b6e-86b9-f0bf3c59f75a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:51.838294 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dc66c-1501-4b6e-86b9-f0bf3c59f75a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:51.838294 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dc66c-1501-4b6e-86b9-f0bf3c59f75a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:51.839652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 612/1233] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 10:59:51.844952 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f7407-8903-4c78-98fe-49f2d8531711 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:51.845398 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f7407-8903-4c78-98fe-49f2d8531711 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:51.845508 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f7407-8903-4c78-98fe-49f2d8531711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:51.863746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-aa3f7407-8903-4c78-98fe-49f2d8531711 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:59:51.864932 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-aa3f7407-8903-4c78-98fe-49f2d8531711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:59:51.933687 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 622/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:59:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:59:51.958049 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dc66c-1501-4b6e-86b9-f0bf3c59f75a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:51.983916 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:52.065316 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dc66c-1501-4b6e-86b9-f0bf3c59f75a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:52.100248 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844e1db-aaf7-4c3e-bb62-2e24024f64f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:52.100954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844e1db-aaf7-4c3e-bb62-2e24024f64f9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:52.101234 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844e1db-aaf7-4c3e-bb62-2e24024f64f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:52.101540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844e1db-aaf7-4c3e-bb62-2e24024f64f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:52.112092 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844e1db-aaf7-4c3e-bb62-2e24024f64f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:59:52.120226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9844e1db-aaf7-4c3e-bb62-2e24024f64f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:59:52.120226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:52.120226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:52.120226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:52.120226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:52.120226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:52.120226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:52.120226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:52.120226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:52.120226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:52.120226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:52.120226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:52.120226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:59:52.120226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:59:52.120226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:59:52.120226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:59:52.121221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:59:52.121221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:59:52.121221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:59:52.121221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:59:52.121221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:52.121221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:52.121221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:52.121221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:52.121221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:52.121221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:52.121221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:52.121221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:52.121221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:52.121221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:52.121221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:52.121221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:52.122116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:52.122116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:52.122116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:52.122116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:52.122116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:59:52.122116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:59:52.122116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:59:52.122116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:59:52.122116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:59:52.122116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:59:52.122116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 10:59:52.122116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:59:52.122116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 613/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jun 27 10:59:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:59:52.127524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f7407-8903-4c78-98fe-49f2d8531711 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:52.174676 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:52.230962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f7407-8903-4c78-98fe-49f2d8531711 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:52.266308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9a155-5dbc-457b-827c-5cb30e470271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:52.267151 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9a155-5dbc-457b-827c-5cb30e470271 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:52.267568 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9a155-5dbc-457b-827c-5cb30e470271 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:52.267890 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9a155-5dbc-457b-827c-5cb30e470271 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:52.268851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9a155-5dbc-457b-827c-5cb30e470271 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:52.269293 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9a155-5dbc-457b-827c-5cb30e470271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:52.271066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9a155-5dbc-457b-827c-5cb30e470271 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:52.281443 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 623/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jun 27 10:59:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:52.288405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844e1db-aaf7-4c3e-bb62-2e24024f64f9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:52.376932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:52.393207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844e1db-aaf7-4c3e-bb62-2e24024f64f9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:52.430568 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbc7ec-2398-45f3-ba65-a4339815a4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:52.431656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbc7ec-2398-45f3-ba65-a4339815a4bc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:52.432056 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbc7ec-2398-45f3-ba65-a4339815a4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:52.432516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbc7ec-2398-45f3-ba65-a4339815a4bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:52.446318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbc7ec-2398-45f3-ba65-a4339815a4bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:52.448029 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbc7ec-2398-45f3-ba65-a4339815a4bc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:52.466744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-dfcbc7ec-2398-45f3-ba65-a4339815a4bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:52.466744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:52.466744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:52.466744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:52.466744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:52.466744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:52.466744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:52.466744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:52.466744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:52.466744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:52.466744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:52.466744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:52.466744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:59:52.466744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:59:52.466744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:59:52.467873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:59:52.467873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:52.467873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:52.467873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:52.467873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:52.467873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:52.467873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:52.467873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:52.467873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:52.467873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:52.467873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:52.467873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:52.467873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:52.467873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:52.467873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:52.467873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:52.467873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:52.468982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:59:52.468982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:59:52.468982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:52.468982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:59:52.468982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 614/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:59:52.474213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9a155-5dbc-457b-827c-5cb30e470271 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:52.583300 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9a155-5dbc-457b-827c-5cb30e470271 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:52.593539 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:52.620191 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2c639-cd05-4961-b2ba-7a70af51f449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:52.620850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c639-cd05-4961-b2ba-7a70af51f449 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:52.621125 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c639-cd05-4961-b2ba-7a70af51f449 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:52.621449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c639-cd05-4961-b2ba-7a70af51f449 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:52.622137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2c639-cd05-4961-b2ba-7a70af51f449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:52.622510 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2c639-cd05-4961-b2ba-7a70af51f449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:52.623907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2c639-cd05-4961-b2ba-7a70af51f449 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:52.636053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 624/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:52.641650 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbc7ec-2398-45f3-ba65-a4339815a4bc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:52.754830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbc7ec-2398-45f3-ba65-a4339815a4bc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:52.795552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741df97-a13d-4a27-940c-3171bcd5a0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:52.796348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741df97-a13d-4a27-940c-3171bcd5a0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:52.796628 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741df97-a13d-4a27-940c-3171bcd5a0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:52.796901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741df97-a13d-4a27-940c-3171bcd5a0c5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:52.799723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:52.805418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741df97-a13d-4a27-940c-3171bcd5a0c5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:52.806872 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741df97-a13d-4a27-940c-3171bcd5a0c5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:52.821389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-4741df97-a13d-4a27-940c-3171bcd5a0c5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 10:59:52.821389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:52.821389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:52.821389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:52.821389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:52.821389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:52.821389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:52.821389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:52.821389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:52.821389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:52.821389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:52.821389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:52.821389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:59:52.821389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:59:52.821389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:59:52.821389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:52.822806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:52.823951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:52.823951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:52.823951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:59:52.823951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:59:52.823951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:59:52.823951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:59:52.823951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:59:52.823951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:59:52.823951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 10:59:52.823951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:59:52.823951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 615/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:59:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:59:52.828393 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2c639-cd05-4961-b2ba-7a70af51f449 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:52.929116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2c639-cd05-4961-b2ba-7a70af51f449 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:52.962586 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6357228-67c6-4a57-9b76-11114bb8151b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:52.963255 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6357228-67c6-4a57-9b76-11114bb8151b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:52.963517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6357228-67c6-4a57-9b76-11114bb8151b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:52.963784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6357228-67c6-4a57-9b76-11114bb8151b None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:52.964611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6357228-67c6-4a57-9b76-11114bb8151b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:52.964913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6357228-67c6-4a57-9b76-11114bb8151b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:52.966348 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6357228-67c6-4a57-9b76-11114bb8151b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:52.988555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 625/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jun 27 10:59:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:52.994621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741df97-a13d-4a27-940c-3171bcd5a0c5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:53.112786 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741df97-a13d-4a27-940c-3171bcd5a0c5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:53.149999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa8fde-ce88-412e-83ec-9914bd564615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:53.150855 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa8fde-ce88-412e-83ec-9914bd564615 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:53.151181 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa8fde-ce88-412e-83ec-9914bd564615 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:53.151507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa8fde-ce88-412e-83ec-9914bd564615 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:53.220534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:53.227920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa8fde-ce88-412e-83ec-9914bd564615 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:53.229442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa8fde-ce88-412e-83ec-9914bd564615 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:53.341812 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 616/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:59:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:59:53.349167 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6357228-67c6-4a57-9b76-11114bb8151b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:53.384664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:53.461971 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6357228-67c6-4a57-9b76-11114bb8151b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:53.499336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867089d-26f3-47d4-b198-79f51252970f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:53.500166 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867089d-26f3-47d4-b198-79f51252970f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:53.500415 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867089d-26f3-47d4-b198-79f51252970f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:53.500692 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867089d-26f3-47d4-b198-79f51252970f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:53.512818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867089d-26f3-47d4-b198-79f51252970f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:53.514315 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867089d-26f3-47d4-b198-79f51252970f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:53.532392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-1867089d-26f3-47d4-b198-79f51252970f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:53.532392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:53.532392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:53.532392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:53.532392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:53.532392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:53.532392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:53.532392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:53.532392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:53.532392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:53.532392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:53.532392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:53.532392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:59:53.532392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:59:53.532392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:59:53.533698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:59:53.533698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:53.533698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:53.533698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:53.533698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:53.533698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:53.533698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:53.533698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:53.533698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:53.533698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:53.533698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:53.533698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:53.533698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:53.533698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:53.533698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:53.533698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:53.533698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:53.534963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:59:53.534963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:59:53.534963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:53.534963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:59:53.534963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 626/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:59:53.539768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa8fde-ce88-412e-83ec-9914bd564615 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:53.636824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:53.643472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa8fde-ce88-412e-83ec-9914bd564615 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:53.680400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4abc6-bd1e-4eb0-b669-892273b4579a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:53.681065 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4abc6-bd1e-4eb0-b669-892273b4579a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:53.681349 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4abc6-bd1e-4eb0-b669-892273b4579a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:53.681657 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4abc6-bd1e-4eb0-b669-892273b4579a None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:53.682384 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4abc6-bd1e-4eb0-b669-892273b4579a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:53.682691 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4abc6-bd1e-4eb0-b669-892273b4579a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:53.684087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4abc6-bd1e-4eb0-b669-892273b4579a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:53.697106 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 617/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:53.703210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867089d-26f3-47d4-b198-79f51252970f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:53.782921 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:53.804829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867089d-26f3-47d4-b198-79f51252970f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:53.842129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751a705-a2ce-4c81-b239-6fb27ae1bf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:53.843130 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751a705-a2ce-4c81-b239-6fb27ae1bf9d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:53.843555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751a705-a2ce-4c81-b239-6fb27ae1bf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:53.843930 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751a705-a2ce-4c81-b239-6fb27ae1bf9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:53.853722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751a705-a2ce-4c81-b239-6fb27ae1bf9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:53.855183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751a705-a2ce-4c81-b239-6fb27ae1bf9d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:53.869183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a751a705-a2ce-4c81-b239-6fb27ae1bf9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:59:53.869183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:53.869183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:53.869183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:53.869183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:53.869183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:53.869183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:53.869183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:53.869183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:53.869183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:53.869183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:53.869183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:53.869183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:59:53.869183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:59:53.869183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:59:53.870113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:59:53.870113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:53.870113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:53.870113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:53.870113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:53.870113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:53.870113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:53.870113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:53.870113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:53.870113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:53.870113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:53.870113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:53.870113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:53.870113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:53.870113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:53.870113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:53.870113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:53.871253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:59:53.871253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:59:53.871253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:59:53.871253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:59:53.871253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:59:53.871253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:59:53.871253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:59:53.871253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:59:53.871253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 627/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:59:53.877160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4abc6-bd1e-4eb0-b669-892273b4579a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:54.001443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4abc6-bd1e-4eb0-b669-892273b4579a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:54.045175 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f36e8-2756-4f96-b5c3-b307a14a4543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:54.045914 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f36e8-2756-4f96-b5c3-b307a14a4543 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:54.046202 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f36e8-2756-4f96-b5c3-b307a14a4543 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:54.046485 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f36e8-2756-4f96-b5c3-b307a14a4543 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:54.047318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f36e8-2756-4f96-b5c3-b307a14a4543 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:54.047652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f36e8-2756-4f96-b5c3-b307a14a4543 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:54.049255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f36e8-2756-4f96-b5c3-b307a14a4543 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:54.064567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 618/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:54.070622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751a705-a2ce-4c81-b239-6fb27ae1bf9d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:54.194177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751a705-a2ce-4c81-b239-6fb27ae1bf9d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:54.236856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ed8f6-4952-40b6-a861-3e664b13269b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:54.237642 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ed8f6-4952-40b6-a861-3e664b13269b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:54.237947 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ed8f6-4952-40b6-a861-3e664b13269b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:54.238218 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ed8f6-4952-40b6-a861-3e664b13269b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:54.239159 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ed8f6-4952-40b6-a861-3e664b13269b None admin] RBAC: Adding query filter params (role.id=e053e0425eb744e2a3e3316222e208f3, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=d8673c91abf14c0b9a237f0499fdf20e) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:54.239505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ed8f6-4952-40b6-a861-3e664b13269b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:54.241164 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ed8f6-4952-40b6-a861-3e664b13269b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:54.248083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 628/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:59:54 2022] GET /identity/v3/role_assignments?user.id=d8673c91abf14c0b9a237f0499fdf20e&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=e053e0425eb744e2a3e3316222e208f3 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:56.473275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c543a-ddf7-435b-ad76-d7cf6c051fa3 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:56.473804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c543a-ddf7-435b-ad76-d7cf6c051fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:56.473804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c543a-ddf7-435b-ad76-d7cf6c051fa3 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:56.475145 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 619/1247] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 10:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 10:59:56.480618 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2909424-4d68-407f-9e08-15bf1862129d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:56.481063 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2909424-4d68-407f-9e08-15bf1862129d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:56.481183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2909424-4d68-407f-9e08-15bf1862129d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:56.486374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:56.499572 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c2909424-4d68-407f-9e08-15bf1862129d None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 10:59:56.500757 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c2909424-4d68-407f-9e08-15bf1862129d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 10:59:56.577148 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 629/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 10:59:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 10:59:56.602586 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c543a-ddf7-435b-ad76-d7cf6c051fa3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:56.624827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:56.714745 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c543a-ddf7-435b-ad76-d7cf6c051fa3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:56.753415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d0b8d-6d53-493c-9df8-8d392d0764ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:56.754142 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d0b8d-6d53-493c-9df8-8d392d0764ad None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:56.754503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d0b8d-6d53-493c-9df8-8d392d0764ad None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:56.754783 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d0b8d-6d53-493c-9df8-8d392d0764ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:56.766666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d0b8d-6d53-493c-9df8-8d392d0764ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 10:59:56.775158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e50d0b8d-6d53-493c-9df8-8d392d0764ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:59:56.775158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:56.775158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:56.775158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:56.775158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:56.775158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:56.775158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:56.775158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:56.775158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:56.775158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:56.775158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:56.775158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:56.775158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 10:59:56.775158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 10:59:56.775158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 10:59:56.775158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 10:59:56.776562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 10:59:56.776562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 10:59:56.776562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 10:59:56.776562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 10:59:56.776562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:56.776562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:56.776562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:56.776562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:56.776562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:56.776562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:56.776562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:56.776562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:56.776562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:56.776562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:56.776562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:56.776562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:56.777521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:56.777521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:56.777521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:56.777521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:56.777521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 10:59:56.777521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 10:59:56.777521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 10:59:56.777521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 10:59:56.777521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 10:59:56.777521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 10:59:56.777521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 10:59:56.777521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:59:56.777521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 620/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 10:59:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:59:56.783109 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2909424-4d68-407f-9e08-15bf1862129d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:56.897391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2909424-4d68-407f-9e08-15bf1862129d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:56.931993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:56.937975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb59331-2683-4c95-9292-dea33ad28223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:56.938676 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59331-2683-4c95-9292-dea33ad28223 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:56.938965 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59331-2683-4c95-9292-dea33ad28223 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:56.939248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59331-2683-4c95-9292-dea33ad28223 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:56.940041 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb59331-2683-4c95-9292-dea33ad28223 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:56.940382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb59331-2683-4c95-9292-dea33ad28223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:56.941956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb59331-2683-4c95-9292-dea33ad28223 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:56.956153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 630/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 10:59:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:56.957442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d0b8d-6d53-493c-9df8-8d392d0764ad None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:57.051476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:57.078769 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d0b8d-6d53-493c-9df8-8d392d0764ad None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:57.117295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59298d2a-2a79-4ed9-8335-092329651380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:57.118117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59298d2a-2a79-4ed9-8335-092329651380 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:57.118404 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59298d2a-2a79-4ed9-8335-092329651380 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:57.118692 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59298d2a-2a79-4ed9-8335-092329651380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:57.129359 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59298d2a-2a79-4ed9-8335-092329651380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:57.130849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59298d2a-2a79-4ed9-8335-092329651380 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:57.148634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-59298d2a-2a79-4ed9-8335-092329651380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:57.148634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:57.148634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:57.148634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:57.148634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:57.148634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:57.148634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:57.148634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:57.148634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:57.148634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:57.148634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:57.148634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:57.148634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:59:57.148634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:59:57.148634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:59:57.150055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:59:57.150055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:57.150055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:57.150055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:57.150055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:57.150055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:57.150055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:57.150055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:57.150055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:57.150055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:57.150055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:57.150055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:57.150055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:57.150055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:57.150055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:57.150055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:57.150055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:57.151290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:59:57.151290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:59:57.151290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:57.151290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:59:57.151290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 621/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:59:57.156815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb59331-2683-4c95-9292-dea33ad28223 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:57.276697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb59331-2683-4c95-9292-dea33ad28223 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:57.314073 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3db0a-7d8d-4f26-a613-b9ce923c802b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:57.314713 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3db0a-7d8d-4f26-a613-b9ce923c802b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:57.314996 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3db0a-7d8d-4f26-a613-b9ce923c802b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:57.315344 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3db0a-7d8d-4f26-a613-b9ce923c802b None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:57.316206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3db0a-7d8d-4f26-a613-b9ce923c802b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:57.316524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3db0a-7d8d-4f26-a613-b9ce923c802b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:57.318281 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3db0a-7d8d-4f26-a613-b9ce923c802b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:57.332263 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 631/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:59:57.338197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59298d2a-2a79-4ed9-8335-092329651380 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:57.465701 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59298d2a-2a79-4ed9-8335-092329651380 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:57.494873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:57.503581 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1beef-b516-46ed-8442-05d6b6066ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:57.504392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1beef-b516-46ed-8442-05d6b6066ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:57.504679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1beef-b516-46ed-8442-05d6b6066ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:57.504955 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1beef-b516-46ed-8442-05d6b6066ae3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:57.513942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1beef-b516-46ed-8442-05d6b6066ae3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:57.515401 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1beef-b516-46ed-8442-05d6b6066ae3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:57.530902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-caf1beef-b516-46ed-8442-05d6b6066ae3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 10:59:57.530902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:57.530902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:57.530902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:57.530902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:57.530902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:57.530902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:57.530902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:57.530902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:57.530902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:57.530902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:57.530902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:57.530902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 10:59:57.530902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 10:59:57.530902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 10:59:57.530902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:57.532306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:57.533532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:57.533532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:57.533532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 10:59:57.533532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 10:59:57.533532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 10:59:57.533532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 10:59:57.533532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 10:59:57.533532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 10:59:57.533532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 10:59:57.533532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 10:59:57.533532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 622/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:59:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:59:57.537992 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3db0a-7d8d-4f26-a613-b9ce923c802b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:57.599953 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:57.650872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3db0a-7d8d-4f26-a613-b9ce923c802b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:57.689937 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5e194-0023-4b3c-888a-13cb8abf84ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:57.691045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5e194-0023-4b3c-888a-13cb8abf84ff None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:57.691380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5e194-0023-4b3c-888a-13cb8abf84ff None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:57.691775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5e194-0023-4b3c-888a-13cb8abf84ff None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:57.692570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5e194-0023-4b3c-888a-13cb8abf84ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:57.692870 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5e194-0023-4b3c-888a-13cb8abf84ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:57.694321 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5e194-0023-4b3c-888a-13cb8abf84ff None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:57.714527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 632/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jun 27 10:59:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 10:59:57.720350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1beef-b516-46ed-8442-05d6b6066ae3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:57.833053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1beef-b516-46ed-8442-05d6b6066ae3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:57.877487 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a412247-8282-45a8-aa3c-98e72c1d6a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:57.878095 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412247-8282-45a8-aa3c-98e72c1d6a6b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:57.878924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412247-8282-45a8-aa3c-98e72c1d6a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:57.879178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412247-8282-45a8-aa3c-98e72c1d6a6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:57.947979 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:57.964420 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a412247-8282-45a8-aa3c-98e72c1d6a6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:57.966344 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a412247-8282-45a8-aa3c-98e72c1d6a6b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:58.102485 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 623/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 10:59:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 10:59:58.108540 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5e194-0023-4b3c-888a-13cb8abf84ff None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:58.239351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5e194-0023-4b3c-888a-13cb8abf84ff None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:58.253239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:58.275940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49034c22-4663-4272-b030-2e4841239151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:58.276724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49034c22-4663-4272-b030-2e4841239151 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:58.277021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49034c22-4663-4272-b030-2e4841239151 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:58.277268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49034c22-4663-4272-b030-2e4841239151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:58.288680 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49034c22-4663-4272-b030-2e4841239151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:58.290145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49034c22-4663-4272-b030-2e4841239151 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:58.308177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-49034c22-4663-4272-b030-2e4841239151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:58.308177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:58.308177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:58.308177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:58.308177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:58.308177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:58.308177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:58.308177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:58.308177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:58.308177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:58.308177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:58.308177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:58.308177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 10:59:58.308177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 10:59:58.308177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 10:59:58.309470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 10:59:58.309470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:58.309470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:58.309470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:58.309470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:58.309470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:58.309470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:58.309470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:58.309470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:58.309470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:58.309470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:58.309470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:58.309470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:58.309470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:58.309470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:58.309470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:58.309470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:58.310614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 10:59:58.310614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 10:59:58.310614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 10:59:58.310614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:59:58.310614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 633/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 10:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 10:59:58.315357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a412247-8282-45a8-aa3c-98e72c1d6a6b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:58.423014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:58.440241 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a412247-8282-45a8-aa3c-98e72c1d6a6b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:58.480574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39c02e-182c-42b1-a4f4-965aea68f28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:58.481152 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39c02e-182c-42b1-a4f4-965aea68f28a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:58.481483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39c02e-182c-42b1-a4f4-965aea68f28a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:58.481741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39c02e-182c-42b1-a4f4-965aea68f28a None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:58.482475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39c02e-182c-42b1-a4f4-965aea68f28a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:58.482762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39c02e-182c-42b1-a4f4-965aea68f28a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:58.484149 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39c02e-182c-42b1-a4f4-965aea68f28a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:58.498337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 624/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 10:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:58.505373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49034c22-4663-4272-b030-2e4841239151 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:58.615758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49034c22-4663-4272-b030-2e4841239151 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:58.657079 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8413f5d-81b5-4def-85d6-5d28a6a18146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:58.657948 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8413f5d-81b5-4def-85d6-5d28a6a18146 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:58.658251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8413f5d-81b5-4def-85d6-5d28a6a18146 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:58.658552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8413f5d-81b5-4def-85d6-5d28a6a18146 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:58.666571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8413f5d-81b5-4def-85d6-5d28a6a18146 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:58.667993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8413f5d-81b5-4def-85d6-5d28a6a18146 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:58.681782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-b8413f5d-81b5-4def-85d6-5d28a6a18146 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:59:58.681782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 10:59:58.681782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 10:59:58.681782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 10:59:58.681782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 10:59:58.681782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 10:59:58.681782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 10:59:58.681782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 10:59:58.681782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 10:59:58.681782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 10:59:58.681782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 10:59:58.681782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 10:59:58.681782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 10:59:58.681782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 10:59:58.681782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 10:59:58.682904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 10:59:58.682904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 10:59:58.682904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 10:59:58.682904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 10:59:58.682904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 10:59:58.682904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 10:59:58.682904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 10:59:58.682904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 10:59:58.682904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 10:59:58.682904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 10:59:58.682904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 10:59:58.682904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 10:59:58.682904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 10:59:58.682904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 10:59:58.682904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 10:59:58.682904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 10:59:58.682904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 10:59:58.684039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 10:59:58.684039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 10:59:58.684039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 10:59:58.684039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 10:59:58.684039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 10:59:58.684039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 10:59:58.684039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 10:59:58.684039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 10:59:58.684039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 634/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 10:59:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 10:59:58.688762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39c02e-182c-42b1-a4f4-965aea68f28a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:58.790902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39c02e-182c-42b1-a4f4-965aea68f28a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:58.824713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a754c1f-2fd7-41cc-95b1-374d5da82807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:58.825402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a754c1f-2fd7-41cc-95b1-374d5da82807 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:58.825709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a754c1f-2fd7-41cc-95b1-374d5da82807 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:58.825993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a754c1f-2fd7-41cc-95b1-374d5da82807 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:58.826770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a754c1f-2fd7-41cc-95b1-374d5da82807 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:58.827079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a754c1f-2fd7-41cc-95b1-374d5da82807 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:58.828540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a754c1f-2fd7-41cc-95b1-374d5da82807 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:58.843603 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 625/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 10:59:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 10:59:58.850248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8413f5d-81b5-4def-85d6-5d28a6a18146 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 10:59:58.877039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 10:59:58.957966 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8413f5d-81b5-4def-85d6-5d28a6a18146 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 10:59:58.995437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561a2b2-fdcf-4970-b778-2b5539e412d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 10:59:58.996386 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561a2b2-fdcf-4970-b778-2b5539e412d9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 10:59:58.996870 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561a2b2-fdcf-4970-b778-2b5539e412d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 10:59:58.997215 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561a2b2-fdcf-4970-b778-2b5539e412d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 10:59:58.998157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561a2b2-fdcf-4970-b778-2b5539e412d9 None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=d8673c91abf14c0b9a237f0499fdf20e) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 10:59:58.998474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561a2b2-fdcf-4970-b778-2b5539e412d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 10:59:59.000026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561a2b2-fdcf-4970-b778-2b5539e412d9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 10:59:59.007307 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 635/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 10:59:58 2022] GET /identity/v3/role_assignments?user.id=d8673c91abf14c0b9a237f0499fdf20e&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:00:01.003926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f8f92-ba6a-437c-b069-b71a6932d032 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:01.004478 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f8f92-ba6a-437c-b069-b71a6932d032 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:01.004567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f8f92-ba6a-437c-b069-b71a6932d032 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:01.006108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 626/1261] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:00:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 11:00:01.012010 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2d942-eaf7-4121-b275-ba73e30f98a8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:01.012566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2d942-eaf7-4121-b275-ba73e30f98a8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:01.012566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2d942-eaf7-4121-b275-ba73e30f98a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:01.029190 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-30b2d942-eaf7-4121-b275-ba73e30f98a8 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:00:01.030393 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-30b2d942-eaf7-4121-b275-ba73e30f98a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:00:01.093007 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 636/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:00:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 11:00:01.116227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f8f92-ba6a-437c-b069-b71a6932d032 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:01.126919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:01.215829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f8f92-ba6a-437c-b069-b71a6932d032 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:01.248828 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262d96e-13e0-4c85-98ae-a2af38224fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:01.249632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262d96e-13e0-4c85-98ae-a2af38224fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:01.249923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262d96e-13e0-4c85-98ae-a2af38224fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:01.250216 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262d96e-13e0-4c85-98ae-a2af38224fd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:01.260009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262d96e-13e0-4c85-98ae-a2af38224fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 11:00:01.267722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c262d96e-13e0-4c85-98ae-a2af38224fd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 11:00:01.267722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 11:00:01.267722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 11:00:01.267722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 11:00:01.267722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 11:00:01.267722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 11:00:01.267722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 11:00:01.267722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 11:00:01.267722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 11:00:01.267722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 11:00:01.267722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 11:00:01.267722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 11:00:01.267722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 11:00:01.267722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 11:00:01.267722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 11:00:01.267722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 11:00:01.268817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 11:00:01.268817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 11:00:01.268817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 11:00:01.268817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 11:00:01.268817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 11:00:01.268817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 11:00:01.268817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 11:00:01.268817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 11:00:01.268817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 11:00:01.268817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 11:00:01.268817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 11:00:01.268817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 11:00:01.268817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 11:00:01.268817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 11:00:01.268817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 11:00:01.268817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 11:00:01.269899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 11:00:01.269899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 11:00:01.269899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 11:00:01.269899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 11:00:01.269899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 11:00:01.269899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 11:00:01.269899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 11:00:01.269899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 11:00:01.269899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 11:00:01.269899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 11:00:01.269899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 11:00:01.269899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 11:00:01.269899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 627/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 11:00:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 11:00:01.274942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2d942-eaf7-4121-b275-ba73e30f98a8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:01.292846 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:01.370113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2d942-eaf7-4121-b275-ba73e30f98a8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:01.402274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79132966-29f1-4143-ad01-d150885510ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:01.402917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79132966-29f1-4143-ad01-d150885510ae None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:01.403194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79132966-29f1-4143-ad01-d150885510ae None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:01.403471 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79132966-29f1-4143-ad01-d150885510ae None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:01.404198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79132966-29f1-4143-ad01-d150885510ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:00:01.404576 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79132966-29f1-4143-ad01-d150885510ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:01.405950 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79132966-29f1-4143-ad01-d150885510ae None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:01.414483 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 637/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 11:00:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:00:01.420130 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262d96e-13e0-4c85-98ae-a2af38224fd3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:01.485516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:01.519113 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262d96e-13e0-4c85-98ae-a2af38224fd3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:01.552141 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3361afb-9b64-4a32-a472-d1d471e2288b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:01.552913 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3361afb-9b64-4a32-a472-d1d471e2288b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:01.553194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3361afb-9b64-4a32-a472-d1d471e2288b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:01.553493 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3361afb-9b64-4a32-a472-d1d471e2288b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:01.563570 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3361afb-9b64-4a32-a472-d1d471e2288b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:01.564999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3361afb-9b64-4a32-a472-d1d471e2288b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:01.582048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a3361afb-9b64-4a32-a472-d1d471e2288b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 11:00:01.582048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 11:00:01.582048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 11:00:01.582048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 11:00:01.582048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 11:00:01.582048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 11:00:01.582048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 11:00:01.582048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 11:00:01.582048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 11:00:01.582048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 11:00:01.582048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 11:00:01.582048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 11:00:01.582048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 11:00:01.582048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 11:00:01.582048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 11:00:01.583053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 11:00:01.583053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 11:00:01.583053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 11:00:01.583053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 11:00:01.583053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 11:00:01.583053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 11:00:01.583053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 11:00:01.583053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 11:00:01.583053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 11:00:01.583053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 11:00:01.583053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 11:00:01.583053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 11:00:01.583053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 11:00:01.583053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 11:00:01.583053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 11:00:01.583053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 11:00:01.583053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 11:00:01.584153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 11:00:01.584153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 11:00:01.584153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 11:00:01.584153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 11:00:01.584153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 628/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 11:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 11:00:01.588957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79132966-29f1-4143-ad01-d150885510ae None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:01.666782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:01.685179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79132966-29f1-4143-ad01-d150885510ae None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:01.723157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47cac1-460f-4f2f-b7c8-4f6ee6e72a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:01.723157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47cac1-460f-4f2f-b7c8-4f6ee6e72a7a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:01.723157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47cac1-460f-4f2f-b7c8-4f6ee6e72a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:01.723157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47cac1-460f-4f2f-b7c8-4f6ee6e72a7a None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:01.723548 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47cac1-460f-4f2f-b7c8-4f6ee6e72a7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:00:01.723548 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47cac1-460f-4f2f-b7c8-4f6ee6e72a7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:01.723548 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47cac1-460f-4f2f-b7c8-4f6ee6e72a7a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:01.733933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 638/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 11:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:00:01.739501 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3361afb-9b64-4a32-a472-d1d471e2288b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:01.836210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3361afb-9b64-4a32-a472-d1d471e2288b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:01.855503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:01.869315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e136e-10d3-4102-971e-f6c89e971f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:01.870133 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e136e-10d3-4102-971e-f6c89e971f6d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:01.870418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e136e-10d3-4102-971e-f6c89e971f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:01.870694 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e136e-10d3-4102-971e-f6c89e971f6d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:01.877914 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e136e-10d3-4102-971e-f6c89e971f6d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:01.879368 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e136e-10d3-4102-971e-f6c89e971f6d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:01.893488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-804e136e-10d3-4102-971e-f6c89e971f6d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 11:00:01.893488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 11:00:01.893488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 11:00:01.893488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 11:00:01.893488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 11:00:01.893488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 11:00:01.893488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 11:00:01.893488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 11:00:01.893488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 11:00:01.893488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 11:00:01.893488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 11:00:01.893488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 11:00:01.893488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 11:00:01.893488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 11:00:01.893488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 11:00:01.893488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 11:00:01.895060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 11:00:01.896289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 11:00:01.896289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 11:00:01.896289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 11:00:01.896289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 11:00:01.896289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 11:00:01.896289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 11:00:01.896289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 11:00:01.896289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 11:00:01.896289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 11:00:01.896289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 11:00:01.896289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 629/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 11:00:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 11:00:01.900817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47cac1-460f-4f2f-b7c8-4f6ee6e72a7a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:01.997495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47cac1-460f-4f2f-b7c8-4f6ee6e72a7a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:02.037303 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0662a0-c89e-4887-988a-b8ee00b7c55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:02.038112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0662a0-c89e-4887-988a-b8ee00b7c55b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:02.038371 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0662a0-c89e-4887-988a-b8ee00b7c55b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:02.038652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0662a0-c89e-4887-988a-b8ee00b7c55b None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:02.039550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0662a0-c89e-4887-988a-b8ee00b7c55b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:00:02.039885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0662a0-c89e-4887-988a-b8ee00b7c55b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:02.041449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0662a0-c89e-4887-988a-b8ee00b7c55b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:02.050387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:02.058791 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 639/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jun 27 11:00:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:00:02.064436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e136e-10d3-4102-971e-f6c89e971f6d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:02.161481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e136e-10d3-4102-971e-f6c89e971f6d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:02.195327 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a30f4-8d5a-449e-af2f-fb8be8db263e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:02.196103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a30f4-8d5a-449e-af2f-fb8be8db263e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:02.196386 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a30f4-8d5a-449e-af2f-fb8be8db263e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:02.196662 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a30f4-8d5a-449e-af2f-fb8be8db263e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:02.209002 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a30f4-8d5a-449e-af2f-fb8be8db263e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:02.210470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a30f4-8d5a-449e-af2f-fb8be8db263e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:02.226950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-568a30f4-8d5a-449e-af2f-fb8be8db263e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 11:00:02.226950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 11:00:02.226950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 11:00:02.226950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 11:00:02.226950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 11:00:02.226950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 11:00:02.226950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 11:00:02.226950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 11:00:02.226950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 11:00:02.226950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 11:00:02.226950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 11:00:02.226950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 11:00:02.226950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 11:00:02.226950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 11:00:02.226950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 11:00:02.227960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 11:00:02.227960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 11:00:02.227960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 11:00:02.227960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 11:00:02.227960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 11:00:02.227960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 11:00:02.227960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 11:00:02.227960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 11:00:02.227960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 11:00:02.227960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 11:00:02.227960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 11:00:02.227960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 11:00:02.227960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 11:00:02.227960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 11:00:02.227960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 11:00:02.227960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 11:00:02.227960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 11:00:02.229224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 11:00:02.229224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 11:00:02.229224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 11:00:02.229224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 11:00:02.229224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 630/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 11:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 11:00:02.233691 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0662a0-c89e-4887-988a-b8ee00b7c55b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:02.328722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0662a0-c89e-4887-988a-b8ee00b7c55b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:02.360333 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6b0cf-0be0-4fbc-99f5-d41c43ce9237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:02.360975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6b0cf-0be0-4fbc-99f5-d41c43ce9237 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:02.361257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6b0cf-0be0-4fbc-99f5-d41c43ce9237 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:02.361570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6b0cf-0be0-4fbc-99f5-d41c43ce9237 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:02.362757 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6b0cf-0be0-4fbc-99f5-d41c43ce9237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:00:02.363074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6b0cf-0be0-4fbc-99f5-d41c43ce9237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:02.364423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6b0cf-0be0-4fbc-99f5-d41c43ce9237 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:02.375115 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 640/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 11:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:00:02.381204 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a30f4-8d5a-449e-af2f-fb8be8db263e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:02.411699 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:02.478336 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a30f4-8d5a-449e-af2f-fb8be8db263e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:02.511738 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e889ce9-d3a4-4870-92c3-ade7f4af9482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:02.512507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e889ce9-d3a4-4870-92c3-ade7f4af9482 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:02.512795 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e889ce9-d3a4-4870-92c3-ade7f4af9482 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:02.513071 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e889ce9-d3a4-4870-92c3-ade7f4af9482 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:02.520563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e889ce9-d3a4-4870-92c3-ade7f4af9482 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:02.522034 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e889ce9-d3a4-4870-92c3-ade7f4af9482 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:02.535965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5e889ce9-d3a4-4870-92c3-ade7f4af9482 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 11:00:02.535965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 11:00:02.535965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 11:00:02.535965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 11:00:02.535965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 11:00:02.535965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 11:00:02.535965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 11:00:02.535965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 11:00:02.535965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 11:00:02.535965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 11:00:02.535965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 11:00:02.535965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 11:00:02.535965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 11:00:02.535965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 11:00:02.535965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 11:00:02.536980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 11:00:02.536980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 11:00:02.536980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 11:00:02.536980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 11:00:02.536980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 11:00:02.536980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 11:00:02.536980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 11:00:02.536980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 11:00:02.536980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 11:00:02.536980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 11:00:02.536980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 11:00:02.536980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 11:00:02.536980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 11:00:02.536980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 11:00:02.536980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 11:00:02.536980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 11:00:02.536980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 11:00:02.538119 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 11:00:02.538119 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 11:00:02.538119 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 11:00:02.538119 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 11:00:02.538119 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 11:00:02.538119 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 11:00:02.538119 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 11:00:02.538119 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 11:00:02.538119 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 631/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 11:00:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 11:00:02.542861 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6b0cf-0be0-4fbc-99f5-d41c43ce9237 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:02.598982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:02.639844 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6b0cf-0be0-4fbc-99f5-d41c43ce9237 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:02.671838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21600bce-042d-413d-a3e2-02eb963fe29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:02.672417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21600bce-042d-413d-a3e2-02eb963fe29e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:02.672696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21600bce-042d-413d-a3e2-02eb963fe29e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:02.672968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21600bce-042d-413d-a3e2-02eb963fe29e None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:02.673770 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21600bce-042d-413d-a3e2-02eb963fe29e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:00:02.674076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21600bce-042d-413d-a3e2-02eb963fe29e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:02.676074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21600bce-042d-413d-a3e2-02eb963fe29e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:02.687432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 641/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 11:00:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:00:02.693120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e889ce9-d3a4-4870-92c3-ade7f4af9482 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:02.780769 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:02.790302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e889ce9-d3a4-4870-92c3-ade7f4af9482 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:02.823730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13968c7d-0122-4427-a802-71d5a1bfa3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:02.824589 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13968c7d-0122-4427-a802-71d5a1bfa3c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:02.824872 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13968c7d-0122-4427-a802-71d5a1bfa3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:02.825149 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13968c7d-0122-4427-a802-71d5a1bfa3c2 None admin] PATH_INFO: `/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/d8673c91abf14c0b9a237f0499fdf20e/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:02.827106 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13968c7d-0122-4427-a802-71d5a1bfa3c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6543a66af8ba48c391ce686f6d82276b, user_id=d8673c91abf14c0b9a237f0499fdf20e, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:02.828571 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13968c7d-0122-4427-a802-71d5a1bfa3c2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:02.840718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 632/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jun 27 11:00:02 2022] PUT /identity/v3/projects/6543a66af8ba48c391ce686f6d82276b/users/d8673c91abf14c0b9a237f0499fdf20e/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:00:04.812528 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ad093-2db7-421f-95bb-7e0e96086214 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:04.813056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ad093-2db7-421f-95bb-7e0e96086214 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:04.813056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ad093-2db7-421f-95bb-7e0e96086214 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:04.814486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 642/1274] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:00:04.820165 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51952e40-4965-49a2-9271-e35e8683b807 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:04.820580 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51952e40-4965-49a2-9271-e35e8683b807 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:04.820722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51952e40-4965-49a2-9271-e35e8683b807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:04.836987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-51952e40-4965-49a2-9271-e35e8683b807 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:00:04.838181 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-51952e40-4965-49a2-9271-e35e8683b807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:00:04.902403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 633/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:00:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 11:00:04.925639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ad093-2db7-421f-95bb-7e0e96086214 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:05.035163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ad093-2db7-421f-95bb-7e0e96086214 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:05.053277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:05.070187 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084cc2c-cca4-420c-8a82-3e5daced4cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:05.070965 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084cc2c-cca4-420c-8a82-3e5daced4cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:05.071247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084cc2c-cca4-420c-8a82-3e5daced4cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:05.071518 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084cc2c-cca4-420c-8a82-3e5daced4cc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:05.081878 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084cc2c-cca4-420c-8a82-3e5daced4cc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 11:00:05.089418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-b084cc2c-cca4-420c-8a82-3e5daced4cc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 11:00:05.089418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 11:00:05.089418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 11:00:05.089418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 11:00:05.089418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 11:00:05.089418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 11:00:05.089418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 11:00:05.089418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 11:00:05.089418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 11:00:05.089418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 11:00:05.089418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 11:00:05.089418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 11:00:05.089418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 11:00:05.089418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 11:00:05.089418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 11:00:05.089418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 11:00:05.090505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 11:00:05.090505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 11:00:05.090505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 11:00:05.090505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 11:00:05.090505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 11:00:05.090505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 11:00:05.090505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 11:00:05.090505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 11:00:05.090505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 11:00:05.090505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 11:00:05.090505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 11:00:05.090505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 11:00:05.090505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 11:00:05.090505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 11:00:05.090505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 11:00:05.090505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 11:00:05.091707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 11:00:05.091707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 11:00:05.091707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 11:00:05.091707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 11:00:05.091707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 11:00:05.091707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 11:00:05.091707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 11:00:05.091707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 11:00:05.091707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 11:00:05.091707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 11:00:05.091707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 11:00:05.091707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 11:00:05.091707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 643/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jun 27 11:00:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 11:00:05.096538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51952e40-4965-49a2-9271-e35e8683b807 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:05.174966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:05.195846 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51952e40-4965-49a2-9271-e35e8683b807 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:05.228547 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a46693-3124-4690-b39f-8e83313ecbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:05.229203 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a46693-3124-4690-b39f-8e83313ecbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:05.229522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a46693-3124-4690-b39f-8e83313ecbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:05.229800 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a46693-3124-4690-b39f-8e83313ecbe5 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:05.230544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a46693-3124-4690-b39f-8e83313ecbe5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:00:05.230847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a46693-3124-4690-b39f-8e83313ecbe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:05.232206 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a46693-3124-4690-b39f-8e83313ecbe5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:05.240441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 634/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jun 27 11:00:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:00:05.246210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084cc2c-cca4-420c-8a82-3e5daced4cc9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:05.342475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084cc2c-cca4-420c-8a82-3e5daced4cc9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:05.374249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691a262-32cc-4e8d-a8b8-23a1cca607b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:05.375020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691a262-32cc-4e8d-a8b8-23a1cca607b5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:05.375303 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691a262-32cc-4e8d-a8b8-23a1cca607b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:05.375582 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691a262-32cc-4e8d-a8b8-23a1cca607b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:05.386246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691a262-32cc-4e8d-a8b8-23a1cca607b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:05.387922 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691a262-32cc-4e8d-a8b8-23a1cca607b5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:05.404423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f691a262-32cc-4e8d-a8b8-23a1cca607b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 11:00:05.404423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 11:00:05.404423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 11:00:05.404423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 11:00:05.404423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 11:00:05.404423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 11:00:05.404423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 11:00:05.404423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 11:00:05.404423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 11:00:05.404423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 11:00:05.404423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 11:00:05.404423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 11:00:05.404423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 11:00:05.404423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 11:00:05.404423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 11:00:05.405493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 11:00:05.405493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 11:00:05.405493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 11:00:05.405493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 11:00:05.405493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 11:00:05.405493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 11:00:05.405493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 11:00:05.405493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 11:00:05.405493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 11:00:05.405493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 11:00:05.405493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 11:00:05.405493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 11:00:05.405493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 11:00:05.405493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 11:00:05.405493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 11:00:05.405493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 11:00:05.405493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 11:00:05.406609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 11:00:05.406609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 11:00:05.406609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 11:00:05.406609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 11:00:05.406609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 644/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 11:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 11:00:05.411115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a46693-3124-4690-b39f-8e83313ecbe5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:05.507713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a46693-3124-4690-b39f-8e83313ecbe5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:05.540166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8b7c0-a140-472b-b528-0c2184eac533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:05.540817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8b7c0-a140-472b-b528-0c2184eac533 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:05.541103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8b7c0-a140-472b-b528-0c2184eac533 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:05.541399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8b7c0-a140-472b-b528-0c2184eac533 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:05.542115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8b7c0-a140-472b-b528-0c2184eac533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:00:05.542422 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8b7c0-a140-472b-b528-0c2184eac533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:05.543783 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8b7c0-a140-472b-b528-0c2184eac533 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:05.555118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 635/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 11:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:00:05.560778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691a262-32cc-4e8d-a8b8-23a1cca607b5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:05.591812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:05.661261 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691a262-32cc-4e8d-a8b8-23a1cca607b5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:05.693460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d3760-9dba-404b-b0ca-7fd6ddbccc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:05.694245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d3760-9dba-404b-b0ca-7fd6ddbccc28 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:05.694529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d3760-9dba-404b-b0ca-7fd6ddbccc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:05.694805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d3760-9dba-404b-b0ca-7fd6ddbccc28 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:05.701974 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d3760-9dba-404b-b0ca-7fd6ddbccc28 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:05.703397 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d3760-9dba-404b-b0ca-7fd6ddbccc28 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:05.717283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-419d3760-9dba-404b-b0ca-7fd6ddbccc28 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 11:00:05.717283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 11:00:05.717283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 11:00:05.717283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 11:00:05.717283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 11:00:05.717283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 11:00:05.717283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 11:00:05.717283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 11:00:05.717283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 11:00:05.717283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 11:00:05.717283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 11:00:05.717283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 11:00:05.717283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 11:00:05.717283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 11:00:05.717283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 11:00:05.717283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 11:00:05.718470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 11:00:05.724720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 11:00:05.724720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 11:00:05.724720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 11:00:05.724720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 11:00:05.724720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 11:00:05.724720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 11:00:05.724720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 11:00:05.724720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 11:00:05.724720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 11:00:05.724720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 11:00:05.724720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 645/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 11:00:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 11:00:05.725565 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8b7c0-a140-472b-b528-0c2184eac533 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:05.728455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:05.822589 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8b7c0-a140-472b-b528-0c2184eac533 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:05.854973 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f344694-7023-471c-a209-7fdb75bf13b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:05.855628 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f344694-7023-471c-a209-7fdb75bf13b9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:05.855915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f344694-7023-471c-a209-7fdb75bf13b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:05.856197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f344694-7023-471c-a209-7fdb75bf13b9 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:05.857027 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f344694-7023-471c-a209-7fdb75bf13b9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:00:05.857338 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f344694-7023-471c-a209-7fdb75bf13b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:05.858799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f344694-7023-471c-a209-7fdb75bf13b9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:05.875837 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 636/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jun 27 11:00:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:00:05.881288 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d3760-9dba-404b-b0ca-7fd6ddbccc28 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:05.967596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:05.980010 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d3760-9dba-404b-b0ca-7fd6ddbccc28 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:06.021628 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd1983-696e-4509-bab9-53edd161d2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:06.022574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd1983-696e-4509-bab9-53edd161d2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:06.023005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd1983-696e-4509-bab9-53edd161d2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:06.023420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd1983-696e-4509-bab9-53edd161d2d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:06.106765 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd1983-696e-4509-bab9-53edd161d2d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:06.108201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd1983-696e-4509-bab9-53edd161d2d6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:06.192132 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:06.205023 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 646/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jun 27 11:00:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 11:00:06.211144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f344694-7023-471c-a209-7fdb75bf13b9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:06.272286 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:06.309589 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f344694-7023-471c-a209-7fdb75bf13b9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:06.342324 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd680293-d7d5-4c24-94cf-b0441c9e2a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:06.343099 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd680293-d7d5-4c24-94cf-b0441c9e2a93 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:06.343385 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd680293-d7d5-4c24-94cf-b0441c9e2a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:06.343663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd680293-d7d5-4c24-94cf-b0441c9e2a93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:06.355408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd680293-d7d5-4c24-94cf-b0441c9e2a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:06.357739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd680293-d7d5-4c24-94cf-b0441c9e2a93 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:06.384658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-fd680293-d7d5-4c24-94cf-b0441c9e2a93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 11:00:06.384658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 11:00:06.384658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 11:00:06.384658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 11:00:06.384658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 11:00:06.384658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 11:00:06.384658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 11:00:06.384658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 11:00:06.384658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 11:00:06.384658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 11:00:06.384658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 11:00:06.384658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 11:00:06.384658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 11:00:06.384658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 11:00:06.384658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 11:00:06.385804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 11:00:06.385804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 11:00:06.385804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 11:00:06.385804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 11:00:06.385804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 11:00:06.385804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 11:00:06.385804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 11:00:06.385804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 11:00:06.385804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 11:00:06.385804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 11:00:06.385804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 11:00:06.385804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 11:00:06.385804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 11:00:06.385804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 11:00:06.385804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 11:00:06.385804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 11:00:06.385804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 11:00:06.387173 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 11:00:06.387173 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 11:00:06.387173 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 11:00:06.387173 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 11:00:06.387173 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 637/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 11:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 11:00:06.392018 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd1983-696e-4509-bab9-53edd161d2d6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:06.487262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd1983-696e-4509-bab9-53edd161d2d6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:06.520149 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe4d5c-8542-4594-ae39-8bee34e83fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:06.520784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe4d5c-8542-4594-ae39-8bee34e83fcb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:06.521060 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe4d5c-8542-4594-ae39-8bee34e83fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:06.521329 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe4d5c-8542-4594-ae39-8bee34e83fcb None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:06.522061 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe4d5c-8542-4594-ae39-8bee34e83fcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:00:06.522406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe4d5c-8542-4594-ae39-8bee34e83fcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:06.523700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe4d5c-8542-4594-ae39-8bee34e83fcb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:06.534353 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 647/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jun 27 11:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:00:06.539972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd680293-d7d5-4c24-94cf-b0441c9e2a93 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:06.636771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd680293-d7d5-4c24-94cf-b0441c9e2a93 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:06.650825 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:06.670383 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce529cf9-1520-40da-b377-e2bbc139f97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:06.671147 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce529cf9-1520-40da-b377-e2bbc139f97e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:06.671427 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce529cf9-1520-40da-b377-e2bbc139f97e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:06.671700 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce529cf9-1520-40da-b377-e2bbc139f97e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:06.678205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce529cf9-1520-40da-b377-e2bbc139f97e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:06.679643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce529cf9-1520-40da-b377-e2bbc139f97e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:06.693521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ce529cf9-1520-40da-b377-e2bbc139f97e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 11:00:06.693521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 11:00:06.693521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 11:00:06.693521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 11:00:06.693521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 11:00:06.693521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 11:00:06.693521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 11:00:06.693521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 11:00:06.693521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 11:00:06.693521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 11:00:06.693521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 11:00:06.693521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 11:00:06.693521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 11:00:06.693521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 11:00:06.693521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 11:00:06.694562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 11:00:06.694562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 11:00:06.694562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 11:00:06.694562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 11:00:06.694562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 11:00:06.694562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 11:00:06.694562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 11:00:06.694562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 11:00:06.694562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 27 11:00:06.694562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 11:00:06.694562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 27 11:00:06.694562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 11:00:06.694562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 11:00:06.694562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 11:00:06.694562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 27 11:00:06.694562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 11:00:06.694562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 27 11:00:06.695523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 11:00:06.695523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 11:00:06.695523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 11:00:06.695523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 11:00:06.695523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 11:00:06.695523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 11:00:06.695523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 11:00:06.695523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 27 11:00:06.695523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 638/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jun 27 11:00:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 11:00:06.700304 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe4d5c-8542-4594-ae39-8bee34e83fcb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:06.748420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:06.796801 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe4d5c-8542-4594-ae39-8bee34e83fcb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:06.829326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d21a1-64ef-4452-bee9-896d8e60fbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:06.829995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d21a1-64ef-4452-bee9-896d8e60fbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:06.830279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d21a1-64ef-4452-bee9-896d8e60fbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:06.830554 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d21a1-64ef-4452-bee9-896d8e60fbd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:06.831358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d21a1-64ef-4452-bee9-896d8e60fbd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:00:06.831662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d21a1-64ef-4452-bee9-896d8e60fbd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:06.833086 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d21a1-64ef-4452-bee9-896d8e60fbd6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:06.845202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 648/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jun 27 11:00:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:00:06.850980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce529cf9-1520-40da-b377-e2bbc139f97e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:06.947736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce529cf9-1520-40da-b377-e2bbc139f97e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:06.982218 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407e7a4-8519-45be-a356-a131e1ef1482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:06.983041 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e7a4-8519-45be-a356-a131e1ef1482 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:06.983212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e7a4-8519-45be-a356-a131e1ef1482 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:06.983530 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e7a4-8519-45be-a356-a131e1ef1482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:06.984438 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407e7a4-8519-45be-a356-a131e1ef1482 None admin] RBAC: Adding query filter params (role.id=d3c63fe700f54e1c8da7f17f7083fd26, scope.project.id=6543a66af8ba48c391ce686f6d82276b, user.id=d8673c91abf14c0b9a237f0499fdf20e) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:00:06.984790 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407e7a4-8519-45be-a356-a131e1ef1482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:06.986367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407e7a4-8519-45be-a356-a131e1ef1482 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:06.993420 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 639/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jun 27 11:00:06 2022] GET /identity/v3/role_assignments?user.id=d8673c91abf14c0b9a237f0499fdf20e&scope.project.id=6543a66af8ba48c391ce686f6d82276b&role.id=d3c63fe700f54e1c8da7f17f7083fd26 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:00:08.998990 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f726d-3d4d-4406-8dc7-c949bff73e5d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:08.999540 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f726d-3d4d-4406-8dc7-c949bff73e5d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:08.999540 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f726d-3d4d-4406-8dc7-c949bff73e5d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:09.000924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 649/1288] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:00:09.006124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e50ca0-6860-4691-b0d8-71644e0eb84a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:09.006543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e50ca0-6860-4691-b0d8-71644e0eb84a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:09.006682 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e50ca0-6860-4691-b0d8-71644e0eb84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:09.023289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-90e50ca0-6860-4691-b0d8-71644e0eb84a None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:00:09.024465 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-90e50ca0-6860-4691-b0d8-71644e0eb84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:00:09.053491 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:09.089267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 640/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:00:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 11:00:09.111901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f726d-3d4d-4406-8dc7-c949bff73e5d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:09.209620 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f726d-3d4d-4406-8dc7-c949bff73e5d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:09.219918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:09.242971 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a13cb-18f4-456c-a3ae-8cd1a748ab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:09.243755 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a13cb-18f4-456c-a3ae-8cd1a748ab53 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:09.244033 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a13cb-18f4-456c-a3ae-8cd1a748ab53 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:09.244302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a13cb-18f4-456c-a3ae-8cd1a748ab53 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:09.244939 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a13cb-18f4-456c-a3ae-8cd1a748ab53 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:09.246318 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a13cb-18f4-456c-a3ae-8cd1a748ab53 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:09.257827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-736a13cb-18f4-456c-a3ae-8cd1a748ab53 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 11:00:09.257827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 11:00:09.257827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 11:00:09.257827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 11:00:09.257827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 11:00:09.257827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 11:00:09.257827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 11:00:09.257827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 11:00:09.257827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 11:00:09.257827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 11:00:09.257827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 11:00:09.257827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 11:00:09.257827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 11:00:09.257827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 11:00:09.257827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 11:00:09.257827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 11:00:09.257827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 11:00:09.259035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 11:00:09.259035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 11:00:09.259035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 11:00:09.259035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 11:00:09.259035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 11:00:09.259035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 11:00:09.259035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 11:00:09.259035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 11:00:09.259035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 11:00:09.259035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 11:00:09.259035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 11:00:09.259035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 11:00:09.259035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 11:00:09.259035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 11:00:09.259035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 11:00:09.259035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 11:00:09.260044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 11:00:09.260044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 11:00:09.260044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 11:00:09.260044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 11:00:09.260044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 11:00:09.260044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 11:00:09.260044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 11:00:09.260044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 11:00:09.260044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 11:00:09.260044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 11:00:09.260044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 11:00:09.260044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 11:00:09.260044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 11:00:09.260044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 11:00:09.260044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 650/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jun 27 11:00:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 11:00:09.264993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e50ca0-6860-4691-b0d8-71644e0eb84a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:09.360255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e50ca0-6860-4691-b0d8-71644e0eb84a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:09.392461 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f2793-f55d-4301-adaa-983a1812245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:09.393107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f2793-f55d-4301-adaa-983a1812245b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:09.393954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f2793-f55d-4301-adaa-983a1812245b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:09.394236 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f2793-f55d-4301-adaa-983a1812245b None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:09.394933 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f2793-f55d-4301-adaa-983a1812245b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:00:09.395239 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f2793-f55d-4301-adaa-983a1812245b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:09.396600 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f2793-f55d-4301-adaa-983a1812245b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:09.401291 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 641/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Jun 27 11:00:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:00:09.406769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a13cb-18f4-456c-a3ae-8cd1a748ab53 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:09.502108 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a13cb-18f4-456c-a3ae-8cd1a748ab53 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:09.534853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfdadc-e80a-4d5e-ad13-5700be8053dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:09.535502 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfdadc-e80a-4d5e-ad13-5700be8053dc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:09.535788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfdadc-e80a-4d5e-ad13-5700be8053dc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:09.536067 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfdadc-e80a-4d5e-ad13-5700be8053dc None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:09.536769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfdadc-e80a-4d5e-ad13-5700be8053dc None admin] RBAC: Adding query filter params (type=placement) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:00:09.537077 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfdadc-e80a-4d5e-ad13-5700be8053dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:09.538457 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfdadc-e80a-4d5e-ad13-5700be8053dc None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:09.542773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 651/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Jun 27 11:00:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 11:00:11.619246 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028731a-f420-4944-b096-b97a5104e899 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:11.619822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028731a-f420-4944-b096-b97a5104e899 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:11.619822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028731a-f420-4944-b096-b97a5104e899 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:11.621149 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 642/1293] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:00:11.626393 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1efff-2d3e-4143-8396-910c77d7d8a7 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:11.626825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1efff-2d3e-4143-8396-910c77d7d8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:11.626942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1efff-2d3e-4143-8396-910c77d7d8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:11.644254 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a1b1efff-2d3e-4143-8396-910c77d7d8a7 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:00:11.645466 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a1b1efff-2d3e-4143-8396-910c77d7d8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:00:11.673877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:11.710041 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 652/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:00:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 11:00:11.732922 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028731a-f420-4944-b096-b97a5104e899 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:11.763496 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:11.830091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028731a-f420-4944-b096-b97a5104e899 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:11.863522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c608a-2070-4d23-86d6-48553a5f4188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:11.864168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c608a-2070-4d23-86d6-48553a5f4188 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:11.864447 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c608a-2070-4d23-86d6-48553a5f4188 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:11.864719 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c608a-2070-4d23-86d6-48553a5f4188 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:11.865461 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c608a-2070-4d23-86d6-48553a5f4188 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:11.866819 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c608a-2070-4d23-86d6-48553a5f4188 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:11.879551 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 643/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jun 27 11:00:11 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:00:13.860349 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab52543-fe39-442e-abc7-06e6c88cf8c5 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:13.860903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab52543-fe39-442e-abc7-06e6c88cf8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:13.860903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab52543-fe39-442e-abc7-06e6c88cf8c5 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:13.862324 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 653/1296] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:00:13.867555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d499ee-00c8-4785-a9b1-26952d4bb8c5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:13.867966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d499ee-00c8-4785-a9b1-26952d4bb8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:13.868109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d499ee-00c8-4785-a9b1-26952d4bb8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:13.884366 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-60d499ee-00c8-4785-a9b1-26952d4bb8c5 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:00:13.885569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-60d499ee-00c8-4785-a9b1-26952d4bb8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:00:13.957214 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 644/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:00:13 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 11:00:13.982547 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab52543-fe39-442e-abc7-06e6c88cf8c5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:14.088671 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab52543-fe39-442e-abc7-06e6c88cf8c5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:14.120309 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6db02-09ab-421c-a1cc-d1b9ed69be3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:14.121031 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6db02-09ab-421c-a1cc-d1b9ed69be3c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:14.121309 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6db02-09ab-421c-a1cc-d1b9ed69be3c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:14.121606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6db02-09ab-421c-a1cc-d1b9ed69be3c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:14.122243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6db02-09ab-421c-a1cc-d1b9ed69be3c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:14.123599 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6db02-09ab-421c-a1cc-d1b9ed69be3c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:14.135647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-46e6db02-09ab-421c-a1cc-d1b9ed69be3c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 11:00:14.135647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 11:00:14.135647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 11:00:14.135647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 11:00:14.135647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 11:00:14.135647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 11:00:14.135647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 11:00:14.135647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 11:00:14.135647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 11:00:14.135647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 11:00:14.135647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 11:00:14.135647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 11:00:14.135647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 11:00:14.135647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 11:00:14.135647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 11:00:14.135647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 11:00:14.135647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 11:00:14.137080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 11:00:14.137080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 11:00:14.137080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 11:00:14.137080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 11:00:14.137080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 11:00:14.137080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 11:00:14.137080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 11:00:14.137080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 11:00:14.137080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 11:00:14.137080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 11:00:14.137080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 11:00:14.137080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 11:00:14.137080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 11:00:14.137080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 11:00:14.137080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 11:00:14.137080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 11:00:14.138347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 11:00:14.138347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 11:00:14.138347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 11:00:14.138347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 11:00:14.138347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 11:00:14.138347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 11:00:14.138347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 11:00:14.138347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 11:00:14.138347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 11:00:14.138347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 11:00:14.138347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 11:00:14.138347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 11:00:14.138347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 11:00:14.138347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 11:00:14.138347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 654/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jun 27 11:00:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 11:00:14.143043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d499ee-00c8-4785-a9b1-26952d4bb8c5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:14.161244 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:14.239351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d499ee-00c8-4785-a9b1-26952d4bb8c5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:14.272168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf6f30-2351-42d5-b020-c6c2af19d915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:14.272815 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf6f30-2351-42d5-b020-c6c2af19d915 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:14.273096 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf6f30-2351-42d5-b020-c6c2af19d915 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:14.273403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf6f30-2351-42d5-b020-c6c2af19d915 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:14.274089 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf6f30-2351-42d5-b020-c6c2af19d915 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:00:14.274389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf6f30-2351-42d5-b020-c6c2af19d915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:14.275738 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf6f30-2351-42d5-b020-c6c2af19d915 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:14.280684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 645/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Jun 27 11:00:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:00:14.286521 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6db02-09ab-421c-a1cc-d1b9ed69be3c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:14.317804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:14.382676 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6db02-09ab-421c-a1cc-d1b9ed69be3c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:14.414099 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55342141-373e-40d6-9e20-c69b92d81a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:14.414732 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55342141-373e-40d6-9e20-c69b92d81a4f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:14.415014 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55342141-373e-40d6-9e20-c69b92d81a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:14.415285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55342141-373e-40d6-9e20-c69b92d81a4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:14.416057 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55342141-373e-40d6-9e20-c69b92d81a4f None admin] RBAC: Adding query filter params (interface=public, service_id=1f53c51bfcb0493b91ddb0f42d145745, region_id=RegionOne) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:00:14.416363 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55342141-373e-40d6-9e20-c69b92d81a4f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:14.417734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55342141-373e-40d6-9e20-c69b92d81a4f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:14.422559 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 655/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jun 27 11:00:14 2022] GET /identity/v3/endpoints?service_id=1f53c51bfcb0493b91ddb0f42d145745&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:00:14.428510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf6f30-2351-42d5-b020-c6c2af19d915 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:14.507830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:14.526332 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf6f30-2351-42d5-b020-c6c2af19d915 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:14.559051 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78437ec0-8e0c-4010-9f7d-ee1329ac23f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:14.559693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78437ec0-8e0c-4010-9f7d-ee1329ac23f8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:14.559981 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78437ec0-8e0c-4010-9f7d-ee1329ac23f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:14.560259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78437ec0-8e0c-4010-9f7d-ee1329ac23f8 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:14.560933 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78437ec0-8e0c-4010-9f7d-ee1329ac23f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:14.562324 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78437ec0-8e0c-4010-9f7d-ee1329ac23f8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:14.569571 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 646/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jun 27 11:00:14 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:00:16.558250 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaf366-0839-478c-a4ff-d0b22fe0d630 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:16.558760 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaf366-0839-478c-a4ff-d0b22fe0d630 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:16.558854 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaf366-0839-478c-a4ff-d0b22fe0d630 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:16.560158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 656/1302] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:00:16.565962 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c406c-8f90-440a-8450-d4e56fde6911 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:16.566371 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c406c-8f90-440a-8450-d4e56fde6911 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:16.566503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c406c-8f90-440a-8450-d4e56fde6911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:16.582791 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a97c406c-8f90-440a-8450-d4e56fde6911 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:00:16.583952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a97c406c-8f90-440a-8450-d4e56fde6911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:00:16.655224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 647/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:00:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 11:00:16.678175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaf366-0839-478c-a4ff-d0b22fe0d630 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:16.774682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:16.781834 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaf366-0839-478c-a4ff-d0b22fe0d630 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:16.814116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c321c8b-a176-4dc8-8904-cfaa66c1e6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:16.814830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c321c8b-a176-4dc8-8904-cfaa66c1e6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:16.815726 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c321c8b-a176-4dc8-8904-cfaa66c1e6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:16.815996 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c321c8b-a176-4dc8-8904-cfaa66c1e6c4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:16.816729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c321c8b-a176-4dc8-8904-cfaa66c1e6c4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:16.818123 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c321c8b-a176-4dc8-8904-cfaa66c1e6c4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:16.829587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9c321c8b-a176-4dc8-8904-cfaa66c1e6c4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 11:00:16.829587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 11:00:16.829587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 11:00:16.829587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 11:00:16.829587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 11:00:16.829587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 11:00:16.829587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 11:00:16.829587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 11:00:16.829587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 11:00:16.829587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 11:00:16.829587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 11:00:16.829587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 11:00:16.829587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 11:00:16.829587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 11:00:16.829587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 11:00:16.829587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 11:00:16.829587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 11:00:16.830802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 11:00:16.830802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 11:00:16.830802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 11:00:16.830802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 11:00:16.830802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 11:00:16.830802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 11:00:16.830802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 11:00:16.830802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 11:00:16.830802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 11:00:16.830802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 11:00:16.830802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 11:00:16.830802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 11:00:16.830802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 11:00:16.830802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 11:00:16.830802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 11:00:16.830802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 11:00:16.831689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 11:00:16.831689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 27 11:00:16.831689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 11:00:16.831689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 27 11:00:16.831689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 11:00:16.831689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 11:00:16.831689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 11:00:16.831689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 27 11:00:16.831689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 11:00:16.831689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 27 11:00:16.831689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 11:00:16.831689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 11:00:16.831689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 11:00:16.831689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 27 11:00:16.831689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 657/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jun 27 11:00:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 11:00:16.836903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c406c-8f90-440a-8450-d4e56fde6911 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:16.913768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:16.936663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c406c-8f90-440a-8450-d4e56fde6911 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:16.969230 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5aaaf-ce36-4c63-bf5c-5963123e6721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:16.969914 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5aaaf-ce36-4c63-bf5c-5963123e6721 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:16.970199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5aaaf-ce36-4c63-bf5c-5963123e6721 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:16.970476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5aaaf-ce36-4c63-bf5c-5963123e6721 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:16.971174 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5aaaf-ce36-4c63-bf5c-5963123e6721 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:00:16.972006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5aaaf-ce36-4c63-bf5c-5963123e6721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:16.973390 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5aaaf-ce36-4c63-bf5c-5963123e6721 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:16.978423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 648/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Jun 27 11:00:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:00:16.984168 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c321c8b-a176-4dc8-8904-cfaa66c1e6c4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:00:17.079503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c321c8b-a176-4dc8-8904-cfaa66c1e6c4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:00:17.111185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99bfc8-3000-4881-95c5-a198c08cc6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:00:17.111819 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99bfc8-3000-4881-95c5-a198c08cc6d6 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:00:17.112632 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99bfc8-3000-4881-95c5-a198c08cc6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:00:17.112902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99bfc8-3000-4881-95c5-a198c08cc6d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:00:17.113649 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99bfc8-3000-4881-95c5-a198c08cc6d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:00:17.115054 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99bfc8-3000-4881-95c5-a198c08cc6d6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:00:17.131875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 658/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jun 27 11:00:16 2022] POST /identity/v3/endpoints => generated 331 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:00:26.975464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=30 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:00:27.128157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:19.478380 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a9ffa-217d-44e0-a5a8-3b09e287709f None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:19.478906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a9ffa-217d-44e0-a5a8-3b09e287709f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:19.478906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a9ffa-217d-44e0-a5a8-3b09e287709f None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:19.485352 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6576f-4141-4d6a-a626-1450658a5e2a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:19.485943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6576f-4141-4d6a-a626-1450658a5e2a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:19.486243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6576f-4141-4d6a-a626-1450658a5e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:19.489680 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 649/1307] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:01:19 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:01:19.571814 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d6d6576f-4141-4d6a-a626-1450658a5e2a None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:01:19.573022 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d6d6576f-4141-4d6a-a626-1450658a5e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:19.754050 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 659/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:01:19.801823 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731990d1-32e0-418e-918b-ed581e589a2b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:19.802878 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731990d1-32e0-418e-918b-ed581e589a2b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:19.803876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731990d1-32e0-418e-918b-ed581e589a2b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:19.809116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 650/1309] 10.222.0.18 () {54 vars in 964 bytes} [Mon Jun 27 11:01:19 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:01:19.827733 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a877e03-8f5d-4e80-8a09-b11b1b7914b1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:19.829153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a877e03-8f5d-4e80-8a09-b11b1b7914b1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:19.830257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a877e03-8f5d-4e80-8a09-b11b1b7914b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:19.935767 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1a877e03-8f5d-4e80-8a09-b11b1b7914b1 None None] MFA Rules not processed for user `cb2d4050a05f4517ab165c74f9e6cae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:01:19.937056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1a877e03-8f5d-4e80-8a09-b11b1b7914b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:19.957896 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:20.018052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 660/1310] 10.222.0.18 () {58 vars in 1061 bytes} [Mon Jun 27 11:01:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:01:20.026842 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731990d1-32e0-418e-918b-ed581e589a2b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:01:20.028796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-731990d1-32e0-418e-918b-ed581e589a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:20.133869 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731990d1-32e0-418e-918b-ed581e589a2b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:01:20.210385 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed98037-d361-43fc-a8c1-0df2c5a12510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:01:20.211033 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed98037-d361-43fc-a8c1-0df2c5a12510 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:20.211318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed98037-d361-43fc-a8c1-0df2c5a12510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:20.211591 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed98037-d361-43fc-a8c1-0df2c5a12510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:20.213210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bed98037-d361-43fc-a8c1-0df2c5a12510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:20.270140 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:20.329396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed98037-d361-43fc-a8c1-0df2c5a12510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:01:20.331513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed98037-d361-43fc-a8c1-0df2c5a12510 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:01:20.351389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 651/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:01:22.637964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d2f45-4e1f-45cb-a5ff-a2a10a00e4d3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:22.638498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d2f45-4e1f-45cb-a5ff-a2a10a00e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:22.638498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d2f45-4e1f-45cb-a5ff-a2a10a00e4d3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:22.639903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 661/1312] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:01:22.645054 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ef40c-32a1-4f5e-97f9-f8aa1bbe5d52 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:22.645503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ef40c-32a1-4f5e-97f9-f8aa1bbe5d52 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:22.645670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ef40c-32a1-4f5e-97f9-f8aa1bbe5d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:22.721778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6f0ef40c-32a1-4f5e-97f9-f8aa1bbe5d52 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:01:22.722992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6f0ef40c-32a1-4f5e-97f9-f8aa1bbe5d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:22.824980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 652/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:01:22.878104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ab58-5f21-4d25-adc5-1843ab4ad5b0 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:22.878390 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ab58-5f21-4d25-adc5-1843ab4ad5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:22.878670 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ab58-5f21-4d25-adc5-1843ab4ad5b0 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:22.880201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 662/1314] 10.222.0.18 () {54 vars in 964 bytes} [Mon Jun 27 11:01:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:01:22.886092 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68592e-659b-4816-98b6-102467e7ec97 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:22.886637 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68592e-659b-4816-98b6-102467e7ec97 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:22.886918 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68592e-659b-4816-98b6-102467e7ec97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:22.897477 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:22.963714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6a68592e-659b-4816-98b6-102467e7ec97 None None] MFA Rules not processed for user `cb2d4050a05f4517ab165c74f9e6cae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:01:22.964918 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6a68592e-659b-4816-98b6-102467e7ec97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:23.041653 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 653/1315] 10.222.0.18 () {58 vars in 1061 bytes} [Mon Jun 27 11:01:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:01:23.051394 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804ab58-5f21-4d25-adc5-1843ab4ad5b0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:01:23.052913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a804ab58-5f21-4d25-adc5-1843ab4ad5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:23.155283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804ab58-5f21-4d25-adc5-1843ab4ad5b0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:01:23.225680 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:23.228253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f110fb-1d11-4d92-8375-aa27f9845405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:01:23.229115 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f110fb-1d11-4d92-8375-aa27f9845405 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:23.229605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f110fb-1d11-4d92-8375-aa27f9845405 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:23.230094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f110fb-1d11-4d92-8375-aa27f9845405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:23.231765 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-47f110fb-1d11-4d92-8375-aa27f9845405 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:23.336898 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f110fb-1d11-4d92-8375-aa27f9845405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:01:23.338352 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f110fb-1d11-4d92-8375-aa27f9845405 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:01:23.356695 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 663/1316] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:01:25.893941 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4ccd9-01d0-44bc-a3c8-cc93c5aed5f0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:25.894506 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4ccd9-01d0-44bc-a3c8-cc93c5aed5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:25.894506 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4ccd9-01d0-44bc-a3c8-cc93c5aed5f0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:25.895872 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 654/1317] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:01:25.901001 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf124-85d7-44fe-b407-aa120731b9ac None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:25.901447 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf124-85d7-44fe-b407-aa120731b9ac None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:25.901569 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf124-85d7-44fe-b407-aa120731b9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:25.963661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b17bf124-85d7-44fe-b407-aa120731b9ac None None] MFA Rules not processed for user `8082f54163cd4ae882a5ec7f9c30f8cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:01:25.964783 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b17bf124-85d7-44fe-b407-aa120731b9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:26.015172 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:26.059886 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 664/1318] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:01:25 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:01:26.098670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4ccd9-01d0-44bc-a3c8-cc93c5aed5f0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:01:26.100202 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-77a4ccd9-01d0-44bc-a3c8-cc93c5aed5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:26.202314 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4ccd9-01d0-44bc-a3c8-cc93c5aed5f0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:01:26.205130 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:26.275542 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34215456-213f-4638-bf3d-3256e53ab524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:01:26.276105 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215456-213f-4638-bf3d-3256e53ab524 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:26.276383 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215456-213f-4638-bf3d-3256e53ab524 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:26.276656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215456-213f-4638-bf3d-3256e53ab524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:26.278318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-34215456-213f-4638-bf3d-3256e53ab524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:26.382089 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34215456-213f-4638-bf3d-3256e53ab524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:01:26.383503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34215456-213f-4638-bf3d-3256e53ab524 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:01:26.401547 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 655/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:01:26 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:01:28.942287 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16c9c5-f690-45df-95b7-918b393fe375 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:28.942850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16c9c5-f690-45df-95b7-918b393fe375 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:28.942850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16c9c5-f690-45df-95b7-918b393fe375 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:28.944212 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 665/1320] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:01:28.949488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffbdd0-7831-42cf-8006-350590930e69 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:28.949895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffbdd0-7831-42cf-8006-350590930e69 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:28.950047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffbdd0-7831-42cf-8006-350590930e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:28.990032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:29.014543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-95ffbdd0-7831-42cf-8006-350590930e69 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:01:29.015738 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-95ffbdd0-7831-42cf-8006-350590930e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:29.109704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 656/1321] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:01:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:01:29.148733 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16c9c5-f690-45df-95b7-918b393fe375 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:01:29.150280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4a16c9c5-f690-45df-95b7-918b393fe375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:29.250832 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16c9c5-f690-45df-95b7-918b393fe375 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:01:29.320532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10863a8-975b-4c22-a13d-44c0c021a170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:01:29.321164 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10863a8-975b-4c22-a13d-44c0c021a170 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:29.321483 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10863a8-975b-4c22-a13d-44c0c021a170 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:29.321757 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10863a8-975b-4c22-a13d-44c0c021a170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:29.323376 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f10863a8-975b-4c22-a13d-44c0c021a170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:29.331131 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:29.429228 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10863a8-975b-4c22-a13d-44c0c021a170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:01:29.430676 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10863a8-975b-4c22-a13d-44c0c021a170 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:01:29.448171 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 666/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:01:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:01:32.116292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a0130-a41c-403c-93c9-aef645cfb9ad None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:32.116868 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a0130-a41c-403c-93c9-aef645cfb9ad None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:32.116868 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a0130-a41c-403c-93c9-aef645cfb9ad None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:32.118246 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 657/1323] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:01:32.123662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edabf7-e42d-466d-8e7d-9add9d78e05b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:32.124065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edabf7-e42d-466d-8e7d-9add9d78e05b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:32.124216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edabf7-e42d-466d-8e7d-9add9d78e05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:32.190741 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-97edabf7-e42d-466d-8e7d-9add9d78e05b None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:01:32.191934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-97edabf7-e42d-466d-8e7d-9add9d78e05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:32.254415 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:32.298239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 667/1324] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:01:32.334445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a0130-a41c-403c-93c9-aef645cfb9ad None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:01:32.336047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-892a0130-a41c-403c-93c9-aef645cfb9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:32.445480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a0130-a41c-403c-93c9-aef645cfb9ad None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:01:32.458143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:32.519712 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ce6f3-3c1c-499f-b92e-3968631905c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:01:32.520357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ce6f3-3c1c-499f-b92e-3968631905c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:32.520638 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ce6f3-3c1c-499f-b92e-3968631905c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:32.520914 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ce6f3-3c1c-499f-b92e-3968631905c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:32.522579 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-992ce6f3-3c1c-499f-b92e-3968631905c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:32.631034 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ce6f3-3c1c-499f-b92e-3968631905c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:01:32.632414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ce6f3-3c1c-499f-b92e-3968631905c8 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:01:32.651746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 658/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:01:34.784923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34692978-0a0b-4675-9def-8fa12ee041df None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:34.785458 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34692978-0a0b-4675-9def-8fa12ee041df None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:34.785569 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34692978-0a0b-4675-9def-8fa12ee041df None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:34.787056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 668/1326] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:01:34.792107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061c9f4-0546-447c-be0d-5bc4b2e856f1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:34.792497 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061c9f4-0546-447c-be0d-5bc4b2e856f1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:34.792670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061c9f4-0546-447c-be0d-5bc4b2e856f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:34.841194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:34.860080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9061c9f4-0546-447c-be0d-5bc4b2e856f1 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:01:34.861326 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9061c9f4-0546-447c-be0d-5bc4b2e856f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:34.959774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 659/1327] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:01:34.995592 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34692978-0a0b-4675-9def-8fa12ee041df None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:01:34.997138 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-34692978-0a0b-4675-9def-8fa12ee041df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:35.105914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34692978-0a0b-4675-9def-8fa12ee041df None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:01:35.178207 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3220a03-b91f-441a-a241-b37330d60c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:01:35.178863 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3220a03-b91f-441a-a241-b37330d60c96 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:35.179149 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3220a03-b91f-441a-a241-b37330d60c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:35.179430 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3220a03-b91f-441a-a241-b37330d60c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:35.181077 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f3220a03-b91f-441a-a241-b37330d60c96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:35.199366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:35.300080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3220a03-b91f-441a-a241-b37330d60c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:01:35.301671 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3220a03-b91f-441a-a241-b37330d60c96 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:01:35.320890 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 669/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:01:37.390388 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aafd17-386b-420e-89b8-7e7dc2f280af None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:37.390838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aafd17-386b-420e-89b8-7e7dc2f280af None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:37.390951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aafd17-386b-420e-89b8-7e7dc2f280af None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:37.392335 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 660/1329] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:01:37.397425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524438f-c08e-444e-b8ff-acb3380ae418 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:37.397845 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524438f-c08e-444e-b8ff-acb3380ae418 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:37.397978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524438f-c08e-444e-b8ff-acb3380ae418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:37.467065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a524438f-c08e-444e-b8ff-acb3380ae418 None None] MFA Rules not processed for user `8082f54163cd4ae882a5ec7f9c30f8cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:01:37.468286 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a524438f-c08e-444e-b8ff-acb3380ae418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:37.533010 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:37.564224 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 670/1330] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:01:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:01:37.601776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aafd17-386b-420e-89b8-7e7dc2f280af None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:01:37.603292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-07aafd17-386b-420e-89b8-7e7dc2f280af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:37.708271 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aafd17-386b-420e-89b8-7e7dc2f280af None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:01:37.728670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:37.794681 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be3358-ea30-46d7-a5ad-76ee62a110bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:01:37.795665 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be3358-ea30-46d7-a5ad-76ee62a110bc service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:37.796822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be3358-ea30-46d7-a5ad-76ee62a110bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:37.796822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be3358-ea30-46d7-a5ad-76ee62a110bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:37.798000 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d9be3358-ea30-46d7-a5ad-76ee62a110bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:37.934002 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be3358-ea30-46d7-a5ad-76ee62a110bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:01:37.935447 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be3358-ea30-46d7-a5ad-76ee62a110bc service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:01:37.953953 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 661/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:01:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:01:40.377731 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dee49d-62b4-4b6a-a17d-8d2cb58c6f00 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:40.378320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dee49d-62b4-4b6a-a17d-8d2cb58c6f00 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:40.378320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dee49d-62b4-4b6a-a17d-8d2cb58c6f00 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:40.379671 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 671/1332] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 11:01:40.384851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82a66-8f03-4e09-afc9-4c59530d76e0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:40.385266 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82a66-8f03-4e09-afc9-4c59530d76e0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:40.385434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82a66-8f03-4e09-afc9-4c59530d76e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:40.446802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:40.449878 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c7a82a66-8f03-4e09-afc9-4c59530d76e0 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:01:40.451600 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c7a82a66-8f03-4e09-afc9-4c59530d76e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:40.546157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 662/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:01:40.581681 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dee49d-62b4-4b6a-a17d-8d2cb58c6f00 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:01:40.583194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-20dee49d-62b4-4b6a-a17d-8d2cb58c6f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:40.684606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dee49d-62b4-4b6a-a17d-8d2cb58c6f00 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:01:40.755259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977461d-303f-4c50-a80e-75956712cd4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:01:40.755898 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977461d-303f-4c50-a80e-75956712cd4f service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:40.756177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977461d-303f-4c50-a80e-75956712cd4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:40.756451 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977461d-303f-4c50-a80e-75956712cd4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:40.758120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9977461d-303f-4c50-a80e-75956712cd4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:40.785873 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:40.865315 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977461d-303f-4c50-a80e-75956712cd4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:01:40.866771 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977461d-303f-4c50-a80e-75956712cd4f service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:01:40.884636 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 672/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:01:42.943563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000c99f-bd5d-491e-820d-10a73de434f0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:42.944125 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000c99f-bd5d-491e-820d-10a73de434f0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:42.944125 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000c99f-bd5d-491e-820d-10a73de434f0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:42.945658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 663/1335] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:01:42.950812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291173c-df8c-4fe8-93b3-483323e69414 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:42.951218 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291173c-df8c-4fe8-93b3-483323e69414 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:42.951363 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291173c-df8c-4fe8-93b3-483323e69414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:43.015873 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9291173c-df8c-4fe8-93b3-483323e69414 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:01:43.017611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9291173c-df8c-4fe8-93b3-483323e69414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:43.089019 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:43.111332 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 673/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:01:43.151368 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000c99f-bd5d-491e-820d-10a73de434f0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:01:43.152885 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3000c99f-bd5d-491e-820d-10a73de434f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:43.254551 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000c99f-bd5d-491e-820d-10a73de434f0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:01:43.282897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:43.327812 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48198b-17f4-4ac7-bf60-7755c32aecea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:01:43.328442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48198b-17f4-4ac7-bf60-7755c32aecea service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:43.328731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48198b-17f4-4ac7-bf60-7755c32aecea service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:43.329653 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48198b-17f4-4ac7-bf60-7755c32aecea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:43.331332 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8b48198b-17f4-4ac7-bf60-7755c32aecea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:43.436926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48198b-17f4-4ac7-bf60-7755c32aecea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:01:43.438892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48198b-17f4-4ac7-bf60-7755c32aecea service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:01:43.456918 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 664/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:01:45.912734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f29ae2-8847-401c-9c39-c4ff877c718e None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:45.913341 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f29ae2-8847-401c-9c39-c4ff877c718e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:45.913341 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f29ae2-8847-401c-9c39-c4ff877c718e None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:45.914748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 674/1338] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:01:45.920162 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b4bb7-6154-4d97-93df-b10dab6261ab None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:45.920558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b4bb7-6154-4d97-93df-b10dab6261ab None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:45.920715 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b4bb7-6154-4d97-93df-b10dab6261ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:45.983658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-dd8b4bb7-6154-4d97-93df-b10dab6261ab None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:01:45.984840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dd8b4bb7-6154-4d97-93df-b10dab6261ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:45.993376 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:46.079608 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 665/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:01:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:01:46.115121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f29ae2-8847-401c-9c39-c4ff877c718e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:01:46.116648 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-21f29ae2-8847-401c-9c39-c4ff877c718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:46.219342 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f29ae2-8847-401c-9c39-c4ff877c718e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:01:46.291179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e8631-8cb0-4c9f-be42-800c35820512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:01:46.291820 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e8631-8cb0-4c9f-be42-800c35820512 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:46.292101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e8631-8cb0-4c9f-be42-800c35820512 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:46.292377 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e8631-8cb0-4c9f-be42-800c35820512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:46.294044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7a0e8631-8cb0-4c9f-be42-800c35820512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:46.328390 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:46.400543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e8631-8cb0-4c9f-be42-800c35820512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:01:46.402002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e8631-8cb0-4c9f-be42-800c35820512 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:01:46.420954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 675/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:01:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:01:50.428623 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7153e8-7d01-4129-b33b-03e188fc3cfe None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:50.429143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7153e8-7d01-4129-b33b-03e188fc3cfe None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:50.429143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7153e8-7d01-4129-b33b-03e188fc3cfe None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:50.430491 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 666/1341] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:01:50.435572 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01149-fc8d-4f8a-85c2-39817de8e720 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:50.435972 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01149-fc8d-4f8a-85c2-39817de8e720 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:50.436155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01149-fc8d-4f8a-85c2-39817de8e720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:50.505923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8ba01149-fc8d-4f8a-85c2-39817de8e720 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:01:50.507150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8ba01149-fc8d-4f8a-85c2-39817de8e720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:50.596399 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:50.609673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 676/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:01:50.649589 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7153e8-7d01-4129-b33b-03e188fc3cfe None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:01:50.651770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6c7153e8-7d01-4129-b33b-03e188fc3cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:50.748149 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7153e8-7d01-4129-b33b-03e188fc3cfe None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:01:50.751599 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc898c2d-53ff-4c69-8708-9def592ba9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:01:50.752238 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc898c2d-53ff-4c69-8708-9def592ba9ac service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:50.752518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc898c2d-53ff-4c69-8708-9def592ba9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:50.752792 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc898c2d-53ff-4c69-8708-9def592ba9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:50.761817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc898c2d-53ff-4c69-8708-9def592ba9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:01:50.763302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc898c2d-53ff-4c69-8708-9def592ba9ac service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:01:50.772457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 667/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:01:53.436584 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd442325-d174-43a0-b833-bae8a2a5dcf1 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:53.437112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd442325-d174-43a0-b833-bae8a2a5dcf1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:53.437112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd442325-d174-43a0-b833-bae8a2a5dcf1 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:53.439093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 677/1344] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:01:53.444192 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89036fcc-6f26-4fb3-b9ad-645ffecbc7d8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:53.444597 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89036fcc-6f26-4fb3-b9ad-645ffecbc7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:53.444877 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89036fcc-6f26-4fb3-b9ad-645ffecbc7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:53.472879 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-89036fcc-6f26-4fb3-b9ad-645ffecbc7d8 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:01:53.474117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-89036fcc-6f26-4fb3-b9ad-645ffecbc7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:53.507108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:01:53.566796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 668/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:01:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:01:53.604290 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd442325-d174-43a0-b833-bae8a2a5dcf1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:01:53.615683 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd442325-d174-43a0-b833-bae8a2a5dcf1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:01:53.619228 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df90f0-c824-4e87-83c5-41dfd98a7117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:01:53.619896 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df90f0-c824-4e87-83c5-41dfd98a7117 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:53.620160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df90f0-c824-4e87-83c5-41dfd98a7117 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:53.620433 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df90f0-c824-4e87-83c5-41dfd98a7117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:53.630788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df90f0-c824-4e87-83c5-41dfd98a7117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:01:53.632251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df90f0-c824-4e87-83c5-41dfd98a7117 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:01:53.642863 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 678/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:01:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:01:57.871249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e7b45-dc7f-4814-93f4-2159cbe0d4c8 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:57.871800 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e7b45-dc7f-4814-93f4-2159cbe0d4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:57.871904 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e7b45-dc7f-4814-93f4-2159cbe0d4c8 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:57.873283 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 669/1347] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:01:57.879106 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec6313-6755-434b-8e64-23e3f7852151 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:57.879511 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec6313-6755-434b-8e64-23e3f7852151 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:57.879610 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec6313-6755-434b-8e64-23e3f7852151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:57.897469 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6cec6313-6755-434b-8e64-23e3f7852151 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:01:57.898664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6cec6313-6755-434b-8e64-23e3f7852151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:01:57.906424 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 679/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:01:57.945485 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e7b45-dc7f-4814-93f4-2159cbe0d4c8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:01:57.955990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e7b45-dc7f-4814-93f4-2159cbe0d4c8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:01:57.959621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b52d7-0b7c-42b1-b114-774c1758c945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:01:57.960304 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b52d7-0b7c-42b1-b114-774c1758c945 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:01:57.960586 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b52d7-0b7c-42b1-b114-774c1758c945 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:01:57.960860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b52d7-0b7c-42b1-b114-774c1758c945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:01:57.972446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b52d7-0b7c-42b1-b114-774c1758c945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:01:57.973913 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b52d7-0b7c-42b1-b114-774c1758c945 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:01:57.984481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 670/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:02:02.902027 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e880282-ceb3-4f3a-8464-c20651e49597 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:02.902517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e880282-ceb3-4f3a-8464-c20651e49597 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:02.902744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e880282-ceb3-4f3a-8464-c20651e49597 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:02.904237 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 680/1350] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jun 27 11:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:02.909237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b03bca-38e7-44cf-9e3e-ee854a274ab3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:02.923424 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b03bca-38e7-44cf-9e3e-ee854a274ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:02.923424 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b03bca-38e7-44cf-9e3e-ee854a274ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:03.027866 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-16b03bca-38e7-44cf-9e3e-ee854a274ab3 None None] MFA Rules not processed for user `d8673c91abf14c0b9a237f0499fdf20e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:03.029040 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-16b03bca-38e7-44cf-9e3e-ee854a274ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:03.115646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 671/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jun 27 11:02:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:07.381867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b7f76-4124-4ffc-95bd-cc169bf29719 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:07.382807 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b7f76-4124-4ffc-95bd-cc169bf29719 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:07.383279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b7f76-4124-4ffc-95bd-cc169bf29719 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:07.384735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 681/1352] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jun 27 11:02:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:07.390326 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acceaa0-38c7-4065-84cc-52e2a18f5cc3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:07.390844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acceaa0-38c7-4065-84cc-52e2a18f5cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:07.391731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acceaa0-38c7-4065-84cc-52e2a18f5cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:07.411522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9acceaa0-38c7-4065-84cc-52e2a18f5cc3 None None] MFA Rules not processed for user `d8673c91abf14c0b9a237f0499fdf20e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:07.412796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9acceaa0-38c7-4065-84cc-52e2a18f5cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:07.421768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 672/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jun 27 11:02:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:07.892313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=13 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:02:08.758938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d853808-842b-4015-86a6-e495b97e4365 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:08.759681 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d853808-842b-4015-86a6-e495b97e4365 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:08.759681 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d853808-842b-4015-86a6-e495b97e4365 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:08.760886 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 682/1354] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jun 27 11:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:08.766787 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f302a-924d-4d76-acc7-65cd748fc7ad None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:08.767249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f302a-924d-4d76-acc7-65cd748fc7ad None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:08.767554 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f302a-924d-4d76-acc7-65cd748fc7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:08.785299 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-203f302a-924d-4d76-acc7-65cd748fc7ad None None] MFA Rules not processed for user `d8673c91abf14c0b9a237f0499fdf20e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:08.786515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-203f302a-924d-4d76-acc7-65cd748fc7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:08.795070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 673/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jun 27 11:02:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:12.410822 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84095db9-2de7-45cd-9fe5-b7bbd6670a10 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:12.411340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84095db9-2de7-45cd-9fe5-b7bbd6670a10 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:12.411340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84095db9-2de7-45cd-9fe5-b7bbd6670a10 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:12.412815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 683/1356] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:12.420965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea8676-5a86-474b-899d-5ea273bbe6b7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:12.421436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea8676-5a86-474b-899d-5ea273bbe6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:12.421584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea8676-5a86-474b-899d-5ea273bbe6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:12.441534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-60ea8676-5a86-474b-899d-5ea273bbe6b7 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:12.442729 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-60ea8676-5a86-474b-899d-5ea273bbe6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:12.450832 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 674/1357] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:12.507929 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fadac-e927-446f-99fb-667dbd1dad7a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:12.508503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fadac-e927-446f-99fb-667dbd1dad7a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:12.508809 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fadac-e927-446f-99fb-667dbd1dad7a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:12.510334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 684/1358] 10.222.0.18 () {54 vars in 961 bytes} [Mon Jun 27 11:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:12.517255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57b29-578f-4660-b29b-d30901a6886f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:12.517711 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57b29-578f-4660-b29b-d30901a6886f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:12.517981 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57b29-578f-4660-b29b-d30901a6886f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:12.564757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:02:12.573494 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-55a57b29-578f-4660-b29b-d30901a6886f None None] MFA Rules not processed for user `ed08c367a3d34207a51914ff77a93898`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:12.574846 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-55a57b29-578f-4660-b29b-d30901a6886f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:12.659931 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 675/1359] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Jun 27 11:02:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:12.668057 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fadac-e927-446f-99fb-667dbd1dad7a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:02:12.684876 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fadac-e927-446f-99fb-667dbd1dad7a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:02:12.690745 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c78f5-b35c-4168-bc3e-710d8b1d0b4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:02:12.691570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c78f5-b35c-4168-bc3e-710d8b1d0b4b service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:12.692009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c78f5-b35c-4168-bc3e-710d8b1d0b4b service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:12.692447 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c78f5-b35c-4168-bc3e-710d8b1d0b4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:12.701549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c78f5-b35c-4168-bc3e-710d8b1d0b4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:02:12.703361 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c78f5-b35c-4168-bc3e-710d8b1d0b4b service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:02:12.715365 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 685/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:02:14.935902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ce538-a484-4cc0-8661-ef76821b5c21 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:14.936408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ce538-a484-4cc0-8661-ef76821b5c21 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:14.936519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ce538-a484-4cc0-8661-ef76821b5c21 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:14.938556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 676/1361] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:02:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:14.943708 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3560d-bd2a-49bf-b3f5-dfcb199000d6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:14.944113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3560d-bd2a-49bf-b3f5-dfcb199000d6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:14.944261 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3560d-bd2a-49bf-b3f5-dfcb199000d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:14.962582 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cfa3560d-bd2a-49bf-b3f5-dfcb199000d6 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:14.963772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cfa3560d-bd2a-49bf-b3f5-dfcb199000d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:14.971616 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 686/1362] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:15.016991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ce538-a484-4cc0-8661-ef76821b5c21 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:02:15.031546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ce538-a484-4cc0-8661-ef76821b5c21 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:02:15.037046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa6996-51bc-47b1-802c-288fe185982b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:02:15.037709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa6996-51bc-47b1-802c-288fe185982b service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:15.037995 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa6996-51bc-47b1-802c-288fe185982b service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:15.038269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa6996-51bc-47b1-802c-288fe185982b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:15.047323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa6996-51bc-47b1-802c-288fe185982b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:02:15.048911 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa6996-51bc-47b1-802c-288fe185982b service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:02:15.058770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 677/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:02:17.407166 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f8ceb-75bd-4513-89de-bd63c8988148 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:17.407610 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f8ceb-75bd-4513-89de-bd63c8988148 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:17.407735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f8ceb-75bd-4513-89de-bd63c8988148 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:17.409096 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 687/1364] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:02:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:17.414187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eeca4-9031-4e0f-acda-e2d5c7bd194e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:17.414603 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eeca4-9031-4e0f-acda-e2d5c7bd194e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:17.414745 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eeca4-9031-4e0f-acda-e2d5c7bd194e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:17.432505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8d7eeca4-9031-4e0f-acda-e2d5c7bd194e None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:17.433704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8d7eeca4-9031-4e0f-acda-e2d5c7bd194e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:17.441351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 678/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:17.488841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50df01c-7764-474d-820d-1da81ccf5eed None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:17.489165 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50df01c-7764-474d-820d-1da81ccf5eed None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:17.490122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50df01c-7764-474d-820d-1da81ccf5eed None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:17.490919 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 688/1366] 10.222.0.18 () {54 vars in 961 bytes} [Mon Jun 27 11:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:17.497045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14114900-3243-4935-9214-077935b5c4a1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:17.497305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14114900-3243-4935-9214-077935b5c4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:17.497720 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14114900-3243-4935-9214-077935b5c4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:17.519134 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-14114900-3243-4935-9214-077935b5c4a1 None None] MFA Rules not processed for user `ed08c367a3d34207a51914ff77a93898`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:17.520564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-14114900-3243-4935-9214-077935b5c4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:17.530205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 679/1367] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Jun 27 11:02:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:17.538485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50df01c-7764-474d-820d-1da81ccf5eed None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:02:17.552972 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50df01c-7764-474d-820d-1da81ccf5eed None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:02:17.558413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96fa9c-b558-40ca-a3ca-a8b036071b17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:02:17.559044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96fa9c-b558-40ca-a3ca-a8b036071b17 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:17.559330 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96fa9c-b558-40ca-a3ca-a8b036071b17 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:17.559610 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96fa9c-b558-40ca-a3ca-a8b036071b17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:17.567899 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96fa9c-b558-40ca-a3ca-a8b036071b17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:02:17.569689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96fa9c-b558-40ca-a3ca-a8b036071b17 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:02:17.580605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 689/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:02:19.672614 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694de8e9-5ed1-4cad-ad17-04c9c5bb6db5 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:19.673144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694de8e9-5ed1-4cad-ad17-04c9c5bb6db5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:19.673144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694de8e9-5ed1-4cad-ad17-04c9c5bb6db5 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:19.674877 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 680/1369] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:19.680218 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8c7a7-29c4-4c48-8f0c-0a36aac4e1f0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:19.680640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8c7a7-29c4-4c48-8f0c-0a36aac4e1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:19.680761 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8c7a7-29c4-4c48-8f0c-0a36aac4e1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:19.699237 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-66d8c7a7-29c4-4c48-8f0c-0a36aac4e1f0 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:19.700603 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-66d8c7a7-29c4-4c48-8f0c-0a36aac4e1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:19.708835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 690/1370] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:19.753588 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694de8e9-5ed1-4cad-ad17-04c9c5bb6db5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:02:19.768374 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694de8e9-5ed1-4cad-ad17-04c9c5bb6db5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:02:19.774279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c681620-461e-4dfd-8a39-697fed72df89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:02:19.775160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c681620-461e-4dfd-8a39-697fed72df89 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:19.775626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c681620-461e-4dfd-8a39-697fed72df89 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:19.776098 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c681620-461e-4dfd-8a39-697fed72df89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:19.786542 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c681620-461e-4dfd-8a39-697fed72df89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:02:19.788513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c681620-461e-4dfd-8a39-697fed72df89 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:02:19.802012 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 681/1371] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:02:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:02:20.557100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54a2f4-8344-4727-99e7-dcd4b4f627fc None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:20.557687 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54a2f4-8344-4727-99e7-dcd4b4f627fc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:20.558078 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54a2f4-8344-4727-99e7-dcd4b4f627fc None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:20.559577 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 691/1372] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:02:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:20.564961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ba050-0c07-4be5-a261-b64a06ef77a6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:20.565510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ba050-0c07-4be5-a261-b64a06ef77a6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:20.565796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ba050-0c07-4be5-a261-b64a06ef77a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:20.584612 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-385ba050-0c07-4be5-a261-b64a06ef77a6 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:20.586121 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-385ba050-0c07-4be5-a261-b64a06ef77a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:20.597395 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 682/1373] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:20.939918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5dfe8-eee5-40ff-8b15-78fd4d6c1966 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:20.940413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5dfe8-eee5-40ff-8b15-78fd4d6c1966 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:20.940607 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5dfe8-eee5-40ff-8b15-78fd4d6c1966 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:20.942838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 692/1374] 10.222.0.18 () {54 vars in 963 bytes} [Mon Jun 27 11:02:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:20.948524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cd485-9ebd-4731-8430-a13ff6ad2f11 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:20.949056 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cd485-9ebd-4731-8430-a13ff6ad2f11 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:20.949309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cd485-9ebd-4731-8430-a13ff6ad2f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:21.003361 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-547cd485-9ebd-4731-8430-a13ff6ad2f11 None None] MFA Rules not processed for user `521f3fcc63524d2d82b4a05a0dc062f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:21.004643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-547cd485-9ebd-4731-8430-a13ff6ad2f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:21.069986 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 683/1375] 10.222.0.18 () {58 vars in 1060 bytes} [Mon Jun 27 11:02:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:21.078035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5dfe8-eee5-40ff-8b15-78fd4d6c1966 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:02:21.089531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5dfe8-eee5-40ff-8b15-78fd4d6c1966 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:02:21.093287 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1b564-caa1-4eae-b711-b15250a2da45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:02:21.094221 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1b564-caa1-4eae-b711-b15250a2da45 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:21.094605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1b564-caa1-4eae-b711-b15250a2da45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:21.094983 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1b564-caa1-4eae-b711-b15250a2da45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:21.104536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1b564-caa1-4eae-b711-b15250a2da45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:02:21.106232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1b564-caa1-4eae-b711-b15250a2da45 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:02:21.116476 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 693/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:02:21.875304 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42640a-a368-4f71-aa6b-5dfc225a38cc None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:21.875820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42640a-a368-4f71-aa6b-5dfc225a38cc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:21.876218 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42640a-a368-4f71-aa6b-5dfc225a38cc None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:21.881353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 684/1377] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:02:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:21.882872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341283c2-3ad4-4e27-bcb6-a3d366fedb70 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:21.883165 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341283c2-3ad4-4e27-bcb6-a3d366fedb70 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:21.883444 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341283c2-3ad4-4e27-bcb6-a3d366fedb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:21.912306 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-341283c2-3ad4-4e27-bcb6-a3d366fedb70 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:21.913663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-341283c2-3ad4-4e27-bcb6-a3d366fedb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:21.921988 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 694/1378] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:21.967068 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42640a-a368-4f71-aa6b-5dfc225a38cc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:02:21.990030 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42640a-a368-4f71-aa6b-5dfc225a38cc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:02:21.995407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d828ce-efbd-424a-b775-1465b584272d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:02:21.996060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d828ce-efbd-424a-b775-1465b584272d service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:21.996330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d828ce-efbd-424a-b775-1465b584272d service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:21.996609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d828ce-efbd-424a-b775-1465b584272d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:22.004706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d828ce-efbd-424a-b775-1465b584272d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:02:22.006329 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d828ce-efbd-424a-b775-1465b584272d service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:02:22.010227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:02:22.017913 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 685/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:02:24.079863 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9ae4a-3e1f-4785-892a-a1ccea715d5e None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:24.080742 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9ae4a-3e1f-4785-892a-a1ccea715d5e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:24.081173 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9ae4a-3e1f-4785-892a-a1ccea715d5e None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:24.084667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 695/1380] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:02:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:24.090408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4102f1-5ad9-4d25-8bc4-e7250d948e1a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:24.091206 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4102f1-5ad9-4d25-8bc4-e7250d948e1a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:24.091632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4102f1-5ad9-4d25-8bc4-e7250d948e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:24.116102 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cc4102f1-5ad9-4d25-8bc4-e7250d948e1a None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:24.117741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cc4102f1-5ad9-4d25-8bc4-e7250d948e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:24.126676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 686/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:24.172483 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9ae4a-3e1f-4785-892a-a1ccea715d5e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:02:24.188966 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9ae4a-3e1f-4785-892a-a1ccea715d5e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:02:24.194367 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d466e5-769d-435d-a12a-92b26eeaed70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:02:24.195000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d466e5-769d-435d-a12a-92b26eeaed70 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:24.195277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d466e5-769d-435d-a12a-92b26eeaed70 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:24.195549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d466e5-769d-435d-a12a-92b26eeaed70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:24.204225 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d466e5-769d-435d-a12a-92b26eeaed70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:02:24.205939 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d466e5-769d-435d-a12a-92b26eeaed70 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:02:24.225553 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 696/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:02:26.274493 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6a948-4f88-47dc-945b-aec7376e1038 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:26.274974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6a948-4f88-47dc-945b-aec7376e1038 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:26.275058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6a948-4f88-47dc-945b-aec7376e1038 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:26.276399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 687/1383] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:26.282054 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1816d-4e38-4141-a212-eefc0524f307 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:26.282585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1816d-4e38-4141-a212-eefc0524f307 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:26.282585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1816d-4e38-4141-a212-eefc0524f307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:26.300034 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-12f1816d-4e38-4141-a212-eefc0524f307 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:26.301197 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-12f1816d-4e38-4141-a212-eefc0524f307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:26.309275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 697/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:26.351436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6a948-4f88-47dc-945b-aec7376e1038 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:02:26.366963 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6a948-4f88-47dc-945b-aec7376e1038 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:02:26.372829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a7cad-bac4-4b20-b694-cb5a5cb4bd9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:02:26.373615 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a7cad-bac4-4b20-b694-cb5a5cb4bd9e service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:26.373999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a7cad-bac4-4b20-b694-cb5a5cb4bd9e service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:26.374410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a7cad-bac4-4b20-b694-cb5a5cb4bd9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:26.383363 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a7cad-bac4-4b20-b694-cb5a5cb4bd9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:02:26.385050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a7cad-bac4-4b20-b694-cb5a5cb4bd9e service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:02:26.397322 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 688/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:02:28.440983 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb9e1b-abbc-4b27-8fc5-2126d67f1dd6 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:28.441551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb9e1b-abbc-4b27-8fc5-2126d67f1dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:28.441551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb9e1b-abbc-4b27-8fc5-2126d67f1dd6 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:28.442813 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 698/1386] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:28.451087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca0e43-a1c0-44d7-b4e8-844ebdc6411d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:28.451526 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca0e43-a1c0-44d7-b4e8-844ebdc6411d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:28.451526 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca0e43-a1c0-44d7-b4e8-844ebdc6411d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:28.495909 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e3ca0e43-a1c0-44d7-b4e8-844ebdc6411d None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:28.498328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e3ca0e43-a1c0-44d7-b4e8-844ebdc6411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:28.506109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 689/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:28.551317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb9e1b-abbc-4b27-8fc5-2126d67f1dd6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:02:28.567542 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb9e1b-abbc-4b27-8fc5-2126d67f1dd6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:02:28.572868 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4147f-355e-41d0-8ba2-536a25e0785e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:02:28.573539 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4147f-355e-41d0-8ba2-536a25e0785e service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:28.573821 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4147f-355e-41d0-8ba2-536a25e0785e service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:28.574094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4147f-355e-41d0-8ba2-536a25e0785e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:28.582762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4147f-355e-41d0-8ba2-536a25e0785e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:02:28.584334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4147f-355e-41d0-8ba2-536a25e0785e service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:02:28.593966 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 699/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:02:30.710683 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2714260-f794-4633-bc4a-bd7b1f5f230e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:30.711239 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2714260-f794-4633-bc4a-bd7b1f5f230e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:30.711397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2714260-f794-4633-bc4a-bd7b1f5f230e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:30.713174 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 690/1389] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:30.719061 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bae36f-261e-4e78-b3bb-efdb637f9a8e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:30.719481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bae36f-261e-4e78-b3bb-efdb637f9a8e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:30.719762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bae36f-261e-4e78-b3bb-efdb637f9a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:30.741466 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-43bae36f-261e-4e78-b3bb-efdb637f9a8e None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:30.743029 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-43bae36f-261e-4e78-b3bb-efdb637f9a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:30.753641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 700/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:30.800038 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2714260-f794-4633-bc4a-bd7b1f5f230e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:02:30.815164 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2714260-f794-4633-bc4a-bd7b1f5f230e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:02:30.820715 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea140b-b24e-4068-b88f-f3f737960244 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:02:30.821356 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea140b-b24e-4068-b88f-f3f737960244 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:30.821689 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea140b-b24e-4068-b88f-f3f737960244 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:30.821981 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea140b-b24e-4068-b88f-f3f737960244 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:30.831215 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea140b-b24e-4068-b88f-f3f737960244 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:02:30.832851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea140b-b24e-4068-b88f-f3f737960244 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:02:30.842809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 691/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:02:32.963726 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d0c06-ab27-46d0-9169-4d8506e62804 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:32.964292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d0c06-ab27-46d0-9169-4d8506e62804 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:32.964648 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d0c06-ab27-46d0-9169-4d8506e62804 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:32.966568 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 701/1392] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:32.972600 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61502e5e-665d-4836-97f9-5c7784310389 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:32.973186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61502e5e-665d-4836-97f9-5c7784310389 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:32.973186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61502e5e-665d-4836-97f9-5c7784310389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:32.995901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-61502e5e-665d-4836-97f9-5c7784310389 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:32.997513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-61502e5e-665d-4836-97f9-5c7784310389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:33.007644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 692/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:33.056127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d0c06-ab27-46d0-9169-4d8506e62804 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:02:33.070265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d0c06-ab27-46d0-9169-4d8506e62804 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:02:33.075931 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc66814-3e93-411e-94cc-02c88f548f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:02:33.076561 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66814-3e93-411e-94cc-02c88f548f16 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:33.076845 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66814-3e93-411e-94cc-02c88f548f16 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:33.077121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66814-3e93-411e-94cc-02c88f548f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:33.085710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc66814-3e93-411e-94cc-02c88f548f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:02:33.087274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc66814-3e93-411e-94cc-02c88f548f16 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:02:33.098911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 702/1394] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:02:35.291339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe3cdf-a2f3-46d2-9518-dabd719a3642 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:35.291935 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe3cdf-a2f3-46d2-9518-dabd719a3642 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:35.291935 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe3cdf-a2f3-46d2-9518-dabd719a3642 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:35.293275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 693/1395] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:35.298980 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcacbc-7d44-43c3-b9de-510ba8d8d33d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:35.299494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcacbc-7d44-43c3-b9de-510ba8d8d33d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:35.299595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcacbc-7d44-43c3-b9de-510ba8d8d33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:35.318098 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b3fcacbc-7d44-43c3-b9de-510ba8d8d33d None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:35.319270 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b3fcacbc-7d44-43c3-b9de-510ba8d8d33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:35.326948 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 703/1396] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:35.370094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe3cdf-a2f3-46d2-9518-dabd719a3642 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:02:35.384878 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe3cdf-a2f3-46d2-9518-dabd719a3642 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:02:35.390609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1d6a8-27b7-40bb-b0a7-67ed67bddb2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:02:35.391170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1d6a8-27b7-40bb-b0a7-67ed67bddb2d service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:35.391451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1d6a8-27b7-40bb-b0a7-67ed67bddb2d service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:35.391724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1d6a8-27b7-40bb-b0a7-67ed67bddb2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:35.399521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1d6a8-27b7-40bb-b0a7-67ed67bddb2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:02:35.401087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1d6a8-27b7-40bb-b0a7-67ed67bddb2d service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:02:35.410260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 694/1397] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:02:36.130500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75253613-d49c-4534-95e2-669a3cce6e0c None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:36.130787 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75253613-d49c-4534-95e2-669a3cce6e0c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:36.131065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75253613-d49c-4534-95e2-669a3cce6e0c None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:36.132491 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 704/1398] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:36.137861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bfc21-cfeb-417b-80f1-391abdb99f5c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:36.138152 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bfc21-cfeb-417b-80f1-391abdb99f5c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:36.138427 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bfc21-cfeb-417b-80f1-391abdb99f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:36.159557 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-df4bfc21-cfeb-417b-80f1-391abdb99f5c None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:36.160771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-df4bfc21-cfeb-417b-80f1-391abdb99f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:36.168498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 695/1399] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:36.223265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6032a-0be1-40fe-a4d7-374ac4ec838c None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:36.223624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6032a-0be1-40fe-a4d7-374ac4ec838c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:36.223968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6032a-0be1-40fe-a4d7-374ac4ec838c None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:36.225520 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 705/1400] 10.222.0.18 () {54 vars in 962 bytes} [Mon Jun 27 11:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:36.230509 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379a861-de75-40d8-9c01-fe44b70ecc41 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:36.230808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379a861-de75-40d8-9c01-fe44b70ecc41 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:36.231185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379a861-de75-40d8-9c01-fe44b70ecc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:36.278585 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0379a861-de75-40d8-9c01-fe44b70ecc41 None None] MFA Rules not processed for user `49b6436fdd7a4977a2e02c0e1b8be2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:36.279784 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0379a861-de75-40d8-9c01-fe44b70ecc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:36.342549 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 696/1401] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Jun 27 11:02:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:36.350094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6032a-0be1-40fe-a4d7-374ac4ec838c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:02:36.360556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6032a-0be1-40fe-a4d7-374ac4ec838c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:02:36.364106 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d91552-ee20-412c-81d5-a842949c67e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b6436fdd7a4977a2e02c0e1b8be2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:02:36.364730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d91552-ee20-412c-81d5-a842949c67e7 service glance] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:36.365234 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d91552-ee20-412c-81d5-a842949c67e7 service glance] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:36.365549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d91552-ee20-412c-81d5-a842949c67e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:36.374703 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d91552-ee20-412c-81d5-a842949c67e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:02:36.376117 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d91552-ee20-412c-81d5-a842949c67e7 service glance] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:02:36.385680 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 706/1402] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:02:37.081566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935ffbd-6c24-4118-a752-2cfc637fb418 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:37.081858 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935ffbd-6c24-4118-a752-2cfc637fb418 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:37.082137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935ffbd-6c24-4118-a752-2cfc637fb418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:37.131053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1935ffbd-6c24-4118-a752-2cfc637fb418 None None] MFA Rules not processed for user `40c6739db5404d59a6799b2ace1c7982`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:37.132228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1935ffbd-6c24-4118-a752-2cfc637fb418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:37.173798 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:02:37.198553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 697/1403] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jun 27 11:02:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:37.244316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfd5b8-2af5-43e1-9249-63a829f6b391 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:37.244808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfd5b8-2af5-43e1-9249-63a829f6b391 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:37.245086 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfd5b8-2af5-43e1-9249-63a829f6b391 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:37.246533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 707/1404] 10.222.0.18 () {54 vars in 942 bytes} [Mon Jun 27 11:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:37.252707 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9134af-4ba8-4d30-af9f-9b748f9e439f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:37.253005 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9134af-4ba8-4d30-af9f-9b748f9e439f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:37.253309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9134af-4ba8-4d30-af9f-9b748f9e439f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:37.302071 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2d9134af-4ba8-4d30-af9f-9b748f9e439f None None] MFA Rules not processed for user `189af68908944b5e9a7cb35fde0e1bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:37.303318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2d9134af-4ba8-4d30-af9f-9b748f9e439f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:37.377632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 698/1405] 10.222.0.18 () {58 vars in 1039 bytes} [Mon Jun 27 11:02:37 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:37.387035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfd5b8-2af5-43e1-9249-63a829f6b391 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:02:37.399943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfd5b8-2af5-43e1-9249-63a829f6b391 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:02:37.404736 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bae501-0037-4e24-b47c-2b9a53f34556 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189af68908944b5e9a7cb35fde0e1bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:02:37.405356 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bae501-0037-4e24-b47c-2b9a53f34556 service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:37.406159 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bae501-0037-4e24-b47c-2b9a53f34556 service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:37.406424 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bae501-0037-4e24-b47c-2b9a53f34556 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:37.414189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bae501-0037-4e24-b47c-2b9a53f34556 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:02:37.415755 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bae501-0037-4e24-b47c-2b9a53f34556 service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:02:37.424638 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 708/1406] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jun 27 11:02:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 11:02:37.460210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bb1d5-ca87-4a69-9676-cb021a4c76ab None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:37.460502 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bb1d5-ca87-4a69-9676-cb021a4c76ab None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:37.460784 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bb1d5-ca87-4a69-9676-cb021a4c76ab None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:37.462384 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 699/1407] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 11:02:37.468575 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63716-8046-494c-98c4-809ba6ed4c58 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:37.469000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63716-8046-494c-98c4-809ba6ed4c58 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:37.469276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63716-8046-494c-98c4-809ba6ed4c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:37.487646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-50f63716-8046-494c-98c4-809ba6ed4c58 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:37.489084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-50f63716-8046-494c-98c4-809ba6ed4c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:37.497815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 709/1408] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:02:37.544751 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bb1d5-ca87-4a69-9676-cb021a4c76ab None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:02:37.561072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bb1d5-ca87-4a69-9676-cb021a4c76ab None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:02:37.566735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9551c-a7df-400c-b58c-a1cab32e7145 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:02:37.567379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9551c-a7df-400c-b58c-a1cab32e7145 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:37.567662 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9551c-a7df-400c-b58c-a1cab32e7145 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:37.567942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9551c-a7df-400c-b58c-a1cab32e7145 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:37.579265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9551c-a7df-400c-b58c-a1cab32e7145 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:02:37.580894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9551c-a7df-400c-b58c-a1cab32e7145 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:02:37.591023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 700/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:02:47.481802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=69 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:02:47.586570 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=59 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:02:59.725606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7c4e8-1439-4d25-bff6-82f82c3d1b92 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:59.726195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7c4e8-1439-4d25-bff6-82f82c3d1b92 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:59.726195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7c4e8-1439-4d25-bff6-82f82c3d1b92 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:59.727530 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 710/1410] 10.222.0.18 () {54 vars in 918 bytes} [Mon Jun 27 11:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:59.732626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412d58-a909-456f-bf22-8b0ff00626d9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:59.733025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412d58-a909-456f-bf22-8b0ff00626d9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:59.733170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412d58-a909-456f-bf22-8b0ff00626d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:59.751092 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b3412d58-a909-456f-bf22-8b0ff00626d9 None None] MFA Rules not processed for user `d8673c91abf14c0b9a237f0499fdf20e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:59.752259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b3412d58-a909-456f-bf22-8b0ff00626d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:59.760582 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 701/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Jun 27 11:02:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:02:59.775186 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0ec63-946a-44eb-9acd-11bbd153c128 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:59.775468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0ec63-946a-44eb-9acd-11bbd153c128 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:59.775740 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0ec63-946a-44eb-9acd-11bbd153c128 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:59.777072 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 711/1412] 10.222.0.18 () {54 vars in 918 bytes} [Mon Jun 27 11:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:02:59.781598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74905a7d-60ea-4f92-9861-fedc7e9ed1a3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:02:59.781883 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74905a7d-60ea-4f92-9861-fedc7e9ed1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:02:59.782158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74905a7d-60ea-4f92-9861-fedc7e9ed1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:02:59.799116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-74905a7d-60ea-4f92-9861-fedc7e9ed1a3 None None] MFA Rules not processed for user `ed08c367a3d34207a51914ff77a93898`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:02:59.800268 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-74905a7d-60ea-4f92-9861-fedc7e9ed1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:02:59.809069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 702/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Jun 27 11:02:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:02.284169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79e609-516c-4537-bfe2-a9b7ea20070a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:02.284715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79e609-516c-4537-bfe2-a9b7ea20070a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:02.284715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79e609-516c-4537-bfe2-a9b7ea20070a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:02.286119 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 11:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:02.291278 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0640-895c-4747-81c5-307557deb5c2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:02.291687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0640-895c-4747-81c5-307557deb5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:02.291838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0640-895c-4747-81c5-307557deb5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:02.310087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f7ea0640-895c-4747-81c5-307557deb5c2 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:02.311313 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f7ea0640-895c-4747-81c5-307557deb5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:02.319046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 11:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:02.362766 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79e609-516c-4537-bfe2-a9b7ea20070a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:02.377815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79e609-516c-4537-bfe2-a9b7ea20070a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:02.383203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07febfd1-aff1-4915-becc-a332431039f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:02.383824 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07febfd1-aff1-4915-becc-a332431039f7 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:02.384101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07febfd1-aff1-4915-becc-a332431039f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:02.384382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07febfd1-aff1-4915-becc-a332431039f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:02.392983 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07febfd1-aff1-4915-becc-a332431039f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:02.394630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07febfd1-aff1-4915-becc-a332431039f7 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:02.403741 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 713/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:03.291836 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422cfc6-8b2f-4345-aafd-52ca9b15d3d0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:03.292378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422cfc6-8b2f-4345-aafd-52ca9b15d3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:03.292378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422cfc6-8b2f-4345-aafd-52ca9b15d3d0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:03.293790 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 11:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:03.299186 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e7e81-267a-4f3a-b721-1c9bbfae1d2e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:03.299616 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e7e81-267a-4f3a-b721-1c9bbfae1d2e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:03.299725 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e7e81-267a-4f3a-b721-1c9bbfae1d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:03.317918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-db6e7e81-267a-4f3a-b721-1c9bbfae1d2e None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:03.319100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-db6e7e81-267a-4f3a-b721-1c9bbfae1d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:03.326901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 11:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:03.475132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422cfc6-8b2f-4345-aafd-52ca9b15d3d0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:03.489685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422cfc6-8b2f-4345-aafd-52ca9b15d3d0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:03.494925 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b3789-9912-4f38-a611-2d84209998e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:03.495546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b3789-9912-4f38-a611-2d84209998e2 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:03.495826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b3789-9912-4f38-a611-2d84209998e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:03.496099 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b3789-9912-4f38-a611-2d84209998e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:03.504206 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b3789-9912-4f38-a611-2d84209998e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:03.505819 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b3789-9912-4f38-a611-2d84209998e2 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:03.515430 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 705/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:04.391375 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d008589-3970-4624-a15d-5133fc2018ba None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:04.391951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d008589-3970-4624-a15d-5133fc2018ba None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:04.391951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d008589-3970-4624-a15d-5133fc2018ba None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:04.393318 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 11:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:04.398118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a888288-73c2-473a-a2fa-02e36f751fe6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:04.398547 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a888288-73c2-473a-a2fa-02e36f751fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:04.398655 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a888288-73c2-473a-a2fa-02e36f751fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:04.416225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4a888288-73c2-473a-a2fa-02e36f751fe6 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:04.417423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4a888288-73c2-473a-a2fa-02e36f751fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:04.425108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 11:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:03:04.575631 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d008589-3970-4624-a15d-5133fc2018ba None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:04.589583 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d008589-3970-4624-a15d-5133fc2018ba None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:04.594973 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac3750-f947-4e66-93cb-d73ba7fd7024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:04.595598 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac3750-f947-4e66-93cb-d73ba7fd7024 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:04.595879 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac3750-f947-4e66-93cb-d73ba7fd7024 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:04.596155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac3750-f947-4e66-93cb-d73ba7fd7024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:04.604219 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac3750-f947-4e66-93cb-d73ba7fd7024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:04.605832 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac3750-f947-4e66-93cb-d73ba7fd7024 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:04.615998 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 716/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:05.465539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63aa60-7eeb-4f0b-baf6-2eb4e6eec8a0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:05.466050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63aa60-7eeb-4f0b-baf6-2eb4e6eec8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:05.466050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63aa60-7eeb-4f0b-baf6-2eb4e6eec8a0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:05.468028 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 11:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:05.472913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11977588-a76b-4547-811d-5f0d54ae14e9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:05.473314 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11977588-a76b-4547-811d-5f0d54ae14e9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:05.473497 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11977588-a76b-4547-811d-5f0d54ae14e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:05.491047 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-11977588-a76b-4547-811d-5f0d54ae14e9 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:05.492234 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-11977588-a76b-4547-811d-5f0d54ae14e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:05.499910 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 11:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:05.650720 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63aa60-7eeb-4f0b-baf6-2eb4e6eec8a0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:05.664796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63aa60-7eeb-4f0b-baf6-2eb4e6eec8a0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:05.670138 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2514a32-111d-4500-93c9-50432b6cfc27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:05.670769 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2514a32-111d-4500-93c9-50432b6cfc27 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:05.671052 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2514a32-111d-4500-93c9-50432b6cfc27 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:05.671327 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2514a32-111d-4500-93c9-50432b6cfc27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:05.679272 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2514a32-111d-4500-93c9-50432b6cfc27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:05.680851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2514a32-111d-4500-93c9-50432b6cfc27 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:05.690619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 708/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:06.533520 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc96126-b9f8-44d9-a703-c26e81b74cb5 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:06.534048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc96126-b9f8-44d9-a703-c26e81b74cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:06.534048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc96126-b9f8-44d9-a703-c26e81b74cb5 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:06.535392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 11:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:06.540377 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5bc8c-9a01-485d-abc3-11f51d3b1d07 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:06.540820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5bc8c-9a01-485d-abc3-11f51d3b1d07 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:06.540925 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5bc8c-9a01-485d-abc3-11f51d3b1d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:06.559273 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9fd5bc8c-9a01-485d-abc3-11f51d3b1d07 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:06.560500 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9fd5bc8c-9a01-485d-abc3-11f51d3b1d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:06.568306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 11:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:06.716795 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc96126-b9f8-44d9-a703-c26e81b74cb5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:06.731676 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc96126-b9f8-44d9-a703-c26e81b74cb5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:06.737576 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf430e1c-9363-4891-983e-b1fd3862b850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:06.738194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf430e1c-9363-4891-983e-b1fd3862b850 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:06.738473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf430e1c-9363-4891-983e-b1fd3862b850 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:06.738743 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf430e1c-9363-4891-983e-b1fd3862b850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:06.746608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf430e1c-9363-4891-983e-b1fd3862b850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:06.748190 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf430e1c-9363-4891-983e-b1fd3862b850 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:06.757273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 719/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:07.556789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13c2ac-a9fd-4095-9865-92109c3d4945 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:07.557339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13c2ac-a9fd-4095-9865-92109c3d4945 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:07.557339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13c2ac-a9fd-4095-9865-92109c3d4945 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:07.558789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 11:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:07.564243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276f68b-8075-4760-beb4-efc30de53337 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:07.564700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276f68b-8075-4760-beb4-efc30de53337 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:07.564807 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276f68b-8075-4760-beb4-efc30de53337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:07.582398 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a276f68b-8075-4760-beb4-efc30de53337 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:07.583581 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a276f68b-8075-4760-beb4-efc30de53337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:07.591358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 11:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:07.739121 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13c2ac-a9fd-4095-9865-92109c3d4945 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:07.753879 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13c2ac-a9fd-4095-9865-92109c3d4945 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:07.759261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc210e59-2824-4d09-a33a-6c818045024f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:07.759895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc210e59-2824-4d09-a33a-6c818045024f service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:07.760184 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc210e59-2824-4d09-a33a-6c818045024f service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:07.760463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc210e59-2824-4d09-a33a-6c818045024f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:07.768720 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc210e59-2824-4d09-a33a-6c818045024f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:07.770338 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc210e59-2824-4d09-a33a-6c818045024f service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:07.779795 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 711/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:08.577268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0708cfe-1709-4fe6-aacb-7ac8030b3760 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:08.577859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0708cfe-1709-4fe6-aacb-7ac8030b3760 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:08.577859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0708cfe-1709-4fe6-aacb-7ac8030b3760 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:08.579269 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 11:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:08.584107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0791f3-0f8e-4738-b22a-8e25d77d783c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:08.584548 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0791f3-0f8e-4738-b22a-8e25d77d783c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:08.584693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0791f3-0f8e-4738-b22a-8e25d77d783c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:08.602892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-be0791f3-0f8e-4738-b22a-8e25d77d783c None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:08.604078 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-be0791f3-0f8e-4738-b22a-8e25d77d783c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:08.611822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 11:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:08.762014 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0708cfe-1709-4fe6-aacb-7ac8030b3760 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:08.776402 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0708cfe-1709-4fe6-aacb-7ac8030b3760 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:08.781649 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75234a53-57ab-49fe-befa-c1ca9f68d3dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:08.782265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75234a53-57ab-49fe-befa-c1ca9f68d3dc service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:08.782541 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75234a53-57ab-49fe-befa-c1ca9f68d3dc service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:08.782809 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75234a53-57ab-49fe-befa-c1ca9f68d3dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:08.790773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75234a53-57ab-49fe-befa-c1ca9f68d3dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:08.792332 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75234a53-57ab-49fe-befa-c1ca9f68d3dc service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:08.801460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 722/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:09.595854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6804709-7923-4b5a-9c37-1778ded30180 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:09.596379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6804709-7923-4b5a-9c37-1778ded30180 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:09.596379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6804709-7923-4b5a-9c37-1778ded30180 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:09.597818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 11:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:09.602615 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223595d8-c6fa-46aa-94e6-3099eddfea6f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:09.603060 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223595d8-c6fa-46aa-94e6-3099eddfea6f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:09.603185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223595d8-c6fa-46aa-94e6-3099eddfea6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:09.621135 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-223595d8-c6fa-46aa-94e6-3099eddfea6f None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:09.622410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-223595d8-c6fa-46aa-94e6-3099eddfea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:09.630219 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 11:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:09.779122 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6804709-7923-4b5a-9c37-1778ded30180 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:09.793705 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6804709-7923-4b5a-9c37-1778ded30180 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:09.798963 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb80cbe-e6be-44d9-8d05-e04fafdd660f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:09.799581 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb80cbe-e6be-44d9-8d05-e04fafdd660f service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:09.799859 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb80cbe-e6be-44d9-8d05-e04fafdd660f service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:09.800131 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb80cbe-e6be-44d9-8d05-e04fafdd660f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:09.808049 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb80cbe-e6be-44d9-8d05-e04fafdd660f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:09.809638 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb80cbe-e6be-44d9-8d05-e04fafdd660f service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:09.818808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 714/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:10.612229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9375826-5274-434f-8d39-9c7b41953039 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:10.612766 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9375826-5274-434f-8d39-9c7b41953039 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:10.612895 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9375826-5274-434f-8d39-9c7b41953039 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:10.614226 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 11:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:10.619004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629422c-c200-40f9-9965-3b8d68b122d1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:10.619415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629422c-c200-40f9-9965-3b8d68b122d1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:10.619593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629422c-c200-40f9-9965-3b8d68b122d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:10.638213 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3629422c-c200-40f9-9965-3b8d68b122d1 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:10.639466 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3629422c-c200-40f9-9965-3b8d68b122d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:10.647121 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 11:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:10.794517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9375826-5274-434f-8d39-9c7b41953039 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:10.809022 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9375826-5274-434f-8d39-9c7b41953039 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:10.814930 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace14633-4ccb-4aa5-8206-c1c742220def service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:10.815549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace14633-4ccb-4aa5-8206-c1c742220def service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:10.815827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace14633-4ccb-4aa5-8206-c1c742220def service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:10.816098 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace14633-4ccb-4aa5-8206-c1c742220def service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:10.823931 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace14633-4ccb-4aa5-8206-c1c742220def service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:10.825526 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace14633-4ccb-4aa5-8206-c1c742220def service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:10.834786 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 725/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:12.730214 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935480e-6bda-4121-9993-d5451dc1390c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:12.730753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935480e-6bda-4121-9993-d5451dc1390c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:12.730753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935480e-6bda-4121-9993-d5451dc1390c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:12.732180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 11:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:12.738141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320022e-4012-413b-8dc1-00478301cea7 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:12.738561 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320022e-4012-413b-8dc1-00478301cea7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:12.738692 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320022e-4012-413b-8dc1-00478301cea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:12.755813 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3320022e-4012-413b-8dc1-00478301cea7 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:12.756983 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3320022e-4012-413b-8dc1-00478301cea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:12.765736 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 11:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:12.803358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935480e-6bda-4121-9993-d5451dc1390c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:12.813914 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935480e-6bda-4121-9993-d5451dc1390c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:12.817343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f454d21-941a-4219-9418-5a887ed0d3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:12.817992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454d21-941a-4219-9418-5a887ed0d3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:12.818278 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454d21-941a-4219-9418-5a887ed0d3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:12.818560 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454d21-941a-4219-9418-5a887ed0d3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:12.827814 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f454d21-941a-4219-9418-5a887ed0d3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:12.829237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f454d21-941a-4219-9418-5a887ed0d3d5 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:12.838507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 717/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:14.992658 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f1d38-ed86-4793-9e8c-30bda27ff3bc None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:14.993224 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f1d38-ed86-4793-9e8c-30bda27ff3bc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:14.993224 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f1d38-ed86-4793-9e8c-30bda27ff3bc None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:14.994645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 11:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:14.999807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bc6f5-6de4-4ba4-85ac-4432eae2983a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:15.000216 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bc6f5-6de4-4ba4-85ac-4432eae2983a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:15.000364 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bc6f5-6de4-4ba4-85ac-4432eae2983a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:15.018406 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e80bc6f5-6de4-4ba4-85ac-4432eae2983a None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:15.019580 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e80bc6f5-6de4-4ba4-85ac-4432eae2983a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:15.027165 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 11:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:15.064145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f1d38-ed86-4793-9e8c-30bda27ff3bc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:15.074781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f1d38-ed86-4793-9e8c-30bda27ff3bc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:15.078774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2eba7-298b-430a-bbf1-a7775cb2f80a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:15.079424 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2eba7-298b-430a-bbf1-a7775cb2f80a service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:15.079706 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2eba7-298b-430a-bbf1-a7775cb2f80a service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:15.079976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2eba7-298b-430a-bbf1-a7775cb2f80a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:15.088607 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2eba7-298b-430a-bbf1-a7775cb2f80a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:15.090056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2eba7-298b-430a-bbf1-a7775cb2f80a service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:15.099779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 728/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:17.414954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5382d6-1ae3-4e51-abf5-21c3cb49bd23 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:17.415481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5382d6-1ae3-4e51-abf5-21c3cb49bd23 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:17.415481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5382d6-1ae3-4e51-abf5-21c3cb49bd23 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:17.416806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 11:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:17.422173 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e37594-9bce-47a4-85b4-d5256763eac3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:17.422584 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e37594-9bce-47a4-85b4-d5256763eac3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:17.422779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e37594-9bce-47a4-85b4-d5256763eac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:17.440033 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a0e37594-9bce-47a4-85b4-d5256763eac3 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:17.441209 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a0e37594-9bce-47a4-85b4-d5256763eac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:17.448858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 11:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:17.487097 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5382d6-1ae3-4e51-abf5-21c3cb49bd23 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:17.497561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5382d6-1ae3-4e51-abf5-21c3cb49bd23 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:17.501015 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313a83e-c326-42aa-888c-d6234acab551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:17.501669 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313a83e-c326-42aa-888c-d6234acab551 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:17.501956 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313a83e-c326-42aa-888c-d6234acab551 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:17.502233 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313a83e-c326-42aa-888c-d6234acab551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:17.511048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313a83e-c326-42aa-888c-d6234acab551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:17.512720 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313a83e-c326-42aa-888c-d6234acab551 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:17.522553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 720/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:19.659726 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5617169-00c6-48d7-9b08-07cc6750d282 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:19.660309 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5617169-00c6-48d7-9b08-07cc6750d282 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:19.660309 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5617169-00c6-48d7-9b08-07cc6750d282 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:19.662063 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 11:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:19.667833 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82411d2a-80af-4a52-a2e8-1b07e0391ce7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:19.668333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82411d2a-80af-4a52-a2e8-1b07e0391ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:19.668449 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82411d2a-80af-4a52-a2e8-1b07e0391ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:19.689281 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-82411d2a-80af-4a52-a2e8-1b07e0391ce7 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:19.690517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-82411d2a-80af-4a52-a2e8-1b07e0391ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:19.698358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 11:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:19.736897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5617169-00c6-48d7-9b08-07cc6750d282 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:19.747321 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5617169-00c6-48d7-9b08-07cc6750d282 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:19.751402 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc8f4f-a244-4c25-8301-e844837382a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:19.752022 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc8f4f-a244-4c25-8301-e844837382a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:19.752297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc8f4f-a244-4c25-8301-e844837382a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:19.752565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc8f4f-a244-4c25-8301-e844837382a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:19.761114 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc8f4f-a244-4c25-8301-e844837382a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:19.762817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc8f4f-a244-4c25-8301-e844837382a5 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:19.772264 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 731/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:21.854667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4498b-7996-4e63-bcc5-a1018077e148 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:21.855263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4498b-7996-4e63-bcc5-a1018077e148 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:21.855263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4498b-7996-4e63-bcc5-a1018077e148 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:21.856605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 11:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:21.862378 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cc9f4-fe1d-4609-8b86-d4aba3409b55 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:21.862778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cc9f4-fe1d-4609-8b86-d4aba3409b55 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:21.862930 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cc9f4-fe1d-4609-8b86-d4aba3409b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:21.881243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ac4cc9f4-fe1d-4609-8b86-d4aba3409b55 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:21.882446 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ac4cc9f4-fe1d-4609-8b86-d4aba3409b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:21.890380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 11:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:21.927995 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4498b-7996-4e63-bcc5-a1018077e148 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:21.939137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4498b-7996-4e63-bcc5-a1018077e148 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:21.942615 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da7063-b644-4f72-b618-c4a1fbde79ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:21.943233 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da7063-b644-4f72-b618-c4a1fbde79ca service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:21.943509 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da7063-b644-4f72-b618-c4a1fbde79ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:21.943777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da7063-b644-4f72-b618-c4a1fbde79ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:21.952458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da7063-b644-4f72-b618-c4a1fbde79ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:21.953923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da7063-b644-4f72-b618-c4a1fbde79ca service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:21.963162 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 723/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:24.042892 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81832a-3580-4482-81db-7f48929f9140 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:24.043452 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81832a-3580-4482-81db-7f48929f9140 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:24.043452 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81832a-3580-4482-81db-7f48929f9140 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:24.044849 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 11:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:24.050154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c729e-60bc-436a-a152-c6d84d5f592e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:24.050587 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c729e-60bc-436a-a152-c6d84d5f592e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:24.050691 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c729e-60bc-436a-a152-c6d84d5f592e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:24.067963 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-490c729e-60bc-436a-a152-c6d84d5f592e None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:24.069137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-490c729e-60bc-436a-a152-c6d84d5f592e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:24.077678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 11:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:24.115498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81832a-3580-4482-81db-7f48929f9140 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:24.127024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81832a-3580-4482-81db-7f48929f9140 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:24.130493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745b453-de74-4121-ae9e-5534255be9f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:24.131116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745b453-de74-4121-ae9e-5534255be9f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:24.131396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745b453-de74-4121-ae9e-5534255be9f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:24.131672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745b453-de74-4121-ae9e-5534255be9f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:24.141074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745b453-de74-4121-ae9e-5534255be9f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:24.142514 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745b453-de74-4121-ae9e-5534255be9f4 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:24.151661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 734/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:26.213716 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060361d-625f-4397-a62d-02c21e7c8d85 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:26.214155 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060361d-625f-4397-a62d-02c21e7c8d85 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:26.214265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060361d-625f-4397-a62d-02c21e7c8d85 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:26.215648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 11:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:26.220978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a69b9c-4ee3-4598-b3e6-6f70aef20b8f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:26.221403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a69b9c-4ee3-4598-b3e6-6f70aef20b8f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:26.221568 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a69b9c-4ee3-4598-b3e6-6f70aef20b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:26.238795 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-62a69b9c-4ee3-4598-b3e6-6f70aef20b8f None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:26.239979 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-62a69b9c-4ee3-4598-b3e6-6f70aef20b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:26.247656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 11:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:26.285861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060361d-625f-4397-a62d-02c21e7c8d85 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:26.297089 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060361d-625f-4397-a62d-02c21e7c8d85 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:26.300612 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3193af8-336e-4838-9c95-57b4498b8d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:26.301236 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3193af8-336e-4838-9c95-57b4498b8d45 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:26.301557 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3193af8-336e-4838-9c95-57b4498b8d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:26.301831 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3193af8-336e-4838-9c95-57b4498b8d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:26.311237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3193af8-336e-4838-9c95-57b4498b8d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:26.312660 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3193af8-336e-4838-9c95-57b4498b8d45 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:26.321883 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 726/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:28.388598 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14ccd7-13c9-4000-8dbc-9eb3267e34ac None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:28.389134 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14ccd7-13c9-4000-8dbc-9eb3267e34ac None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:28.389338 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14ccd7-13c9-4000-8dbc-9eb3267e34ac None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:28.390585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 11:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:28.395692 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99154477-790e-4e64-93b2-9f9a547706a9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:28.396109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99154477-790e-4e64-93b2-9f9a547706a9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:28.396251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99154477-790e-4e64-93b2-9f9a547706a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:28.402252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=79 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:03:28.414972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-99154477-790e-4e64-93b2-9f9a547706a9 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:28.416141 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-99154477-790e-4e64-93b2-9f9a547706a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:28.424456 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 11:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:28.461320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14ccd7-13c9-4000-8dbc-9eb3267e34ac None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:28.466621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=73 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:03:28.473613 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14ccd7-13c9-4000-8dbc-9eb3267e34ac None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:28.477118 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce760d-4d67-4238-8a6a-a42a6cf439af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:28.477793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce760d-4d67-4238-8a6a-a42a6cf439af service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:28.478076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce760d-4d67-4238-8a6a-a42a6cf439af service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:28.478380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce760d-4d67-4238-8a6a-a42a6cf439af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:28.487936 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce760d-4d67-4238-8a6a-a42a6cf439af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:28.489357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce760d-4d67-4238-8a6a-a42a6cf439af service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:28.498592 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 737/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:30.522987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870b1ea-41de-4911-904c-cc670f756f50 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:30.523513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870b1ea-41de-4911-904c-cc670f756f50 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:30.523513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870b1ea-41de-4911-904c-cc670f756f50 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:30.524878 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 11:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:30.530036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdd1e9-27ab-4edc-ab48-259f31f417e8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:30.530437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdd1e9-27ab-4edc-ab48-259f31f417e8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:30.530592 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdd1e9-27ab-4edc-ab48-259f31f417e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:30.547735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-77fdd1e9-27ab-4edc-ab48-259f31f417e8 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:30.548931 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-77fdd1e9-27ab-4edc-ab48-259f31f417e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:30.556601 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 11:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:30.593496 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870b1ea-41de-4911-904c-cc670f756f50 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:30.604200 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870b1ea-41de-4911-904c-cc670f756f50 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:30.607762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d119f-82f2-457e-b2a0-a0ddea23c02c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:30.608387 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d119f-82f2-457e-b2a0-a0ddea23c02c service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:30.608671 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d119f-82f2-457e-b2a0-a0ddea23c02c service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:30.608947 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d119f-82f2-457e-b2a0-a0ddea23c02c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:30.617746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d119f-82f2-457e-b2a0-a0ddea23c02c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:30.619172 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d119f-82f2-457e-b2a0-a0ddea23c02c service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:30.628959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 729/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:32.651838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a351f52-476f-433e-9aa5-33f25d7d870c None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:32.652395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a351f52-476f-433e-9aa5-33f25d7d870c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:32.652395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a351f52-476f-433e-9aa5-33f25d7d870c None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:32.653803 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 11:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:32.659619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363764b-0b43-43b9-b31c-bd07a3a04491 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:32.660015 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363764b-0b43-43b9-b31c-bd07a3a04491 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:32.660186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363764b-0b43-43b9-b31c-bd07a3a04491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:32.678690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8363764b-0b43-43b9-b31c-bd07a3a04491 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:32.679872 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8363764b-0b43-43b9-b31c-bd07a3a04491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:32.687554 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 11:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:32.724157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a351f52-476f-433e-9aa5-33f25d7d870c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:32.725823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8a351f52-476f-433e-9aa5-33f25d7d870c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:32.739351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a351f52-476f-433e-9aa5-33f25d7d870c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:32.742836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5fbf1-f1a7-4ef1-a1a0-4cc1d17b276d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:32.743468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5fbf1-f1a7-4ef1-a1a0-4cc1d17b276d service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:32.743748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5fbf1-f1a7-4ef1-a1a0-4cc1d17b276d service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:32.744023 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5fbf1-f1a7-4ef1-a1a0-4cc1d17b276d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:32.752811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5fbf1-f1a7-4ef1-a1a0-4cc1d17b276d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:32.754252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5fbf1-f1a7-4ef1-a1a0-4cc1d17b276d service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:32.763803 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 740/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:42.672999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=11 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:03:42.759432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=14 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:03:52.371076 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291cdab-1869-426a-8261-47cf9e0e0050 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:52.371706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291cdab-1869-426a-8261-47cf9e0e0050 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:52.371706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291cdab-1869-426a-8261-47cf9e0e0050 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:52.373593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 731/1471] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:03:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:52.378932 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcadc3-adf2-4cc7-840d-a0071bb5729a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:52.379377 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcadc3-adf2-4cc7-840d-a0071bb5729a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:52.379478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcadc3-adf2-4cc7-840d-a0071bb5729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:52.397722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9efcadc3-adf2-4cc7-840d-a0071bb5729a None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:52.398904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9efcadc3-adf2-4cc7-840d-a0071bb5729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:52.406951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 741/1472] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:52.453218 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d203c-985e-4591-84a1-a772ceea18ff None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:52.453526 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d203c-985e-4591-84a1-a772ceea18ff None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:52.453801 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d203c-985e-4591-84a1-a772ceea18ff None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:52.455153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 732/1473] 10.222.0.18 () {54 vars in 962 bytes} [Mon Jun 27 11:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:52.459968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe01bfe-ca40-4a96-ba2e-4d535bfbaf3f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:52.460252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe01bfe-ca40-4a96-ba2e-4d535bfbaf3f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:52.460525 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe01bfe-ca40-4a96-ba2e-4d535bfbaf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:52.478559 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ebe01bfe-ca40-4a96-ba2e-4d535bfbaf3f None None] MFA Rules not processed for user `49b6436fdd7a4977a2e02c0e1b8be2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:52.479725 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ebe01bfe-ca40-4a96-ba2e-4d535bfbaf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:52.486057 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 742/1474] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Jun 27 11:03:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:03:52.493293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d203c-985e-4591-84a1-a772ceea18ff None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:52.504211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d203c-985e-4591-84a1-a772ceea18ff None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:52.507701 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6924c-a297-43ee-9b73-208f5cea8451 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b6436fdd7a4977a2e02c0e1b8be2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:52.508314 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6924c-a297-43ee-9b73-208f5cea8451 service glance] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:52.508593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6924c-a297-43ee-9b73-208f5cea8451 service glance] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:52.508864 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6924c-a297-43ee-9b73-208f5cea8451 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:52.518553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6924c-a297-43ee-9b73-208f5cea8451 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:52.519974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6924c-a297-43ee-9b73-208f5cea8451 service glance] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:52.529213 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 733/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:03:54.617827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b48e8-ca30-40b6-a3a0-281a3f9aafd8 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:54.618393 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b48e8-ca30-40b6-a3a0-281a3f9aafd8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:54.618393 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b48e8-ca30-40b6-a3a0-281a3f9aafd8 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:54.619829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 743/1476] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:54.624858 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550c34c-da7d-430b-836d-e12b066b17f2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:54.625250 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550c34c-da7d-430b-836d-e12b066b17f2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:54.625445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550c34c-da7d-430b-836d-e12b066b17f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:54.642728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f550c34c-da7d-430b-836d-e12b066b17f2 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:54.643895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f550c34c-da7d-430b-836d-e12b066b17f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:54.651523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 734/1477] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:03:54.675866 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b48e8-ca30-40b6-a3a0-281a3f9aafd8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:54.688166 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b48e8-ca30-40b6-a3a0-281a3f9aafd8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:54.692572 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabd1a8-8e0b-4f0e-8f90-5c0ef2655c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:54.693201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabd1a8-8e0b-4f0e-8f90-5c0ef2655c00 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:54.693513 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabd1a8-8e0b-4f0e-8f90-5c0ef2655c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:54.693788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabd1a8-8e0b-4f0e-8f90-5c0ef2655c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:54.694508 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabd1a8-8e0b-4f0e-8f90-5c0ef2655c00 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:54.696292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-5cabd1a8-8e0b-4f0e-8f90-5c0ef2655c00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 11:03:54.696292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Jun 27 11:03:54.696292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: Jun 27 11:03:54.697440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabd1a8-8e0b-4f0e-8f90-5c0ef2655c00 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:54.715777 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 744/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jun 27 11:03:54 2022] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:03:56.786950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f22ea3-4f92-4515-bbf0-8a8fb91c588b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:56.787516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f22ea3-4f92-4515-bbf0-8a8fb91c588b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:56.787516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f22ea3-4f92-4515-bbf0-8a8fb91c588b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:56.788866 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 735/1479] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:56.794002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b78bde-7b1c-4c39-9c7a-00a3caa6c094 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:56.794428 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b78bde-7b1c-4c39-9c7a-00a3caa6c094 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:56.794605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b78bde-7b1c-4c39-9c7a-00a3caa6c094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:56.812610 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-73b78bde-7b1c-4c39-9c7a-00a3caa6c094 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:56.813821 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-73b78bde-7b1c-4c39-9c7a-00a3caa6c094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:56.821479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 745/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:03:56.864755 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f22ea3-4f92-4515-bbf0-8a8fb91c588b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:56.878992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f22ea3-4f92-4515-bbf0-8a8fb91c588b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:56.884298 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14533391-3380-4be8-9736-3ee90c3f6580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:56.884929 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14533391-3380-4be8-9736-3ee90c3f6580 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:56.885213 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14533391-3380-4be8-9736-3ee90c3f6580 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:56.885582 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14533391-3380-4be8-9736-3ee90c3f6580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:56.893903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14533391-3380-4be8-9736-3ee90c3f6580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:56.895484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14533391-3380-4be8-9736-3ee90c3f6580 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:56.905341 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 736/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:03:59.090031 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dfd9e-c24c-4f83-8a41-13a58c6206e9 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:59.090577 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dfd9e-c24c-4f83-8a41-13a58c6206e9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:59.090577 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dfd9e-c24c-4f83-8a41-13a58c6206e9 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:59.092461 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 746/1482] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:03:59.097650 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0be263-836c-484f-b837-16990c2127b5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:59.098076 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0be263-836c-484f-b837-16990c2127b5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:59.098186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0be263-836c-484f-b837-16990c2127b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:59.116610 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4b0be263-836c-484f-b837-16990c2127b5 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:03:59.117948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4b0be263-836c-484f-b837-16990c2127b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:03:59.125940 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 737/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:03:59.162480 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dfd9e-c24c-4f83-8a41-13a58c6206e9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:03:59.175074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dfd9e-c24c-4f83-8a41-13a58c6206e9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:03:59.179600 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0c41f-823f-4f47-8adf-552a4edfa791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:03:59.180484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0c41f-823f-4f47-8adf-552a4edfa791 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:03:59.180987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0c41f-823f-4f47-8adf-552a4edfa791 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:03:59.181502 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0c41f-823f-4f47-8adf-552a4edfa791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:03:59.192982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0c41f-823f-4f47-8adf-552a4edfa791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:03:59.194818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0c41f-823f-4f47-8adf-552a4edfa791 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:03:59.205899 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 747/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:04:01.260038 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf49714-ba94-4a07-9ba9-c22ee04bb5cc None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:04:01.260541 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf49714-ba94-4a07-9ba9-c22ee04bb5cc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:04:01.260662 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf49714-ba94-4a07-9ba9-c22ee04bb5cc None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:04:01.262009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 738/1485] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:04:01.268217 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08223592-035e-426b-bff1-1de46661e822 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:04:01.268646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08223592-035e-426b-bff1-1de46661e822 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:04:01.268753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08223592-035e-426b-bff1-1de46661e822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:04:01.285897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-08223592-035e-426b-bff1-1de46661e822 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:04:01.287059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-08223592-035e-426b-bff1-1de46661e822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:04:01.294654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 748/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:04:01.332684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf49714-ba94-4a07-9ba9-c22ee04bb5cc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:04:01.343151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf49714-ba94-4a07-9ba9-c22ee04bb5cc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:04:01.346873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aeb59f-c0e0-4b1c-ae16-af8fbce48a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:04:01.347492 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeb59f-c0e0-4b1c-ae16-af8fbce48a16 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:04:01.347769 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeb59f-c0e0-4b1c-ae16-af8fbce48a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:04:01.348040 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeb59f-c0e0-4b1c-ae16-af8fbce48a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:04:01.356662 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aeb59f-c0e0-4b1c-ae16-af8fbce48a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:04:01.358118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aeb59f-c0e0-4b1c-ae16-af8fbce48a16 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:04:01.367233 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 739/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:04:03.525451 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079f7ad-d6e8-48d0-9b9f-0c9694dc10bb None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:04:03.525991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079f7ad-d6e8-48d0-9b9f-0c9694dc10bb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:04:03.525991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079f7ad-d6e8-48d0-9b9f-0c9694dc10bb None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:04:03.527294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 749/1488] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:04:03.532516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49075abd-f073-40dd-8f63-39a1c6889ccc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:04:03.532971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49075abd-f073-40dd-8f63-39a1c6889ccc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:04:03.533082 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49075abd-f073-40dd-8f63-39a1c6889ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:04:03.550236 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-49075abd-f073-40dd-8f63-39a1c6889ccc None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:04:03.551402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-49075abd-f073-40dd-8f63-39a1c6889ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:04:03.559018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 740/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:04:03.599331 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079f7ad-d6e8-48d0-9b9f-0c9694dc10bb None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:04:03.610116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079f7ad-d6e8-48d0-9b9f-0c9694dc10bb None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:04:03.613539 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfa3e4-a2db-414d-ab6d-acceaa15e938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:04:03.614158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfa3e4-a2db-414d-ab6d-acceaa15e938 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:04:03.614438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfa3e4-a2db-414d-ab6d-acceaa15e938 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:04:03.614711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfa3e4-a2db-414d-ab6d-acceaa15e938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:04:03.623800 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfa3e4-a2db-414d-ab6d-acceaa15e938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:04:03.625240 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfa3e4-a2db-414d-ab6d-acceaa15e938 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:04:03.634397 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 750/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:04:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:04:05.820236 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e7cdf-b9f3-4907-a2d5-0ee6076bf39a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:04:05.820755 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e7cdf-b9f3-4907-a2d5-0ee6076bf39a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:04:05.820879 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e7cdf-b9f3-4907-a2d5-0ee6076bf39a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:04:05.822179 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 741/1491] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jun 27 11:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:04:05.827260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4b252-320e-4989-823b-ee664b84dfdc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:04:05.827656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4b252-320e-4989-823b-ee664b84dfdc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:04:05.827814 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4b252-320e-4989-823b-ee664b84dfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:04:05.845443 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-dde4b252-320e-4989-823b-ee664b84dfdc None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:04:05.846625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dde4b252-320e-4989-823b-ee664b84dfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:04:05.854266 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 751/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jun 27 11:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:04:05.892826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e7cdf-b9f3-4907-a2d5-0ee6076bf39a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:04:05.903409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e7cdf-b9f3-4907-a2d5-0ee6076bf39a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:04:05.907515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161b98c-2edc-4129-8f3e-fe0346bb0d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:04:05.908158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161b98c-2edc-4129-8f3e-fe0346bb0d3d service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:04:05.908445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161b98c-2edc-4129-8f3e-fe0346bb0d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:04:05.908724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161b98c-2edc-4129-8f3e-fe0346bb0d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:04:05.917778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161b98c-2edc-4129-8f3e-fe0346bb0d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:04:05.919200 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161b98c-2edc-4129-8f3e-fe0346bb0d3d service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:04:05.929150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 742/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:04:15.839967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=33 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:04:15.924980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=33 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:05:36.044704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60c42d-602f-4068-96cb-13cb2a762171 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:05:36.045293 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60c42d-602f-4068-96cb-13cb2a762171 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:05:36.045293 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60c42d-602f-4068-96cb-13cb2a762171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:05:36.062871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2c60c42d-602f-4068-96cb-13cb2a762171 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:05:36.064051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2c60c42d-602f-4068-96cb-13cb2a762171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:05:36.071793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 752/1494] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:05:36.080021 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64935794-ff42-41d8-b880-a01093e661b2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:05:36.080496 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64935794-ff42-41d8-b880-a01093e661b2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:05:36.080593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64935794-ff42-41d8-b880-a01093e661b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:05:36.098594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-64935794-ff42-41d8-b880-a01093e661b2 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:05:36.099763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-64935794-ff42-41d8-b880-a01093e661b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:05:36.107593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 743/1495] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:05:36.111892 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60c42d-602f-4068-96cb-13cb2a762171 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:05:36.121492 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60c42d-602f-4068-96cb-13cb2a762171 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:05:36.126113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8eeea-c324-43cf-9bc8-a7d45b80a4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:05:36.126758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8eeea-c324-43cf-9bc8-a7d45b80a4df admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:05:36.127046 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8eeea-c324-43cf-9bc8-a7d45b80a4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:05:36.127323 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8eeea-c324-43cf-9bc8-a7d45b80a4df admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:05:36.128042 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8eeea-c324-43cf-9bc8-a7d45b80a4df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:05:36.128346 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8eeea-c324-43cf-9bc8-a7d45b80a4df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:05:36.129351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-41d8eeea-c324-43cf-9bc8-a7d45b80a4df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 11:05:36.129351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Jun 27 11:05:36.129351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: Jun 27 11:05:36.130257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8eeea-c324-43cf-9bc8-a7d45b80a4df admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:05:36.142273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 753/1496] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:05:36.150052 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64935794-ff42-41d8-b880-a01093e661b2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:05:36.160183 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64935794-ff42-41d8-b880-a01093e661b2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:05:36.164723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6998f0-1b9d-46b3-8e06-fcf8eca390b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:05:36.165425 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6998f0-1b9d-46b3-8e06-fcf8eca390b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:05:36.165715 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6998f0-1b9d-46b3-8e06-fcf8eca390b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:05:36.165992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6998f0-1b9d-46b3-8e06-fcf8eca390b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:05:36.166688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6998f0-1b9d-46b3-8e06-fcf8eca390b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:05:36.168483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-db6998f0-1b9d-46b3-8e06-fcf8eca390b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 11:05:36.168483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 27 11:05:36.168483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: Jun 27 11:05:36.169696 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6998f0-1b9d-46b3-8e06-fcf8eca390b0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:05:36.204599 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 744/1497] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:05:36 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:05:36.208910 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8eeea-c324-43cf-9bc8-a7d45b80a4df admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:05:36.219423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8eeea-c324-43cf-9bc8-a7d45b80a4df admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:05:36.273152 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb573d-722d-4bd8-87e6-9df5a5830ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:05:36.273838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb573d-722d-4bd8-87e6-9df5a5830ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:05:36.274127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb573d-722d-4bd8-87e6-9df5a5830ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:05:36.274408 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb573d-722d-4bd8-87e6-9df5a5830ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:05:36.275092 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb573d-722d-4bd8-87e6-9df5a5830ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:05:36.276101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-3ecb573d-722d-4bd8-87e6-9df5a5830ba7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 11:05:36.276101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Jun 27 11:05:36.276101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: Jun 27 11:05:36.277303 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb573d-722d-4bd8-87e6-9df5a5830ba7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:05:36.297260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 754/1498] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:05:36 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:05:36.301225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6998f0-1b9d-46b3-8e06-fcf8eca390b0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:05:36.311762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6998f0-1b9d-46b3-8e06-fcf8eca390b0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:05:36.316329 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698501a6-7903-4585-8cde-e9c026c6d598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:05:36.316982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698501a6-7903-4585-8cde-e9c026c6d598 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:05:36.317266 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698501a6-7903-4585-8cde-e9c026c6d598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:05:36.317577 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698501a6-7903-4585-8cde-e9c026c6d598 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:05:36.318305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698501a6-7903-4585-8cde-e9c026c6d598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:05:36.319343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-698501a6-7903-4585-8cde-e9c026c6d598 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 11:05:36.319343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 27 11:05:36.319343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: Jun 27 11:05:36.320217 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698501a6-7903-4585-8cde-e9c026c6d598 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:05:36.333288 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 745/1499] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:05:36.337082 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb573d-722d-4bd8-87e6-9df5a5830ba7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:05:36.347527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb573d-722d-4bd8-87e6-9df5a5830ba7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:05:36.352051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebc2c8-e82f-43ca-8332-f824ee87fa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:05:36.352726 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebc2c8-e82f-43ca-8332-f824ee87fa03 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:05:36.353013 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebc2c8-e82f-43ca-8332-f824ee87fa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:05:36.353294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebc2c8-e82f-43ca-8332-f824ee87fa03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:05:36.354046 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebc2c8-e82f-43ca-8332-f824ee87fa03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:05:36.355055 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-2eebc2c8-e82f-43ca-8332-f824ee87fa03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 11:05:36.355055 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Jun 27 11:05:36.355055 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: Jun 27 11:05:36.355935 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebc2c8-e82f-43ca-8332-f824ee87fa03 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:05:36.368849 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 755/1500] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:05:36.372852 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698501a6-7903-4585-8cde-e9c026c6d598 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:05:36.383022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698501a6-7903-4585-8cde-e9c026c6d598 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:05:36.387506 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cef5e2-c194-4230-af7b-62b9c70b36e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:05:36.388360 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cef5e2-c194-4230-af7b-62b9c70b36e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:05:36.388640 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cef5e2-c194-4230-af7b-62b9c70b36e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:05:36.389159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cef5e2-c194-4230-af7b-62b9c70b36e7 admin admin] PATH_INFO: `/v3/projects/4ef3949d9545454881722a172e90c5ea/users/f77e8885afbd49c28ecce3f980e831c1/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:05:36.404442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cef5e2-c194-4230-af7b-62b9c70b36e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef3949d9545454881722a172e90c5ea, user_id=f77e8885afbd49c28ecce3f980e831c1, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:05:36.405565 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-31cef5e2-c194-4230-af7b-62b9c70b36e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 11:05:36.405565 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 27 11:05:36.405565 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: Jun 27 11:05:36.407491 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cef5e2-c194-4230-af7b-62b9c70b36e7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:05:36.420034 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 746/1501] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:05:36 2022] PUT /identity/v3/projects/4ef3949d9545454881722a172e90c5ea/users/f77e8885afbd49c28ecce3f980e831c1/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:05:36.430901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3127fd-c304-4239-9b11-1695dd74836c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:05:36.431239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3127fd-c304-4239-9b11-1695dd74836c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:05:36.431545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3127fd-c304-4239-9b11-1695dd74836c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:05:36.457797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6f3127fd-c304-4239-9b11-1695dd74836c None None] MFA Rules not processed for user `f77e8885afbd49c28ecce3f980e831c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:05:36.458991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6f3127fd-c304-4239-9b11-1695dd74836c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:05:36.524607 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 756/1502] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:05:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:05:36.537850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96597d-6846-45d9-b0b3-cf817bc2e4e2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:05:36.538147 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96597d-6846-45d9-b0b3-cf817bc2e4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:05:36.538433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96597d-6846-45d9-b0b3-cf817bc2e4e2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:05:36.539811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 747/1503] 10.222.0.18 () {54 vars in 963 bytes} [Mon Jun 27 11:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:05:36.544827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480eacd0-b3b6-4c4b-8314-38f943e8ecfd None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:05:36.545116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480eacd0-b3b6-4c4b-8314-38f943e8ecfd None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:05:36.545421 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480eacd0-b3b6-4c4b-8314-38f943e8ecfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:05:36.563382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-480eacd0-b3b6-4c4b-8314-38f943e8ecfd None None] MFA Rules not processed for user `521f3fcc63524d2d82b4a05a0dc062f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:05:36.564498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-480eacd0-b3b6-4c4b-8314-38f943e8ecfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:05:36.606212 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:05:36.614403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 757/1504] 10.222.0.18 () {58 vars in 1060 bytes} [Mon Jun 27 11:05:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:05:36.621976 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96597d-6846-45d9-b0b3-cf817bc2e4e2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:05:36.633009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96597d-6846-45d9-b0b3-cf817bc2e4e2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:05:36.636517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63181dd-7e15-4c0c-8e54-8c19e4406581 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:05:36.637145 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63181dd-7e15-4c0c-8e54-8c19e4406581 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:05:36.637471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63181dd-7e15-4c0c-8e54-8c19e4406581 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:05:36.637749 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63181dd-7e15-4c0c-8e54-8c19e4406581 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:05:36.646742 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63181dd-7e15-4c0c-8e54-8c19e4406581 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:05:36.648188 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63181dd-7e15-4c0c-8e54-8c19e4406581 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:05:36.656966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 748/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:05:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:05:36.698693 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a7399-73c4-4610-abc3-735a71fd3c05 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:05:36.698999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a7399-73c4-4610-abc3-735a71fd3c05 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:05:36.699254 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a7399-73c4-4610-abc3-735a71fd3c05 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:05:36.700539 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 758/1506] 10.222.0.18 () {52 vars in 829 bytes} [Mon Jun 27 11:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:05:36.704840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63181dd-7e15-4c0c-8e54-8c19e4406581 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:05:36.765296 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63181dd-7e15-4c0c-8e54-8c19e4406581 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:05:36.769750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9fe16-38a5-4e5f-af3a-898a44f565d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:05:36.770595 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9fe16-38a5-4e5f-af3a-898a44f565d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:05:36.770875 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9fe16-38a5-4e5f-af3a-898a44f565d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:05:36.771147 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9fe16-38a5-4e5f-af3a-898a44f565d4 admin admin] PATH_INFO: `/v3/users/f77e8885afbd49c28ecce3f980e831c1` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:05:36.772297 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9fe16-38a5-4e5f-af3a-898a44f565d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f77e8885afbd49c28ecce3f980e831c1)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:05:36.773309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-82d9fe16-38a5-4e5f-af3a-898a44f565d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 11:05:36.773309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 27 11:05:36.773309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: Jun 27 11:05:36.774522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9fe16-38a5-4e5f-af3a-898a44f565d4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:05:36.837409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-82d9fe16-38a5-4e5f-af3a-898a44f565d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f77e8885afbd49c28ecce3f980e831c1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:05:36.855565 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-82d9fe16-38a5-4e5f-af3a-898a44f565d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f77e8885afbd49c28ecce3f980e831c1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:05:36.856243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-82d9fe16-38a5-4e5f-af3a-898a44f565d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f77e8885afbd49c28ecce3f980e831c1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:05:36.856953 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-82d9fe16-38a5-4e5f-af3a-898a44f565d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f77e8885afbd49c28ecce3f980e831c1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:05:36.866510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-82d9fe16-38a5-4e5f-af3a-898a44f565d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f77e8885afbd49c28ecce3f980e831c1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:05:36.875417 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:05:36.886906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 749/1507] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:05:36 2022] DELETE /identity/v3/users/f77e8885afbd49c28ecce3f980e831c1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:05:36.891655 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4ab80-94f3-4b9b-a824-e59127fa9bc6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:05:36.891943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4ab80-94f3-4b9b-a824-e59127fa9bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:05:36.892216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4ab80-94f3-4b9b-a824-e59127fa9bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:05:36.910203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0bf4ab80-94f3-4b9b-a824-e59127fa9bc6 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:05:36.911383 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0bf4ab80-94f3-4b9b-a824-e59127fa9bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:05:36.966607 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 759/1508] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:05:36.976143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9fe16-38a5-4e5f-af3a-898a44f565d4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:05:36.977585 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-82d9fe16-38a5-4e5f-af3a-898a44f565d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:05:37.039460 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9fe16-38a5-4e5f-af3a-898a44f565d4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:05:37.043080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0444b4a-89dc-4353-bf3e-05bfa19cfeb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:05:37.043723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0444b4a-89dc-4353-bf3e-05bfa19cfeb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:05:37.044030 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0444b4a-89dc-4353-bf3e-05bfa19cfeb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:05:37.044306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0444b4a-89dc-4353-bf3e-05bfa19cfeb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:05:37.053729 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0444b4a-89dc-4353-bf3e-05bfa19cfeb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:05:37.055163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0444b4a-89dc-4353-bf3e-05bfa19cfeb5 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:05:37.065054 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 750/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:05:37.385983 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4ab80-94f3-4b9b-a824-e59127fa9bc6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:05:37.387433 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0bf4ab80-94f3-4b9b-a824-e59127fa9bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:05:37.403790 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4ab80-94f3-4b9b-a824-e59127fa9bc6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:05:37.409052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fac4b2-6fe7-421b-b904-253ba4767dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:05:37.410037 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fac4b2-6fe7-421b-b904-253ba4767dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:05:37.410235 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fac4b2-6fe7-421b-b904-253ba4767dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:05:37.410495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fac4b2-6fe7-421b-b904-253ba4767dd5 admin admin] PATH_INFO: `/v3/projects/4ef3949d9545454881722a172e90c5ea` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:05:37.411667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fac4b2-6fe7-421b-b904-253ba4767dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef3949d9545454881722a172e90c5ea)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:05:37.412753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-b8fac4b2-6fe7-421b-b904-253ba4767dd5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 11:05:37.412753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Jun 27 11:05:37.412753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: Jun 27 11:05:37.413991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fac4b2-6fe7-421b-b904-253ba4767dd5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:05:37.472139 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b8fac4b2-6fe7-421b-b904-253ba4767dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef3949d9545454881722a172e90c5ea', 'request_id': 'req-b8fac4b2-6fe7-421b-b904-253ba4767dd5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:05:37.485844 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b8fac4b2-6fe7-421b-b904-253ba4767dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef3949d9545454881722a172e90c5ea', 'request_id': 'req-b8fac4b2-6fe7-421b-b904-253ba4767dd5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:05:37.491793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b8fac4b2-6fe7-421b-b904-253ba4767dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef3949d9545454881722a172e90c5ea', 'request_id': 'req-b8fac4b2-6fe7-421b-b904-253ba4767dd5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:05:37.506123 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b8fac4b2-6fe7-421b-b904-253ba4767dd5 admin admin] The token cache is being invalidate because project 4ef3949d9545454881722a172e90c5ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:05:37.506412 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b8fac4b2-6fe7-421b-b904-253ba4767dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:05:37.507123 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b8fac4b2-6fe7-421b-b904-253ba4767dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:05:37.508673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 760/1510] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:05:37 2022] DELETE /identity/v3/projects/4ef3949d9545454881722a172e90c5ea => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:05:47.060312 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=29 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:05:47.503096 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:07:11.449814 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3f50d-15b1-45b8-93c1-7e2580e26dd2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:11.450416 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3f50d-15b1-45b8-93c1-7e2580e26dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:11.450416 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3f50d-15b1-45b8-93c1-7e2580e26dd2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:11.451759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 11:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:07:11.457228 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dd9a0-1e24-407f-8135-96f5cc9ba7e5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:11.457732 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dd9a0-1e24-407f-8135-96f5cc9ba7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:11.457732 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dd9a0-1e24-407f-8135-96f5cc9ba7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:11.475943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-450dd9a0-1e24-407f-8135-96f5cc9ba7e5 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:07:11.477145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-450dd9a0-1e24-407f-8135-96f5cc9ba7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:07:11.535552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 11:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:07:11.689865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3f50d-15b1-45b8-93c1-7e2580e26dd2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:07:11.691623 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-11b3f50d-15b1-45b8-93c1-7e2580e26dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:07:11.763912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3f50d-15b1-45b8-93c1-7e2580e26dd2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:07:11.770042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6157e-37b3-4bca-a356-7f2378538258 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:07:11.770674 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6157e-37b3-4bca-a356-7f2378538258 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:11.770984 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6157e-37b3-4bca-a356-7f2378538258 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:11.771257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6157e-37b3-4bca-a356-7f2378538258 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:11.779223 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6157e-37b3-4bca-a356-7f2378538258 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:07:11.780845 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6157e-37b3-4bca-a356-7f2378538258 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:07:11.790690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 752/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:07:12.615504 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7ec46-672d-4c96-97f4-26ab56512370 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:12.616066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7ec46-672d-4c96-97f4-26ab56512370 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:12.616066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7ec46-672d-4c96-97f4-26ab56512370 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:12.617449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 11:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:07:12.622137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa82bea-8ca3-4c50-b4fe-317ebe2d5fe2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:12.622582 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa82bea-8ca3-4c50-b4fe-317ebe2d5fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:12.622698 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa82bea-8ca3-4c50-b4fe-317ebe2d5fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:12.641731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2fa82bea-8ca3-4c50-b4fe-317ebe2d5fe2 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:07:12.642917 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2fa82bea-8ca3-4c50-b4fe-317ebe2d5fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:07:12.650744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 11:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:07:12.801209 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7ec46-672d-4c96-97f4-26ab56512370 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:07:12.815930 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7ec46-672d-4c96-97f4-26ab56512370 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:07:12.821241 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2719979-cc8a-45a1-a635-fac2928b4421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:07:12.821968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2719979-cc8a-45a1-a635-fac2928b4421 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:12.822251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2719979-cc8a-45a1-a635-fac2928b4421 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:12.822528 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2719979-cc8a-45a1-a635-fac2928b4421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:12.830557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2719979-cc8a-45a1-a635-fac2928b4421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:07:12.832149 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2719979-cc8a-45a1-a635-fac2928b4421 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:07:12.841477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 763/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:07:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:07:13.836025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e8a4c-e96d-4237-bc0a-9d92a3b93923 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:13.836638 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e8a4c-e96d-4237-bc0a-9d92a3b93923 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:13.836638 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e8a4c-e96d-4237-bc0a-9d92a3b93923 None None] PATH_INFO: `/v3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:13.837921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 754/1517] 10.222.0.36 () {54 vars in 925 bytes} [Mon Jun 27 11:07:13 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:07:13.844711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7837c96-2ec3-4895-92ce-a8b3e30269d8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:13.845142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7837c96-2ec3-4895-92ce-a8b3e30269d8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:13.845257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7837c96-2ec3-4895-92ce-a8b3e30269d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:13.862837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d7837c96-2ec3-4895-92ce-a8b3e30269d8 None None] MFA Rules not processed for user `d8673c91abf14c0b9a237f0499fdf20e`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:07:13.864021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d7837c96-2ec3-4895-92ce-a8b3e30269d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:07:13.924585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 764/1518] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Jun 27 11:07:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:07:22.635697 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=37 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:07:22.937792 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0920a-7fea-4e54-b52a-e4724449a38c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:22.938322 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0920a-7fea-4e54-b52a-e4724449a38c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:22.938605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0920a-7fea-4e54-b52a-e4724449a38c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:22.940027 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 755/1519] 10.222.0.18 () {54 vars in 960 bytes} [Mon Jun 27 11:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:07:22.945472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ed188-b45e-4d79-a8dc-9ff5aa4bb9d9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:22.945995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ed188-b45e-4d79-a8dc-9ff5aa4bb9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:22.946095 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ed188-b45e-4d79-a8dc-9ff5aa4bb9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:22.964545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9c0ed188-b45e-4d79-a8dc-9ff5aa4bb9d9 None None] MFA Rules not processed for user `d8673c91abf14c0b9a237f0499fdf20e`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:07:22.965782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9c0ed188-b45e-4d79-a8dc-9ff5aa4bb9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:07:22.974338 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 765/1520] 10.222.0.18 () {58 vars in 1057 bytes} [Mon Jun 27 11:07:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:07:22.981806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0920a-7fea-4e54-b52a-e4724449a38c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:07:22.994958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0920a-7fea-4e54-b52a-e4724449a38c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:07:23.000666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db1b94-3cba-4e50-9ece-db6ad68d8978 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8673c91abf14c0b9a237f0499fdf20e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:07:23.001325 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db1b94-3cba-4e50-9ece-db6ad68d8978 service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:23.001744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db1b94-3cba-4e50-9ece-db6ad68d8978 service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:23.002131 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db1b94-3cba-4e50-9ece-db6ad68d8978 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:23.010673 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db1b94-3cba-4e50-9ece-db6ad68d8978 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:07:23.012251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db1b94-3cba-4e50-9ece-db6ad68d8978 service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:07:23.023386 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 756/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:07:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:07:24.073690 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3afe56-5a60-49f1-b423-55462c4fab9e None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:24.074212 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3afe56-5a60-49f1-b423-55462c4fab9e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:24.074358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3afe56-5a60-49f1-b423-55462c4fab9e None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:24.075704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 11:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:07:24.080975 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd1372-8b27-4f95-ad77-f308de3678b7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:24.081387 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd1372-8b27-4f95-ad77-f308de3678b7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:24.081572 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd1372-8b27-4f95-ad77-f308de3678b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:24.099876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4abd1372-8b27-4f95-ad77-f308de3678b7 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:07:24.101088 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4abd1372-8b27-4f95-ad77-f308de3678b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:07:24.109068 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 11:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:07:24.262675 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3afe56-5a60-49f1-b423-55462c4fab9e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:07:24.277663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3afe56-5a60-49f1-b423-55462c4fab9e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:07:24.282908 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da55bc2-1a13-41c8-acbe-d89a956becca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:07:24.283530 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da55bc2-1a13-41c8-acbe-d89a956becca service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:24.283808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da55bc2-1a13-41c8-acbe-d89a956becca service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:24.284081 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da55bc2-1a13-41c8-acbe-d89a956becca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:24.292101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da55bc2-1a13-41c8-acbe-d89a956becca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:07:24.293757 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da55bc2-1a13-41c8-acbe-d89a956becca service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:07:24.303467 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 767/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:07:25.115127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf07083-4812-47c7-866c-c014023bf3c9 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:25.115695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf07083-4812-47c7-866c-c014023bf3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:25.115695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf07083-4812-47c7-866c-c014023bf3c9 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:25.117046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 11:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:07:25.121863 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c21f86-a6ee-4ec7-972f-ba2e0952f030 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:25.122289 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c21f86-a6ee-4ec7-972f-ba2e0952f030 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:25.122424 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c21f86-a6ee-4ec7-972f-ba2e0952f030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:25.142459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-89c21f86-a6ee-4ec7-972f-ba2e0952f030 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:07:25.143657 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-89c21f86-a6ee-4ec7-972f-ba2e0952f030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:07:25.151494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 11:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:07:25.305018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf07083-4812-47c7-866c-c014023bf3c9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:07:25.319735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf07083-4812-47c7-866c-c014023bf3c9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:07:25.325086 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e053b-6521-43a0-8a25-59e21ecf4b77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:07:25.325772 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e053b-6521-43a0-8a25-59e21ecf4b77 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:25.326053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e053b-6521-43a0-8a25-59e21ecf4b77 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:25.326327 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e053b-6521-43a0-8a25-59e21ecf4b77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:25.334355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e053b-6521-43a0-8a25-59e21ecf4b77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:07:25.335931 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e053b-6521-43a0-8a25-59e21ecf4b77 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:07:25.345643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 759/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:07:29.089182 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890a686-38c3-4b09-850e-85cf524e37ff None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:29.089826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890a686-38c3-4b09-850e-85cf524e37ff None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:29.089826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890a686-38c3-4b09-850e-85cf524e37ff None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:29.091172 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 11:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:07:29.097108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee2207-9aca-4a23-82ec-720b87115e70 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:29.097604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee2207-9aca-4a23-82ec-720b87115e70 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:29.097712 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee2207-9aca-4a23-82ec-720b87115e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:29.116122 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7fee2207-9aca-4a23-82ec-720b87115e70 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:07:29.117309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7fee2207-9aca-4a23-82ec-720b87115e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:07:29.125061 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 11:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:07:29.162544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890a686-38c3-4b09-850e-85cf524e37ff None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:07:29.164180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9890a686-38c3-4b09-850e-85cf524e37ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:07:29.221006 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890a686-38c3-4b09-850e-85cf524e37ff None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:07:29.224552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67d7f9-93fc-435f-ae33-313344c10bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:07:29.225221 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67d7f9-93fc-435f-ae33-313344c10bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:29.225537 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67d7f9-93fc-435f-ae33-313344c10bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:29.225821 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67d7f9-93fc-435f-ae33-313344c10bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:29.234706 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67d7f9-93fc-435f-ae33-313344c10bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:07:29.236131 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67d7f9-93fc-435f-ae33-313344c10bb8 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:07:29.241101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:07:29.246360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 770/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:07:31.250232 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99de1f-4207-46af-bcdf-d0141a9b950f None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:31.250648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99de1f-4207-46af-bcdf-d0141a9b950f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:31.250820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99de1f-4207-46af-bcdf-d0141a9b950f None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:31.252205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 11:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:07:31.260776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4a7c0-e1fe-445b-b741-1c0d7b5a56bc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:31.261232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4a7c0-e1fe-445b-b741-1c0d7b5a56bc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:31.261338 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4a7c0-e1fe-445b-b741-1c0d7b5a56bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:31.282606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0bc4a7c0-e1fe-445b-b741-1c0d7b5a56bc None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:07:31.283783 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0bc4a7c0-e1fe-445b-b741-1c0d7b5a56bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:07:31.291500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 11:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:07:31.327816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99de1f-4207-46af-bcdf-d0141a9b950f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:07:31.329504 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bc99de1f-4207-46af-bcdf-d0141a9b950f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:07:31.342178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99de1f-4207-46af-bcdf-d0141a9b950f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:07:31.346231 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e8a8b-0c04-4667-96d6-7f655802a18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:07:31.346860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e8a8b-0c04-4667-96d6-7f655802a18c service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:31.347141 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e8a8b-0c04-4667-96d6-7f655802a18c service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:31.347417 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e8a8b-0c04-4667-96d6-7f655802a18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:31.356178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e8a8b-0c04-4667-96d6-7f655802a18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:07:31.357658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e8a8b-0c04-4667-96d6-7f655802a18c service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:07:31.367542 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 762/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:07:34.804687 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16608a-79dc-41ff-8d21-68cb15665c63 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:34.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16608a-79dc-41ff-8d21-68cb15665c63 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:34.805260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16608a-79dc-41ff-8d21-68cb15665c63 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:34.806670 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 11:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:07:34.811918 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b830aa-e927-427c-91c9-0a08145c5dc8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:34.812318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b830aa-e927-427c-91c9-0a08145c5dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:34.812472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b830aa-e927-427c-91c9-0a08145c5dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:34.830028 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-88b830aa-e927-427c-91c9-0a08145c5dc8 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:07:34.831199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-88b830aa-e927-427c-91c9-0a08145c5dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:07:34.838935 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 11:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:07:35.135959 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16608a-79dc-41ff-8d21-68cb15665c63 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:07:35.137745 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6f16608a-79dc-41ff-8d21-68cb15665c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:07:35.194991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16608a-79dc-41ff-8d21-68cb15665c63 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:07:35.198521 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fea546-5924-45b0-ad8e-175202cec223 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:07:35.199162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fea546-5924-45b0-ad8e-175202cec223 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:35.199446 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fea546-5924-45b0-ad8e-175202cec223 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:35.199723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fea546-5924-45b0-ad8e-175202cec223 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:35.209553 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fea546-5924-45b0-ad8e-175202cec223 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:07:35.210979 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fea546-5924-45b0-ad8e-175202cec223 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:07:35.220840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 773/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:07:37.240114 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393662d-f560-4266-9008-56d988c591f5 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:37.240508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393662d-f560-4266-9008-56d988c591f5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:37.240713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393662d-f560-4266-9008-56d988c591f5 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:37.242001 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 11:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:07:37.247130 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665cc49-037e-4b73-9c6b-f69407bbbbfc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:37.247559 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665cc49-037e-4b73-9c6b-f69407bbbbfc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:37.247671 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665cc49-037e-4b73-9c6b-f69407bbbbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:37.266501 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0665cc49-037e-4b73-9c6b-f69407bbbbfc None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:07:37.267682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0665cc49-037e-4b73-9c6b-f69407bbbbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:07:37.275387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 11:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:07:37.573643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393662d-f560-4266-9008-56d988c591f5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:07:37.575330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b393662d-f560-4266-9008-56d988c591f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:07:37.588180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393662d-f560-4266-9008-56d988c591f5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:07:37.591672 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec616c9-2130-455e-96cb-4d961897cfbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:07:37.592301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec616c9-2130-455e-96cb-4d961897cfbe service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:07:37.592585 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec616c9-2130-455e-96cb-4d961897cfbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:07:37.592861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec616c9-2130-455e-96cb-4d961897cfbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:07:37.601605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec616c9-2130-455e-96cb-4d961897cfbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:07:37.603023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec616c9-2130-455e-96cb-4d961897cfbe service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:07:37.612847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 765/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:07:47.260506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=32 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:07:47.608205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=33 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:05.238005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f5050-4351-4f0e-82ce-3b1a0abfb712 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.239155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f5050-4351-4f0e-82ce-3b1a0abfb712 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.239664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f5050-4351-4f0e-82ce-3b1a0abfb712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.265203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1d5f5050-4351-4f0e-82ce-3b1a0abfb712 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:05.266879 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1d5f5050-4351-4f0e-82ce-3b1a0abfb712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:05.280482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 775/1540] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:05.290213 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea445c-1acb-4592-abb5-a2692664216c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.290687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea445c-1acb-4592-abb5-a2692664216c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.290687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea445c-1acb-4592-abb5-a2692664216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.318251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0674e-d078-4539-916d-5a2c653663f3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.318564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0674e-d078-4539-916d-5a2c653663f3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.318806 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0674e-d078-4539-916d-5a2c653663f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.322961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b7ea445c-1acb-4592-abb5-a2692664216c None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:05.324190 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b7ea445c-1acb-4592-abb5-a2692664216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:05.348403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 766/1541] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:05.349754 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04a68b-3911-4de2-9022-5a94d0509a19 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.350040 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04a68b-3911-4de2-9022-5a94d0509a19 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.350318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04a68b-3911-4de2-9022-5a94d0509a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.351472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6de0674e-d078-4539-916d-5a2c653663f3 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:05.352881 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6de0674e-d078-4539-916d-5a2c653663f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:05.369856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 776/1542] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:09:05.370529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0674e-d078-4539-916d-5a2c653663f3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:05.385199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9d04a68b-3911-4de2-9022-5a94d0509a19 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:05.386455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9d04a68b-3911-4de2-9022-5a94d0509a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:05.390074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0674e-d078-4539-916d-5a2c653663f3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:05.399043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 767/1543] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:05.400486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4596e1-0d1a-4e65-918d-043983cf5004 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.400773 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4596e1-0d1a-4e65-918d-043983cf5004 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.401046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4596e1-0d1a-4e65-918d-043983cf5004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.402390 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245383b-c2be-46ba-8c6e-655b9111b608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:05.403160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245383b-c2be-46ba-8c6e-655b9111b608 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.403449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245383b-c2be-46ba-8c6e-655b9111b608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.403732 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245383b-c2be-46ba-8c6e-655b9111b608 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.404468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245383b-c2be-46ba-8c6e-655b9111b608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:09:05.404774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245383b-c2be-46ba-8c6e-655b9111b608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:05.406608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245383b-c2be-46ba-8c6e-655b9111b608 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:05.429163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bf4596e1-0d1a-4e65-918d-043983cf5004 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:05.430401 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bf4596e1-0d1a-4e65-918d-043983cf5004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:05.435586 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 777/1544] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:09:05.437934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0effe4c-9613-48dc-8603-1d74516eb32c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.438219 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0effe4c-9613-48dc-8603-1d74516eb32c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.438494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0effe4c-9613-48dc-8603-1d74516eb32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.446373 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 768/1545] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:05.447767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ad62f-8710-4202-8e78-f7cdc76c8573 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.448053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ad62f-8710-4202-8e78-f7cdc76c8573 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.448325 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ad62f-8710-4202-8e78-f7cdc76c8573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.466828 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b0effe4c-9613-48dc-8603-1d74516eb32c None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:05.468192 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b0effe4c-9613-48dc-8603-1d74516eb32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:05.471160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2a9ad62f-8710-4202-8e78-f7cdc76c8573 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:05.472339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2a9ad62f-8710-4202-8e78-f7cdc76c8573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:05.483550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 778/1546] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:05.483550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049aefb-0554-4853-acf5-a0a28cbc767b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.483550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049aefb-0554-4853-acf5-a0a28cbc767b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.483550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049aefb-0554-4853-acf5-a0a28cbc767b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.487986 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 769/1547] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:05.488992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ad62f-8710-4202-8e78-f7cdc76c8573 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:05.501449 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ad62f-8710-4202-8e78-f7cdc76c8573 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:05.504802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6049aefb-0554-4853-acf5-a0a28cbc767b None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:05.506183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6049aefb-0554-4853-acf5-a0a28cbc767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:05.506886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edf1c4-28eb-4ee4-836f-39014c789bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:05.507749 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edf1c4-28eb-4ee4-836f-39014c789bdc admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.508228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edf1c4-28eb-4ee4-836f-39014c789bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.508702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edf1c4-28eb-4ee4-836f-39014c789bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.509610 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edf1c4-28eb-4ee4-836f-39014c789bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:05.511842 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edf1c4-28eb-4ee4-836f-39014c789bdc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:05.513955 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 779/1548] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:05.515293 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bea17-7234-4a85-8f40-d99be412ff17 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.515583 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bea17-7234-4a85-8f40-d99be412ff17 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.515860 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bea17-7234-4a85-8f40-d99be412ff17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.535043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e83bea17-7234-4a85-8f40-d99be412ff17 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:05.536393 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e83bea17-7234-4a85-8f40-d99be412ff17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:05.544046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 770/1549] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:05.545670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f97365-af5c-469a-9ae0-215347f7de25 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.545964 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f97365-af5c-469a-9ae0-215347f7de25 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.546290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f97365-af5c-469a-9ae0-215347f7de25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.548277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 780/1550] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:05.549096 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bea17-7234-4a85-8f40-d99be412ff17 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:05.559055 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bea17-7234-4a85-8f40-d99be412ff17 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:05.565309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-75f97365-af5c-469a-9ae0-215347f7de25 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:05.566534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-75f97365-af5c-469a-9ae0-215347f7de25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:05.614300 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87d90a-688a-4948-9587-34c7965826f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:05.614966 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87d90a-688a-4948-9587-34c7965826f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.615253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87d90a-688a-4948-9587-34c7965826f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.615533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87d90a-688a-4948-9587-34c7965826f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.616259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87d90a-688a-4948-9587-34c7965826f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:09:05.616566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87d90a-688a-4948-9587-34c7965826f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:05.618370 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87d90a-688a-4948-9587-34c7965826f3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:05.624715 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 771/1551] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:05.626166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809cd27-3321-4f2f-99b7-f4a37f6d1a75 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.626456 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809cd27-3321-4f2f-99b7-f4a37f6d1a75 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.626732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809cd27-3321-4f2f-99b7-f4a37f6d1a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.631223 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 781/1552] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:09:05.632633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4bb1b-0fc6-4ecf-86ac-15168896a7f0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.632923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4bb1b-0fc6-4ecf-86ac-15168896a7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.633201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4bb1b-0fc6-4ecf-86ac-15168896a7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.646152 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5809cd27-3321-4f2f-99b7-f4a37f6d1a75 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:05.647355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5809cd27-3321-4f2f-99b7-f4a37f6d1a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:05.652725 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e7e4bb1b-0fc6-4ecf-86ac-15168896a7f0 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:05.653888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e7e4bb1b-0fc6-4ecf-86ac-15168896a7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:05.655273 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 772/1553] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:05.656047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809cd27-3321-4f2f-99b7-f4a37f6d1a75 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:05.662357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 782/1554] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:05.663876 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed8bea-4c55-45ad-a54a-000249bae1a8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.664162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed8bea-4c55-45ad-a54a-000249bae1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.664435 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed8bea-4c55-45ad-a54a-000249bae1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.673240 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809cd27-3321-4f2f-99b7-f4a37f6d1a75 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:05.678485 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8de86-1917-4344-b4c1-5f1ac3f2ff14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:05.679148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8de86-1917-4344-b4c1-5f1ac3f2ff14 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.679433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8de86-1917-4344-b4c1-5f1ac3f2ff14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.679713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8de86-1917-4344-b4c1-5f1ac3f2ff14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.680446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8de86-1917-4344-b4c1-5f1ac3f2ff14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:09:05.680753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8de86-1917-4344-b4c1-5f1ac3f2ff14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:05.681805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-61e8de86-1917-4344-b4c1-5f1ac3f2ff14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 11:09:05.681805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 27 11:09:05.681805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: Jun 27 11:09:05.682705 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8de86-1917-4344-b4c1-5f1ac3f2ff14 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:05.683446 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8fed8bea-4c55-45ad-a54a-000249bae1a8 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:05.684621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8fed8bea-4c55-45ad-a54a-000249bae1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:05.692722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 783/1555] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:05.693248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed8bea-4c55-45ad-a54a-000249bae1a8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:05.701828 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 773/1556] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:09:05.701828 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc8b69-3d37-456b-83a6-8984209f5a34 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.701828 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc8b69-3d37-456b-83a6-8984209f5a34 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.701828 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc8b69-3d37-456b-83a6-8984209f5a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.705113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed8bea-4c55-45ad-a54a-000249bae1a8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:05.710662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18605e29-16ce-460b-acc6-232764dd9e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:05.711328 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605e29-16ce-460b-acc6-232764dd9e33 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.711610 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605e29-16ce-460b-acc6-232764dd9e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.711885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605e29-16ce-460b-acc6-232764dd9e33 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.712565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18605e29-16ce-460b-acc6-232764dd9e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:05.714965 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18605e29-16ce-460b-acc6-232764dd9e33 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:05.718301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-71dc8b69-3d37-456b-83a6-8984209f5a34 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:05.719432 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-71dc8b69-3d37-456b-83a6-8984209f5a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:05.727990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 774/1557] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:05.728915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc8b69-3d37-456b-83a6-8984209f5a34 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:05.741075 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 784/1558] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:05.741075 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18605e29-16ce-460b-acc6-232764dd9e33 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:05.741293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc8b69-3d37-456b-83a6-8984209f5a34 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:05.744061 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4183dc-1a02-4cca-819b-4f7b8fa39b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:05.744694 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4183dc-1a02-4cca-819b-4f7b8fa39b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.744974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4183dc-1a02-4cca-819b-4f7b8fa39b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.745246 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4183dc-1a02-4cca-819b-4f7b8fa39b6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.746005 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4183dc-1a02-4cca-819b-4f7b8fa39b6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:09:05.746314 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4183dc-1a02-4cca-819b-4f7b8fa39b6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:05.747894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4183dc-1a02-4cca-819b-4f7b8fa39b6c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:05.748518 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18605e29-16ce-460b-acc6-232764dd9e33 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:05.753993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502ef6f-b642-4e7d-94f9-480d07f29309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:05.754631 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502ef6f-b642-4e7d-94f9-480d07f29309 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.754912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502ef6f-b642-4e7d-94f9-480d07f29309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.755191 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502ef6f-b642-4e7d-94f9-480d07f29309 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.755862 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502ef6f-b642-4e7d-94f9-480d07f29309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:05.756889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-3502ef6f-b642-4e7d-94f9-480d07f29309 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 11:09:05.756889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Jun 27 11:09:05.756889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: Jun 27 11:09:05.758099 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502ef6f-b642-4e7d-94f9-480d07f29309 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:05.759297 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 775/1559] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:09:05.760529 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8b093-3316-4c85-a412-cc457fede39d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.760819 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8b093-3316-4c85-a412-cc457fede39d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.761103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8b093-3316-4c85-a412-cc457fede39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.779109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-dee8b093-3316-4c85-a412-cc457fede39d None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:05.780377 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dee8b093-3316-4c85-a412-cc457fede39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:05.788947 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 776/1560] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:05.789677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 785/1561] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:05.789901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8b093-3316-4c85-a412-cc457fede39d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:05.791387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffed58-54f8-433a-9e83-cd61889bc474 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.791822 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffed58-54f8-433a-9e83-cd61889bc474 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.792235 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffed58-54f8-433a-9e83-cd61889bc474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.800128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8b093-3316-4c85-a412-cc457fede39d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:05.809938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a8ffed58-54f8-433a-9e83-cd61889bc474 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:05.811101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a8ffed58-54f8-433a-9e83-cd61889bc474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:05.856171 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0821041-cc1f-48a1-a0b8-8e2c3149f5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:05.856824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0821041-cc1f-48a1-a0b8-8e2c3149f5ea admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.857104 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0821041-cc1f-48a1-a0b8-8e2c3149f5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.857394 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0821041-cc1f-48a1-a0b8-8e2c3149f5ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.858144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0821041-cc1f-48a1-a0b8-8e2c3149f5ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:09:05.858444 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0821041-cc1f-48a1-a0b8-8e2c3149f5ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:05.859526 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:05.860089 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0821041-cc1f-48a1-a0b8-8e2c3149f5ea admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:05.868938 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:05.872721 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 777/1562] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:09:05.876463 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 786/1563] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:05.876626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0821041-cc1f-48a1-a0b8-8e2c3149f5ea admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:05.876726 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffed58-54f8-433a-9e83-cd61889bc474 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:05.884289 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffed58-54f8-433a-9e83-cd61889bc474 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:05.888891 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596f72b-dd96-4212-b03d-21abb90d6467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:05.889334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0821041-cc1f-48a1-a0b8-8e2c3149f5ea admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:05.889641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596f72b-dd96-4212-b03d-21abb90d6467 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.889991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596f72b-dd96-4212-b03d-21abb90d6467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.890224 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596f72b-dd96-4212-b03d-21abb90d6467 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.891202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596f72b-dd96-4212-b03d-21abb90d6467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:09:05.891511 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596f72b-dd96-4212-b03d-21abb90d6467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:05.893130 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596f72b-dd96-4212-b03d-21abb90d6467 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:05.894357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e6d46-c179-417e-a5ca-37f308087b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:05.895117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e6d46-c179-417e-a5ca-37f308087b68 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.895396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e6d46-c179-417e-a5ca-37f308087b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.895671 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e6d46-c179-417e-a5ca-37f308087b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.896349 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e6d46-c179-417e-a5ca-37f308087b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:05.898259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e6d46-c179-417e-a5ca-37f308087b68 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:05.911552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 787/1564] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:09:05.911552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596f72b-dd96-4212-b03d-21abb90d6467 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:05.921675 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596f72b-dd96-4212-b03d-21abb90d6467 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:05.925043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 778/1565] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:05.925794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e6d46-c179-417e-a5ca-37f308087b68 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:05.926882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef9ce0-df47-4358-aff2-447693fec123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:05.927531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef9ce0-df47-4358-aff2-447693fec123 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.927803 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef9ce0-df47-4358-aff2-447693fec123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.928143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef9ce0-df47-4358-aff2-447693fec123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.928872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef9ce0-df47-4358-aff2-447693fec123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:05.930463 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef9ce0-df47-4358-aff2-447693fec123 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:05.945252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 788/1566] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:05.945252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef9ce0-df47-4358-aff2-447693fec123 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:05.952587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef9ce0-df47-4358-aff2-447693fec123 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:05.990494 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e6d46-c179-417e-a5ca-37f308087b68 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:05.995107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec008b3-f599-4392-86f3-4a93e133e9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:05.995770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec008b3-f599-4392-86f3-4a93e133e9cf admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:05.996058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec008b3-f599-4392-86f3-4a93e133e9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:05.996338 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec008b3-f599-4392-86f3-4a93e133e9cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:05.997031 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec008b3-f599-4392-86f3-4a93e133e9cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:05.998961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec008b3-f599-4392-86f3-4a93e133e9cf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.007660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe957340-495c-4e86-9fdd-29b6d29d50d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.008317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe957340-495c-4e86-9fdd-29b6d29d50d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.008599 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe957340-495c-4e86-9fdd-29b6d29d50d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.008875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe957340-495c-4e86-9fdd-29b6d29d50d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.009580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe957340-495c-4e86-9fdd-29b6d29d50d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.011496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe957340-495c-4e86-9fdd-29b6d29d50d1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.026959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 779/1567] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:06.027634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec008b3-f599-4392-86f3-4a93e133e9cf admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.034853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 789/1568] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:05 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:06.035857 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe957340-495c-4e86-9fdd-29b6d29d50d1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.046600 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe957340-495c-4e86-9fdd-29b6d29d50d1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.089084 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec008b3-f599-4392-86f3-4a93e133e9cf admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.093748 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d401b1c-9a43-4b6e-844e-aaa8c1220064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.094407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d401b1c-9a43-4b6e-844e-aaa8c1220064 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.094694 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d401b1c-9a43-4b6e-844e-aaa8c1220064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.094967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d401b1c-9a43-4b6e-844e-aaa8c1220064 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.095712 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d401b1c-9a43-4b6e-844e-aaa8c1220064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:09:06.096023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d401b1c-9a43-4b6e-844e-aaa8c1220064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.098278 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d401b1c-9a43-4b6e-844e-aaa8c1220064 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.104347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660ef28-96be-4887-8a7b-3e8a0948c823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.105009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660ef28-96be-4887-8a7b-3e8a0948c823 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.105292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660ef28-96be-4887-8a7b-3e8a0948c823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.105615 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660ef28-96be-4887-8a7b-3e8a0948c823 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.106331 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660ef28-96be-4887-8a7b-3e8a0948c823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:09:06.106638 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660ef28-96be-4887-8a7b-3e8a0948c823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.108221 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660ef28-96be-4887-8a7b-3e8a0948c823 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.109663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 780/1569] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:09:06.110679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d401b1c-9a43-4b6e-844e-aaa8c1220064 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.120039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 790/1570] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:09:06.120819 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660ef28-96be-4887-8a7b-3e8a0948c823 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.128864 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d401b1c-9a43-4b6e-844e-aaa8c1220064 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.131563 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660ef28-96be-4887-8a7b-3e8a0948c823 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.133353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa37a4-de77-443e-b975-e14a1a6544de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.134023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa37a4-de77-443e-b975-e14a1a6544de admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.134305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa37a4-de77-443e-b975-e14a1a6544de admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.134575 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa37a4-de77-443e-b975-e14a1a6544de admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.135245 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa37a4-de77-443e-b975-e14a1a6544de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.136224 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03bba8-8837-4bfb-ad65-1d5cba3bd383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.136850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03bba8-8837-4bfb-ad65-1d5cba3bd383 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.137133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03bba8-8837-4bfb-ad65-1d5cba3bd383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.137259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa37a4-de77-443e-b975-e14a1a6544de admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.137440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03bba8-8837-4bfb-ad65-1d5cba3bd383 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.138111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03bba8-8837-4bfb-ad65-1d5cba3bd383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.140036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03bba8-8837-4bfb-ad65-1d5cba3bd383 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.165028 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 781/1571] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:06 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:06.166422 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa37a4-de77-443e-b975-e14a1a6544de admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.169661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 791/1572] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:06 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:06.169661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03bba8-8837-4bfb-ad65-1d5cba3bd383 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.208141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:06.212628 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:06.236346 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03bba8-8837-4bfb-ad65-1d5cba3bd383 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.236812 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa37a4-de77-443e-b975-e14a1a6544de admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.240952 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99ade2-7174-42dc-a6c4-004bd3f0e33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.241593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99ade2-7174-42dc-a6c4-004bd3f0e33f admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.241873 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99ade2-7174-42dc-a6c4-004bd3f0e33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.242071 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbec798-3768-46b3-8274-5a6f314c7c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.242182 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99ade2-7174-42dc-a6c4-004bd3f0e33f admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.242740 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbec798-3768-46b3-8274-5a6f314c7c19 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.242850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99ade2-7174-42dc-a6c4-004bd3f0e33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.243045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbec798-3768-46b3-8274-5a6f314c7c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.243311 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbec798-3768-46b3-8274-5a6f314c7c19 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.243990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbec798-3768-46b3-8274-5a6f314c7c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.244411 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99ade2-7174-42dc-a6c4-004bd3f0e33f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.245037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-5bbec798-3768-46b3-8274-5a6f314c7c19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 11:09:06.245037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 27 11:09:06.245037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: Jun 27 11:09:06.246296 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbec798-3768-46b3-8274-5a6f314c7c19 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.254767 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 792/1573] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:06.255577 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99ade2-7174-42dc-a6c4-004bd3f0e33f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.265012 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99ade2-7174-42dc-a6c4-004bd3f0e33f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.267819 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 782/1574] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:06 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:06.269253 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbec798-3768-46b3-8274-5a6f314c7c19 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.273024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41891c6d-f5f2-4712-8e5d-e79589a64287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.273733 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41891c6d-f5f2-4712-8e5d-e79589a64287 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.274197 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41891c6d-f5f2-4712-8e5d-e79589a64287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.274483 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41891c6d-f5f2-4712-8e5d-e79589a64287 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.275191 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41891c6d-f5f2-4712-8e5d-e79589a64287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.277127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41891c6d-f5f2-4712-8e5d-e79589a64287 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.278825 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbec798-3768-46b3-8274-5a6f314c7c19 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.283925 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686a92a-43b7-43f0-b789-6cd7cb073c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.284561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686a92a-43b7-43f0-b789-6cd7cb073c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.284851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686a92a-43b7-43f0-b789-6cd7cb073c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.285135 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686a92a-43b7-43f0-b789-6cd7cb073c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.285920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686a92a-43b7-43f0-b789-6cd7cb073c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.288132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686a92a-43b7-43f0-b789-6cd7cb073c15 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.297438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 793/1575] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:06 2022] POST /identity/v3/users => generated 297 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:06.297622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41891c6d-f5f2-4712-8e5d-e79589a64287 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.302756 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 783/1576] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:06.303437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686a92a-43b7-43f0-b789-6cd7cb073c15 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.309286 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41891c6d-f5f2-4712-8e5d-e79589a64287 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.313010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686a92a-43b7-43f0-b789-6cd7cb073c15 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.313896 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27472804-28a8-46e7-9a13-f09f4c995f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.314529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27472804-28a8-46e7-9a13-f09f4c995f0e admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.315337 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27472804-28a8-46e7-9a13-f09f4c995f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.315750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27472804-28a8-46e7-9a13-f09f4c995f0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.316430 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27472804-28a8-46e7-9a13-f09f4c995f0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.318175 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032dadf6-c14d-4bac-bc44-cff9f379847e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.318370 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27472804-28a8-46e7-9a13-f09f4c995f0e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.318801 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dadf6-c14d-4bac-bc44-cff9f379847e admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.319082 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dadf6-c14d-4bac-bc44-cff9f379847e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.319359 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dadf6-c14d-4bac-bc44-cff9f379847e admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.320028 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032dadf6-c14d-4bac-bc44-cff9f379847e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.322001 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032dadf6-c14d-4bac-bc44-cff9f379847e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.347381 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 794/1577] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:06 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:06.347381 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27472804-28a8-46e7-9a13-f09f4c995f0e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.347669 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 784/1578] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:06 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:06.347774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032dadf6-c14d-4bac-bc44-cff9f379847e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.408928 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27472804-28a8-46e7-9a13-f09f4c995f0e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.409468 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032dadf6-c14d-4bac-bc44-cff9f379847e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.413726 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f3078-d0ee-4bf7-a49f-f83954242cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.414148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ace59-5387-4107-b62e-20f08c02ec4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.414538 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f3078-d0ee-4bf7-a49f-f83954242cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.414806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ace59-5387-4107-b62e-20f08c02ec4c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.414953 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f3078-d0ee-4bf7-a49f-f83954242cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.415091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ace59-5387-4107-b62e-20f08c02ec4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.415358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f3078-d0ee-4bf7-a49f-f83954242cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.415466 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ace59-5387-4107-b62e-20f08c02ec4c admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.416052 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ace59-5387-4107-b62e-20f08c02ec4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.416221 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f3078-d0ee-4bf7-a49f-f83954242cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.418005 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ace59-5387-4107-b62e-20f08c02ec4c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.418209 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f3078-d0ee-4bf7-a49f-f83954242cd4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.438488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 785/1579] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:06 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:06.439434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ace59-5387-4107-b62e-20f08c02ec4c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.443252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 795/1580] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:06 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:06.443252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f3078-d0ee-4bf7-a49f-f83954242cd4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.450116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f3078-d0ee-4bf7-a49f-f83954242cd4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.452334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ace59-5387-4107-b62e-20f08c02ec4c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.454620 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d16e6a-4877-4f13-aa02-c416b714638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.455255 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d16e6a-4877-4f13-aa02-c416b714638e admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.456124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d16e6a-4877-4f13-aa02-c416b714638e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.456403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d16e6a-4877-4f13-aa02-c416b714638e admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.457113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d16e6a-4877-4f13-aa02-c416b714638e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.457819 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746fb36-fd4b-46dc-beda-f7a64715361e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.458684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746fb36-fd4b-46dc-beda-f7a64715361e admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.458787 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d16e6a-4877-4f13-aa02-c416b714638e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.458973 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746fb36-fd4b-46dc-beda-f7a64715361e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.459259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746fb36-fd4b-46dc-beda-f7a64715361e admin admin] PATH_INFO: `/v3/projects/0801844b85614126a95ea1c8437cfa9b/users/28dd1fefe1ab4904b83e9fdbd08d3bfe/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.468556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 796/1581] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:06.469929 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d16e6a-4877-4f13-aa02-c416b714638e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.475951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746fb36-fd4b-46dc-beda-f7a64715361e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0801844b85614126a95ea1c8437cfa9b, user_id=28dd1fefe1ab4904b83e9fdbd08d3bfe, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.478736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746fb36-fd4b-46dc-beda-f7a64715361e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.479444 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d16e6a-4877-4f13-aa02-c416b714638e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.484265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba76435-02d6-447c-9e00-e2c4a1bb31ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.484966 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba76435-02d6-447c-9e00-e2c4a1bb31ae admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.485249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba76435-02d6-447c-9e00-e2c4a1bb31ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.485662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba76435-02d6-447c-9e00-e2c4a1bb31ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.486380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba76435-02d6-447c-9e00-e2c4a1bb31ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.488384 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba76435-02d6-447c-9e00-e2c4a1bb31ae admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.492735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 786/1582] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:06 2022] PUT /identity/v3/projects/0801844b85614126a95ea1c8437cfa9b/users/28dd1fefe1ab4904b83e9fdbd08d3bfe/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:06.493557 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746fb36-fd4b-46dc-beda-f7a64715361e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.506155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 797/1583] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:06.506155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba76435-02d6-447c-9e00-e2c4a1bb31ae admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.513855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba76435-02d6-447c-9e00-e2c4a1bb31ae admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.553065 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:06.556991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746fb36-fd4b-46dc-beda-f7a64715361e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.563296 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15c894-dbb4-495b-a746-36facaab4e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.563963 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15c894-dbb4-495b-a746-36facaab4e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.564365 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15c894-dbb4-495b-a746-36facaab4e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.564464 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:06.564649 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15c894-dbb4-495b-a746-36facaab4e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.566101 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15c894-dbb4-495b-a746-36facaab4e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.567745 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15c894-dbb4-495b-a746-36facaab4e8a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.571946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab685272-f7b6-4ed2-861d-ff00bf149723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.572614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab685272-f7b6-4ed2-861d-ff00bf149723 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.573213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab685272-f7b6-4ed2-861d-ff00bf149723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.573213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab685272-f7b6-4ed2-861d-ff00bf149723 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.573899 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab685272-f7b6-4ed2-861d-ff00bf149723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.575849 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab685272-f7b6-4ed2-861d-ff00bf149723 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.577951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 787/1584] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:06.578748 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15c894-dbb4-495b-a746-36facaab4e8a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.588190 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15c894-dbb4-495b-a746-36facaab4e8a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.592765 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953194a0-f0b7-4a55-a3eb-e493e6094afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.593420 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953194a0-f0b7-4a55-a3eb-e493e6094afa admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.593736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953194a0-f0b7-4a55-a3eb-e493e6094afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.594002 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953194a0-f0b7-4a55-a3eb-e493e6094afa admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.594654 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953194a0-f0b7-4a55-a3eb-e493e6094afa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.595423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 798/1585] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:06 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:06.596496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab685272-f7b6-4ed2-861d-ff00bf149723 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.596738 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953194a0-f0b7-4a55-a3eb-e493e6094afa admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.609595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab685272-f7b6-4ed2-861d-ff00bf149723 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.615478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8657779-9db8-495e-b1ff-63629c3e683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.616138 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8657779-9db8-495e-b1ff-63629c3e683f admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.616419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8657779-9db8-495e-b1ff-63629c3e683f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.616697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8657779-9db8-495e-b1ff-63629c3e683f admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.617455 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8657779-9db8-495e-b1ff-63629c3e683f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.619041 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8657779-9db8-495e-b1ff-63629c3e683f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.619392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 788/1586] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:06 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:06.620260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953194a0-f0b7-4a55-a3eb-e493e6094afa admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.630479 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953194a0-f0b7-4a55-a3eb-e493e6094afa admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.635103 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 799/1587] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:06.635103 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8657779-9db8-495e-b1ff-63629c3e683f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.635325 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede0cfb-f842-4228-88a9-be9d8941bc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.635830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede0cfb-f842-4228-88a9-be9d8941bc02 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.636114 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede0cfb-f842-4228-88a9-be9d8941bc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.636390 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede0cfb-f842-4228-88a9-be9d8941bc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.637106 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede0cfb-f842-4228-88a9-be9d8941bc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.638705 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede0cfb-f842-4228-88a9-be9d8941bc02 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.642579 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8657779-9db8-495e-b1ff-63629c3e683f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.647136 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bf85a-8c2c-4d17-af01-52f74486a93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.647762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bf85a-8c2c-4d17-af01-52f74486a93d admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.648045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bf85a-8c2c-4d17-af01-52f74486a93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.648322 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bf85a-8c2c-4d17-af01-52f74486a93d admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.649033 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bf85a-8c2c-4d17-af01-52f74486a93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.649319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 789/1588] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:06.650584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5959c33-32d9-463c-a7a3-6eeee77057c3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.650872 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5959c33-32d9-463c-a7a3-6eeee77057c3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.650979 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bf85a-8c2c-4d17-af01-52f74486a93d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.651137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5959c33-32d9-463c-a7a3-6eeee77057c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.664665 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 800/1589] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:06.664665 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bf85a-8c2c-4d17-af01-52f74486a93d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.667548 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c5959c33-32d9-463c-a7a3-6eeee77057c3 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:06.668730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c5959c33-32d9-463c-a7a3-6eeee77057c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:06.671623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bf85a-8c2c-4d17-af01-52f74486a93d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.676648 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ad757-0b31-421b-a919-a90ec5520f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.676809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 790/1590] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:06.677276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ad757-0b31-421b-a919-a90ec5520f38 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.677582 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5959c33-32d9-463c-a7a3-6eeee77057c3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.677672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ad757-0b31-421b-a919-a90ec5520f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.677855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ad757-0b31-421b-a919-a90ec5520f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.678556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ad757-0b31-421b-a919-a90ec5520f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.680628 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ad757-0b31-421b-a919-a90ec5520f38 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.686981 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5959c33-32d9-463c-a7a3-6eeee77057c3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.691171 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 801/1591] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:06.691922 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ad757-0b31-421b-a919-a90ec5520f38 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.692319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc450da6-9bf8-4bee-8618-7fc39f76d1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.693207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc450da6-9bf8-4bee-8618-7fc39f76d1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.693494 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc450da6-9bf8-4bee-8618-7fc39f76d1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.693767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc450da6-9bf8-4bee-8618-7fc39f76d1b4 admin admin] PATH_INFO: `/v3/projects/64915daac7324d9ba2a1a855a936542b/users/4d4dcc61d97942388468d6996f70e492/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.703372 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ad757-0b31-421b-a919-a90ec5520f38 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.708060 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b334f-6333-46fa-983f-9e0087473f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.708639 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc450da6-9bf8-4bee-8618-7fc39f76d1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64915daac7324d9ba2a1a855a936542b, user_id=4d4dcc61d97942388468d6996f70e492, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.708768 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b334f-6333-46fa-983f-9e0087473f85 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.708966 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b334f-6333-46fa-983f-9e0087473f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.709242 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b334f-6333-46fa-983f-9e0087473f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.709982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b334f-6333-46fa-983f-9e0087473f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.711339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc450da6-9bf8-4bee-8618-7fc39f76d1b4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.711557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b334f-6333-46fa-983f-9e0087473f85 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.721596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 802/1592] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:06.721596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b334f-6333-46fa-983f-9e0087473f85 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.726888 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 791/1593] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:06 2022] PUT /identity/v3/projects/64915daac7324d9ba2a1a855a936542b/users/4d4dcc61d97942388468d6996f70e492/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:06.727751 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc450da6-9bf8-4bee-8618-7fc39f76d1b4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.742348 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b334f-6333-46fa-983f-9e0087473f85 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.788801 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc450da6-9bf8-4bee-8618-7fc39f76d1b4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.793460 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1cdcda-690d-4e4b-8afb-72639bdbbf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.794128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cdcda-690d-4e4b-8afb-72639bdbbf21 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.794511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cdcda-690d-4e4b-8afb-72639bdbbf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.794858 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cdcda-690d-4e4b-8afb-72639bdbbf21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.795777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1cdcda-690d-4e4b-8afb-72639bdbbf21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.797387 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1cdcda-690d-4e4b-8afb-72639bdbbf21 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.798205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c780a-e0b9-40c9-a6e1-c2256da05240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.798869 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c780a-e0b9-40c9-a6e1-c2256da05240 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.799663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c780a-e0b9-40c9-a6e1-c2256da05240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.799942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c780a-e0b9-40c9-a6e1-c2256da05240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.800656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c780a-e0b9-40c9-a6e1-c2256da05240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.802408 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c780a-e0b9-40c9-a6e1-c2256da05240 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.807893 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 792/1594] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:06.808720 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1cdcda-690d-4e4b-8afb-72639bdbbf21 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.816000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 803/1595] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:06.816000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c780a-e0b9-40c9-a6e1-c2256da05240 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.821270 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1cdcda-690d-4e4b-8afb-72639bdbbf21 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.825594 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c780a-e0b9-40c9-a6e1-c2256da05240 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.825842 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0595466-b4ca-4cc2-8471-ed98060ffedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.826489 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0595466-b4ca-4cc2-8471-ed98060ffedc admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.826776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0595466-b4ca-4cc2-8471-ed98060ffedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.827061 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0595466-b4ca-4cc2-8471-ed98060ffedc admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.827780 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0595466-b4ca-4cc2-8471-ed98060ffedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.829388 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0595466-b4ca-4cc2-8471-ed98060ffedc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.830451 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5b058-3450-446d-864c-067d7d5e423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.831347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5b058-3450-446d-864c-067d7d5e423e admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.831719 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5b058-3450-446d-864c-067d7d5e423e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.831986 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5b058-3450-446d-864c-067d7d5e423e admin admin] PATH_INFO: `/v3/projects/3f254c1d62a14737904b16384808e795/users/7869177071064c9998abdae9d350f051/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.839636 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 793/1596] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:06.840528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0595466-b4ca-4cc2-8471-ed98060ffedc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.848153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5b058-3450-446d-864c-067d7d5e423e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f254c1d62a14737904b16384808e795, user_id=7869177071064c9998abdae9d350f051, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.849189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-7bb5b058-3450-446d-864c-067d7d5e423e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 11:09:06.849189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Jun 27 11:09:06.849189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: Jun 27 11:09:06.851189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5b058-3450-446d-864c-067d7d5e423e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.864479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 804/1597] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:06 2022] PUT /identity/v3/projects/3f254c1d62a14737904b16384808e795/users/7869177071064c9998abdae9d350f051/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:06.865187 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5b058-3450-446d-864c-067d7d5e423e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.898242 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0595466-b4ca-4cc2-8471-ed98060ffedc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.927749 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5b058-3450-446d-864c-067d7d5e423e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:06.930816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:06.932930 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054df954-fdc7-4049-b9eb-b337a60d66fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.934005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054df954-fdc7-4049-b9eb-b337a60d66fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.934292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054df954-fdc7-4049-b9eb-b337a60d66fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.934658 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054df954-fdc7-4049-b9eb-b337a60d66fb admin admin] PATH_INFO: `/v3/projects/4bf80abcddfc4dbdb9e845b6eaf1b508/users/38dde6fe09ca4266af31f3e1bc19e18c/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.949179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054df954-fdc7-4049-b9eb-b337a60d66fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf80abcddfc4dbdb9e845b6eaf1b508, user_id=38dde6fe09ca4266af31f3e1bc19e18c, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.949393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c750625-3935-49a5-8319-62339412fbad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:06.949937 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c750625-3935-49a5-8319-62339412fbad service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.950221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c750625-3935-49a5-8319-62339412fbad service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.950498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c750625-3935-49a5-8319-62339412fbad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:06.951854 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054df954-fdc7-4049-b9eb-b337a60d66fb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.959851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:06.960036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c750625-3935-49a5-8319-62339412fbad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:06.961496 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c750625-3935-49a5-8319-62339412fbad service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:06.967019 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 805/1598] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:06 2022] PUT /identity/v3/projects/4bf80abcddfc4dbdb9e845b6eaf1b508/users/38dde6fe09ca4266af31f3e1bc19e18c/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:06.971569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 794/1599] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:06.971743 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054df954-fdc7-4049-b9eb-b337a60d66fb admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:06.972714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9027d32-cf27-4243-93a4-5e357f9f8df9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:06.973001 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9027d32-cf27-4243-93a4-5e357f9f8df9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:06.973279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9027d32-cf27-4243-93a4-5e357f9f8df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.000375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f9027d32-cf27-4243-93a4-5e357f9f8df9 None None] MFA Rules not processed for user `4d4dcc61d97942388468d6996f70e492`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:07.002068 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f9027d32-cf27-4243-93a4-5e357f9f8df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:07.039784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054df954-fdc7-4049-b9eb-b337a60d66fb admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:07.044420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f454e3-18b8-4b6f-a909-450ce02e7936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:07.045533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f454e3-18b8-4b6f-a909-450ce02e7936 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.045856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f454e3-18b8-4b6f-a909-450ce02e7936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.046169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f454e3-18b8-4b6f-a909-450ce02e7936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.047032 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f454e3-18b8-4b6f-a909-450ce02e7936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:07.048931 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f454e3-18b8-4b6f-a909-450ce02e7936 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:07.064522 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 806/1600] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:07.064522 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f454e3-18b8-4b6f-a909-450ce02e7936 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:07.073875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f454e3-18b8-4b6f-a909-450ce02e7936 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:07.076714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 795/1601] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:07.077660 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9027d32-cf27-4243-93a4-5e357f9f8df9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:07.083211 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa1afb-9059-4c86-b703-176d3bb6ac6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:07.084532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa1afb-9059-4c86-b703-176d3bb6ac6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.084822 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa1afb-9059-4c86-b703-176d3bb6ac6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.085249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa1afb-9059-4c86-b703-176d3bb6ac6d admin admin] PATH_INFO: `/v3/projects/a705e677ae29454b8a0a3f5df57d90e7/users/c4a4dd8d8f624a1e94226a4025f5dd3f/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.090310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9027d32-cf27-4243-93a4-5e357f9f8df9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:07.096821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f24039-ca78-4c50-ac42-618b44f8b13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:07.097785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f24039-ca78-4c50-ac42-618b44f8b13b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.098167 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f24039-ca78-4c50-ac42-618b44f8b13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.098543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f24039-ca78-4c50-ac42-618b44f8b13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.099366 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f24039-ca78-4c50-ac42-618b44f8b13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:07.101103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f24039-ca78-4c50-ac42-618b44f8b13b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:07.104302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa1afb-9059-4c86-b703-176d3bb6ac6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a705e677ae29454b8a0a3f5df57d90e7, user_id=c4a4dd8d8f624a1e94226a4025f5dd3f, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:07.107448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa1afb-9059-4c86-b703-176d3bb6ac6d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:07.113969 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 796/1602] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:07.114951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f24039-ca78-4c50-ac42-618b44f8b13b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:07.125830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 807/1603] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:07 2022] PUT /identity/v3/projects/a705e677ae29454b8a0a3f5df57d90e7/users/c4a4dd8d8f624a1e94226a4025f5dd3f/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:07.126952 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84898138-3dbc-43e8-8ae6-ed1b98cd9708 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.127102 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f24039-ca78-4c50-ac42-618b44f8b13b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:07.127272 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84898138-3dbc-43e8-8ae6-ed1b98cd9708 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.127557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84898138-3dbc-43e8-8ae6-ed1b98cd9708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.155133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-84898138-3dbc-43e8-8ae6-ed1b98cd9708 None None] MFA Rules not processed for user `7869177071064c9998abdae9d350f051`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:07.156618 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-84898138-3dbc-43e8-8ae6-ed1b98cd9708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:07.217983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1460b36-c801-464e-bef1-4ddffc8f1cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:07.218879 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1460b36-c801-464e-bef1-4ddffc8f1cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.219158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1460b36-c801-464e-bef1-4ddffc8f1cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.219429 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1460b36-c801-464e-bef1-4ddffc8f1cc9 admin admin] PATH_INFO: `/v3/projects/33b8bcf19597417b87a2c3e532871bcb/users/1a6f74ad17db45bf8d2e4f0631d1a55e/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.237552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1460b36-c801-464e-bef1-4ddffc8f1cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b8bcf19597417b87a2c3e532871bcb, user_id=1a6f74ad17db45bf8d2e4f0631d1a55e, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:07.240204 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1460b36-c801-464e-bef1-4ddffc8f1cc9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:07.242857 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 808/1604] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:07.246947 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df6509-4b85-4c23-af10-01afe66bfdcb None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.247815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df6509-4b85-4c23-af10-01afe66bfdcb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.248254 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df6509-4b85-4c23-af10-01afe66bfdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.254912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 797/1605] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:07 2022] PUT /identity/v3/projects/33b8bcf19597417b87a2c3e532871bcb/users/1a6f74ad17db45bf8d2e4f0631d1a55e/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:07.256001 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1460b36-c801-464e-bef1-4ddffc8f1cc9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:07.279231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c8df6509-4b85-4c23-af10-01afe66bfdcb None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:07.282065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c8df6509-4b85-4c23-af10-01afe66bfdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:07.314534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:07.338212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1460b36-c801-464e-bef1-4ddffc8f1cc9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:07.343570 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3284bb-8002-453c-9fd3-7df3c44ca9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:07.344480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3284bb-8002-453c-9fd3-7df3c44ca9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.344761 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3284bb-8002-453c-9fd3-7df3c44ca9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.345032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3284bb-8002-453c-9fd3-7df3c44ca9f6 admin admin] PATH_INFO: `/v3/projects/7ad7773986f9408597352f49ed44cf66/users/8c4a977f4cdf44838410821dd0f27c38/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.350305 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:07.363356 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3284bb-8002-453c-9fd3-7df3c44ca9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad7773986f9408597352f49ed44cf66, user_id=8c4a977f4cdf44838410821dd0f27c38, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:07.365526 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 809/1606] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:07.366031 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3284bb-8002-453c-9fd3-7df3c44ca9f6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:07.366909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df6509-4b85-4c23-af10-01afe66bfdcb None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:07.384871 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 798/1607] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:07 2022] PUT /identity/v3/projects/7ad7773986f9408597352f49ed44cf66/users/8c4a977f4cdf44838410821dd0f27c38/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:07.385867 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3284bb-8002-453c-9fd3-7df3c44ca9f6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:07.455892 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df6509-4b85-4c23-af10-01afe66bfdcb None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:07.500578 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3284bb-8002-453c-9fd3-7df3c44ca9f6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:07.507213 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f6393-a5cc-4385-bb73-ae117fde61dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:07.508285 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f6393-a5cc-4385-bb73-ae117fde61dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.509046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f6393-a5cc-4385-bb73-ae117fde61dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.509339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f6393-a5cc-4385-bb73-ae117fde61dc admin admin] PATH_INFO: `/v3/projects/0bbf44422f974f348d8a4217896ceaaf/users/fcbcaa64592b45d2a4db33a592ca3d6a/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.519842 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b9b6d-1e4b-4748-9bd2-114330e45321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:07.520738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b9b6d-1e4b-4748-9bd2-114330e45321 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.521301 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b9b6d-1e4b-4748-9bd2-114330e45321 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.521746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b9b6d-1e4b-4748-9bd2-114330e45321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.530869 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f6393-a5cc-4385-bb73-ae117fde61dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bbf44422f974f348d8a4217896ceaaf, user_id=fcbcaa64592b45d2a4db33a592ca3d6a, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:07.535983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f6393-a5cc-4385-bb73-ae117fde61dc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:07.554710 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 799/1608] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:07 2022] PUT /identity/v3/projects/0bbf44422f974f348d8a4217896ceaaf/users/fcbcaa64592b45d2a4db33a592ca3d6a/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:07.556368 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef524fe-256f-4f01-af9e-8b448cce1e9a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.556900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef524fe-256f-4f01-af9e-8b448cce1e9a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.557254 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef524fe-256f-4f01-af9e-8b448cce1e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.588819 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0ef524fe-256f-4f01-af9e-8b448cce1e9a None None] MFA Rules not processed for user `c4a4dd8d8f624a1e94226a4025f5dd3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:07.590349 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0ef524fe-256f-4f01-af9e-8b448cce1e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:07.593401 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b9b6d-1e4b-4748-9bd2-114330e45321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:07.595071 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b9b6d-1e4b-4748-9bd2-114330e45321 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:07.608243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 810/1609] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:07.609881 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511faf2-b15b-489a-95ba-a2cfe883a4d4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.610257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511faf2-b15b-489a-95ba-a2cfe883a4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.610612 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511faf2-b15b-489a-95ba-a2cfe883a4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.631408 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9511faf2-b15b-489a-95ba-a2cfe883a4d4 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:07.632690 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9511faf2-b15b-489a-95ba-a2cfe883a4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:07.693907 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 800/1610] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:07.699097 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ecfab-a89b-4fa5-b130-84c1da62a1ab None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.699600 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ecfab-a89b-4fa5-b130-84c1da62a1ab None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.700017 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ecfab-a89b-4fa5-b130-84c1da62a1ab None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.701569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 801/1611] 10.222.0.18 () {54 vars in 961 bytes} [Mon Jun 27 11:09:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:09:07.702375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ecfab-a89b-4fa5-b130-84c1da62a1ab None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:07.744179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 811/1612] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:07.744179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c24b9d-087b-4d83-b8f9-6456a345289f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.744179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c24b9d-087b-4d83-b8f9-6456a345289f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.744179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c24b9d-087b-4d83-b8f9-6456a345289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.774046 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:07.778655 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:07.785928 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-12c24b9d-087b-4d83-b8f9-6456a345289f None None] MFA Rules not processed for user `8c4a977f4cdf44838410821dd0f27c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:07.787291 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-12c24b9d-087b-4d83-b8f9-6456a345289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:07.813390 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ecfab-a89b-4fa5-b130-84c1da62a1ab None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:07.818699 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16439e-e225-4a1f-92a7-23d8ad2c8f23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:07.819423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16439e-e225-4a1f-92a7-23d8ad2c8f23 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.819837 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16439e-e225-4a1f-92a7-23d8ad2c8f23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.820122 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16439e-e225-4a1f-92a7-23d8ad2c8f23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.831288 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16439e-e225-4a1f-92a7-23d8ad2c8f23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:07.833612 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16439e-e225-4a1f-92a7-23d8ad2c8f23 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:07.846616 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 802/1613] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:07.847927 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4eabf-afc1-4359-a1b6-ac996262629f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.848221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4eabf-afc1-4359-a1b6-ac996262629f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.848501 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4eabf-afc1-4359-a1b6-ac996262629f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.869512 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 812/1614] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:07.871148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-80f4eabf-afc1-4359-a1b6-ac996262629f None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:07.872387 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-80f4eabf-afc1-4359-a1b6-ac996262629f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:07.873484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac35fd-d848-44b1-bc22-59887717e232 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.873874 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac35fd-d848-44b1-bc22-59887717e232 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.874167 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac35fd-d848-44b1-bc22-59887717e232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.882031 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 803/1615] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:07.883670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3900875-ee17-4e77-80c5-4225f02e9067 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.883810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3900875-ee17-4e77-80c5-4225f02e9067 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.884221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3900875-ee17-4e77-80c5-4225f02e9067 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.885986 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 804/1616] 10.222.0.18 () {54 vars in 961 bytes} [Mon Jun 27 11:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:09:07.886858 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3900875-ee17-4e77-80c5-4225f02e9067 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:07.899593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3900875-ee17-4e77-80c5-4225f02e9067 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:07.904778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca67965-7f07-4c6d-ac17-70cd0d1d5455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:07.905467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca67965-7f07-4c6d-ac17-70cd0d1d5455 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.905797 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca67965-7f07-4c6d-ac17-70cd0d1d5455 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.906075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca67965-7f07-4c6d-ac17-70cd0d1d5455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.910983 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-25ac35fd-d848-44b1-bc22-59887717e232 None None] MFA Rules not processed for user `ed08c367a3d34207a51914ff77a93898`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:07.913264 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-25ac35fd-d848-44b1-bc22-59887717e232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:07.917724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca67965-7f07-4c6d-ac17-70cd0d1d5455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:07.919931 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca67965-7f07-4c6d-ac17-70cd0d1d5455 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:07.932934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 805/1617] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:07.934290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832241f5-c392-4b8e-96bf-07483b5a18c9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:07.935188 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832241f5-c392-4b8e-96bf-07483b5a18c9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:07.935475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832241f5-c392-4b8e-96bf-07483b5a18c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:07.956013 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-832241f5-c392-4b8e-96bf-07483b5a18c9 None None] MFA Rules not processed for user `ed08c367a3d34207a51914ff77a93898`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:07.957487 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-832241f5-c392-4b8e-96bf-07483b5a18c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:08.074818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 813/1618] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Jun 27 11:09:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:08.076027 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac35fd-d848-44b1-bc22-59887717e232 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:08.087150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 806/1619] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Jun 27 11:09:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:08.087947 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832241f5-c392-4b8e-96bf-07483b5a18c9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:08.090013 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac35fd-d848-44b1-bc22-59887717e232 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:08.094801 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1d314-905f-4652-ad51-7958416cf898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:08.095700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d314-905f-4652-ad51-7958416cf898 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:08.096738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d314-905f-4652-ad51-7958416cf898 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:08.097222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d314-905f-4652-ad51-7958416cf898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:08.113164 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1d314-905f-4652-ad51-7958416cf898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:08.113613 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832241f5-c392-4b8e-96bf-07483b5a18c9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:08.115067 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1d314-905f-4652-ad51-7958416cf898 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:08.126519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639d564-4cbb-407f-b40d-ac13c70753ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:08.127248 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d564-4cbb-407f-b40d-ac13c70753ba service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:08.127543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d564-4cbb-407f-b40d-ac13c70753ba service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:08.127821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d564-4cbb-407f-b40d-ac13c70753ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:08.128459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 814/1620] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:08.130030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1d314-905f-4652-ad51-7958416cf898 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:08.146645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1d314-905f-4652-ad51-7958416cf898 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:08.156572 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d697df-9d04-4806-be21-b0000c2f0ea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:08.157873 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d697df-9d04-4806-be21-b0000c2f0ea6 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:08.158126 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d697df-9d04-4806-be21-b0000c2f0ea6 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:08.158407 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d697df-9d04-4806-be21-b0000c2f0ea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:08.178772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d697df-9d04-4806-be21-b0000c2f0ea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:08.186734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d697df-9d04-4806-be21-b0000c2f0ea6 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:08.217481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 815/1621] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:08.245716 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639d564-4cbb-407f-b40d-ac13c70753ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:08.247493 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639d564-4cbb-407f-b40d-ac13c70753ba service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:08.270352 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 807/1622] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:08.733764 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fd388-0973-494b-aaa8-5c1f59f98174 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:08.734846 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fd388-0973-494b-aaa8-5c1f59f98174 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:08.735152 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fd388-0973-494b-aaa8-5c1f59f98174 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:08.737714 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 816/1623] 10.222.0.18 () {54 vars in 912 bytes} [Mon Jun 27 11:09:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:09:08.744358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b13cd-e1b1-4f6d-afdb-f571d7d8b218 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:08.744358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b13cd-e1b1-4f6d-afdb-f571d7d8b218 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:08.745008 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b13cd-e1b1-4f6d-afdb-f571d7d8b218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:08.772687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e32b13cd-e1b1-4f6d-afdb-f571d7d8b218 None None] MFA Rules not processed for user `ed08c367a3d34207a51914ff77a93898`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:08.774423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e32b13cd-e1b1-4f6d-afdb-f571d7d8b218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:08.804750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 808/1624] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jun 27 11:09:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:08.816428 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fd388-0973-494b-aaa8-5c1f59f98174 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:08.862014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac55e5-c04b-455f-801a-3eeea7246c4b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:08.862311 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac55e5-c04b-455f-801a-3eeea7246c4b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:08.862588 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac55e5-c04b-455f-801a-3eeea7246c4b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:08.864217 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 809/1625] 10.222.0.18 () {54 vars in 912 bytes} [Mon Jun 27 11:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 11:09:08.889036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fefe3e-3baf-433a-b776-d1203a7cf652 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:08.889419 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fefe3e-3baf-433a-b776-d1203a7cf652 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:08.890448 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fefe3e-3baf-433a-b776-d1203a7cf652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:08.933114 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-38fefe3e-3baf-433a-b776-d1203a7cf652 None None] MFA Rules not processed for user `ed08c367a3d34207a51914ff77a93898`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:08.935584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-38fefe3e-3baf-433a-b776-d1203a7cf652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:08.943563 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fd388-0973-494b-aaa8-5c1f59f98174 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:08.951983 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257be0c-a74b-477a-aba9-3fc3dfdd0349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:08.953485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257be0c-a74b-477a-aba9-3fc3dfdd0349 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:08.953775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257be0c-a74b-477a-aba9-3fc3dfdd0349 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:08.954052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257be0c-a74b-477a-aba9-3fc3dfdd0349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:08.958347 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 810/1626] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jun 27 11:09:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:08.974646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fefe3e-3baf-433a-b776-d1203a7cf652 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:08.983174 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257be0c-a74b-477a-aba9-3fc3dfdd0349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:08.984631 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257be0c-a74b-477a-aba9-3fc3dfdd0349 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:08.990982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fefe3e-3baf-433a-b776-d1203a7cf652 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:08.999017 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40293c80-d170-4633-a01d-a07b6ab50306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:08.999904 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40293c80-d170-4633-a01d-a07b6ab50306 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:09.000193 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40293c80-d170-4633-a01d-a07b6ab50306 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:09.000503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40293c80-d170-4633-a01d-a07b6ab50306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:09.028041 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40293c80-d170-4633-a01d-a07b6ab50306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:09.029577 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40293c80-d170-4633-a01d-a07b6ab50306 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:09.037393 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 817/1627] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:09.072581 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 811/1628] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:09:09.601847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257be0c-a74b-477a-aba9-3fc3dfdd0349 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:09.621356 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257be0c-a74b-477a-aba9-3fc3dfdd0349 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:09.653356 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1ed2e-7cd3-4572-961e-3e69a77789d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:09.654737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1ed2e-7cd3-4572-961e-3e69a77789d2 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:09.655340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1ed2e-7cd3-4572-961e-3e69a77789d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:09.655816 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1ed2e-7cd3-4572-961e-3e69a77789d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:09.671240 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:09.676693 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1ed2e-7cd3-4572-961e-3e69a77789d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:09.692335 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1ed2e-7cd3-4572-961e-3e69a77789d2 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:09.716599 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 818/1629] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:10.265119 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40293c80-d170-4633-a01d-a07b6ab50306 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:10.285930 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40293c80-d170-4633-a01d-a07b6ab50306 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:10.316699 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb59d67-a8cf-4f17-b2d9-fe4ecbdb3453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:10.317727 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb59d67-a8cf-4f17-b2d9-fe4ecbdb3453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:10.318132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb59d67-a8cf-4f17-b2d9-fe4ecbdb3453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:10.318316 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb59d67-a8cf-4f17-b2d9-fe4ecbdb3453 admin admin] PATH_INFO: `/v3/users/8c4a977f4cdf44838410821dd0f27c38` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:10.322480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb59d67-a8cf-4f17-b2d9-fe4ecbdb3453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c4a977f4cdf44838410821dd0f27c38)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:10.331060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb59d67-a8cf-4f17-b2d9-fe4ecbdb3453 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:10.356757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:10.416487 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-deb59d67-a8cf-4f17-b2d9-fe4ecbdb3453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c4a977f4cdf44838410821dd0f27c38'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:10.433964 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-deb59d67-a8cf-4f17-b2d9-fe4ecbdb3453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c4a977f4cdf44838410821dd0f27c38'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:10.434940 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-deb59d67-a8cf-4f17-b2d9-fe4ecbdb3453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c4a977f4cdf44838410821dd0f27c38'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:10.435767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-deb59d67-a8cf-4f17-b2d9-fe4ecbdb3453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c4a977f4cdf44838410821dd0f27c38'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:10.455697 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-deb59d67-a8cf-4f17-b2d9-fe4ecbdb3453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c4a977f4cdf44838410821dd0f27c38'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:10.474875 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 812/1630] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:09:10 2022] DELETE /identity/v3/users/8c4a977f4cdf44838410821dd0f27c38 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:10.480229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e46a46-32c8-4532-b0c7-7d578236319d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:10.481268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e46a46-32c8-4532-b0c7-7d578236319d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:10.481798 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e46a46-32c8-4532-b0c7-7d578236319d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:10.510474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c2e46a46-32c8-4532-b0c7-7d578236319d None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:10.512319 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c2e46a46-32c8-4532-b0c7-7d578236319d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:10.589521 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 819/1631] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:10.623838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb59d67-a8cf-4f17-b2d9-fe4ecbdb3453 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:10.626719 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-deb59d67-a8cf-4f17-b2d9-fe4ecbdb3453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:10.762358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb59d67-a8cf-4f17-b2d9-fe4ecbdb3453 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:10.767087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f5139-c47e-499a-b074-b78a9d7d5f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:10.769619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f5139-c47e-499a-b074-b78a9d7d5f48 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:10.769915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f5139-c47e-499a-b074-b78a9d7d5f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:10.770198 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f5139-c47e-499a-b074-b78a9d7d5f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:10.787025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f5139-c47e-499a-b074-b78a9d7d5f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:10.788507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f5139-c47e-499a-b074-b78a9d7d5f48 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:10.801648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 813/1632] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:12.232303 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e46a46-32c8-4532-b0c7-7d578236319d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:12.234877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c2e46a46-32c8-4532-b0c7-7d578236319d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:12.248945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e46a46-32c8-4532-b0c7-7d578236319d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:12.255692 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c8654-a8f3-4d58-910c-968937f6967b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:12.256806 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c8654-a8f3-4d58-910c-968937f6967b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:12.257284 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c8654-a8f3-4d58-910c-968937f6967b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:12.257752 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c8654-a8f3-4d58-910c-968937f6967b admin admin] PATH_INFO: `/v3/projects/7ad7773986f9408597352f49ed44cf66` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:12.259334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c8654-a8f3-4d58-910c-968937f6967b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad7773986f9408597352f49ed44cf66)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:12.262211 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c8654-a8f3-4d58-910c-968937f6967b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:12.321475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a55c8654-a8f3-4d58-910c-968937f6967b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad7773986f9408597352f49ed44cf66', 'request_id': 'req-a55c8654-a8f3-4d58-910c-968937f6967b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:12.331999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a55c8654-a8f3-4d58-910c-968937f6967b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad7773986f9408597352f49ed44cf66', 'request_id': 'req-a55c8654-a8f3-4d58-910c-968937f6967b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:12.345533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a55c8654-a8f3-4d58-910c-968937f6967b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad7773986f9408597352f49ed44cf66', 'request_id': 'req-a55c8654-a8f3-4d58-910c-968937f6967b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:12.376690 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a55c8654-a8f3-4d58-910c-968937f6967b admin admin] The token cache is being invalidate because project 7ad7773986f9408597352f49ed44cf66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:09:12.377003 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a55c8654-a8f3-4d58-910c-968937f6967b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:12.378509 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a55c8654-a8f3-4d58-910c-968937f6967b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:12.380368 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 820/1633] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:09:12 2022] DELETE /identity/v3/projects/7ad7773986f9408597352f49ed44cf66 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:12.386163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caa03a-8b22-437a-9558-5cfadbfe7f55 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:12.386163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caa03a-8b22-437a-9558-5cfadbfe7f55 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:12.386902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caa03a-8b22-437a-9558-5cfadbfe7f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:12.418271 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f3caa03a-8b22-437a-9558-5cfadbfe7f55 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:12.419803 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f3caa03a-8b22-437a-9558-5cfadbfe7f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:12.588505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853274e5-3a31-409a-a28c-65535e8de7ba None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:12.588797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853274e5-3a31-409a-a28c-65535e8de7ba None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:12.588924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 814/1634] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:12.589103 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853274e5-3a31-409a-a28c-65535e8de7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:12.671382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-853274e5-3a31-409a-a28c-65535e8de7ba None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:12.672613 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-853274e5-3a31-409a-a28c-65535e8de7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:12.713311 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 821/1635] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:09:12.713570 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caa03a-8b22-437a-9558-5cfadbfe7f55 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:12.722891 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caa03a-8b22-437a-9558-5cfadbfe7f55 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:12.737473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414efc0-c53f-424d-9d09-e858e4228672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:12.738159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414efc0-c53f-424d-9d09-e858e4228672 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:12.738439 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414efc0-c53f-424d-9d09-e858e4228672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:12.738712 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414efc0-c53f-424d-9d09-e858e4228672 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:12.739450 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414efc0-c53f-424d-9d09-e858e4228672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:09:12.739748 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414efc0-c53f-424d-9d09-e858e4228672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:12.741393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414efc0-c53f-424d-9d09-e858e4228672 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:12.779442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 815/1636] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:09:12.781710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853274e5-3a31-409a-a28c-65535e8de7ba None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:12.794817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853274e5-3a31-409a-a28c-65535e8de7ba None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:12.809902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69840363-76fb-494c-b4ab-5f041c5eb9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:12.810587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69840363-76fb-494c-b4ab-5f041c5eb9b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:12.810871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69840363-76fb-494c-b4ab-5f041c5eb9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:12.811145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69840363-76fb-494c-b4ab-5f041c5eb9b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:12.811851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69840363-76fb-494c-b4ab-5f041c5eb9b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:12.813946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69840363-76fb-494c-b4ab-5f041c5eb9b1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:12.878875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 822/1637] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:12 2022] POST /identity/v3/projects => generated 403 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:12.879130 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414efc0-c53f-424d-9d09-e858e4228672 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:12.890233 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414efc0-c53f-424d-9d09-e858e4228672 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:12.941898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:13.019130 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bbd09-e05e-40cd-b63a-c0d1012e7583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:13.020052 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bbd09-e05e-40cd-b63a-c0d1012e7583 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:13.020541 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bbd09-e05e-40cd-b63a-c0d1012e7583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:13.020952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bbd09-e05e-40cd-b63a-c0d1012e7583 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:13.021823 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bbd09-e05e-40cd-b63a-c0d1012e7583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:13.026394 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bbd09-e05e-40cd-b63a-c0d1012e7583 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:13.090474 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 816/1638] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:12 2022] POST /identity/v3/users => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:13.093271 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69840363-76fb-494c-b4ab-5f041c5eb9b1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:13.107047 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69840363-76fb-494c-b4ab-5f041c5eb9b1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:13.126112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a68197-c98f-4cea-a42b-0a1828d57afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:13.126807 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a68197-c98f-4cea-a42b-0a1828d57afd admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:13.127604 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a68197-c98f-4cea-a42b-0a1828d57afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:13.127888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a68197-c98f-4cea-a42b-0a1828d57afd admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:13.128613 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a68197-c98f-4cea-a42b-0a1828d57afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:13.131569 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a68197-c98f-4cea-a42b-0a1828d57afd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:13.161143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 823/1639] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:13.165166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bbd09-e05e-40cd-b63a-c0d1012e7583 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:13.182724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bbd09-e05e-40cd-b63a-c0d1012e7583 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:13.196914 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79107f2e-7e6e-4e5c-af98-4b42a576e898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:13.198418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79107f2e-7e6e-4e5c-af98-4b42a576e898 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:13.198418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79107f2e-7e6e-4e5c-af98-4b42a576e898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:13.198418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79107f2e-7e6e-4e5c-af98-4b42a576e898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:13.201657 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79107f2e-7e6e-4e5c-af98-4b42a576e898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:13.204012 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79107f2e-7e6e-4e5c-af98-4b42a576e898 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:13.233826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 817/1640] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:13.239528 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a68197-c98f-4cea-a42b-0a1828d57afd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:13.250050 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a68197-c98f-4cea-a42b-0a1828d57afd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:13.266297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f376c4d-5a30-4971-9fd6-967c081edb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:13.267563 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f376c4d-5a30-4971-9fd6-967c081edb4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:13.268016 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f376c4d-5a30-4971-9fd6-967c081edb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:13.268432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f376c4d-5a30-4971-9fd6-967c081edb4c admin admin] PATH_INFO: `/v3/projects/c46df6de8e1e48f79ff227edbdc44ba0/users/86a0638f9e2c4bb584cc80cee58eca5b/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:13.345050 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f376c4d-5a30-4971-9fd6-967c081edb4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c46df6de8e1e48f79ff227edbdc44ba0, user_id=86a0638f9e2c4bb584cc80cee58eca5b, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:13.356848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f376c4d-5a30-4971-9fd6-967c081edb4c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:13.407436 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 824/1641] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:13 2022] PUT /identity/v3/projects/c46df6de8e1e48f79ff227edbdc44ba0/users/86a0638f9e2c4bb584cc80cee58eca5b/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:13.419202 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606d8c4-8c52-4280-9a3a-578abf2011bc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:13.419685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606d8c4-8c52-4280-9a3a-578abf2011bc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:13.423010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606d8c4-8c52-4280-9a3a-578abf2011bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:13.514562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b606d8c4-8c52-4280-9a3a-578abf2011bc None None] MFA Rules not processed for user `86a0638f9e2c4bb584cc80cee58eca5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:13.522544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b606d8c4-8c52-4280-9a3a-578abf2011bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:13.727784 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 818/1642] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:13.728940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f376c4d-5a30-4971-9fd6-967c081edb4c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:13.764748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:13.920646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f376c4d-5a30-4971-9fd6-967c081edb4c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:13.938809 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c994565-da85-49d1-83e7-974686e4f892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:13.939504 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c994565-da85-49d1-83e7-974686e4f892 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:13.940480 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c994565-da85-49d1-83e7-974686e4f892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:13.940679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c994565-da85-49d1-83e7-974686e4f892 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:13.941276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c994565-da85-49d1-83e7-974686e4f892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:13.944100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c994565-da85-49d1-83e7-974686e4f892 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:14.020008 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 825/1643] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:13 2022] POST /identity/v3/projects => generated 405 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:14.024277 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606d8c4-8c52-4280-9a3a-578abf2011bc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:14.039194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606d8c4-8c52-4280-9a3a-578abf2011bc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:14.196163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72c4b9-1ad6-4b83-ae35-b073e2c2a975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:14.196976 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72c4b9-1ad6-4b83-ae35-b073e2c2a975 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:14.202065 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72c4b9-1ad6-4b83-ae35-b073e2c2a975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:14.202470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72c4b9-1ad6-4b83-ae35-b073e2c2a975 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:14.203331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72c4b9-1ad6-4b83-ae35-b073e2c2a975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:14.218258 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72c4b9-1ad6-4b83-ae35-b073e2c2a975 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:14.267214 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 819/1644] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:14 2022] POST /identity/v3/users => generated 309 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:14.271554 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c994565-da85-49d1-83e7-974686e4f892 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:14.290656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c994565-da85-49d1-83e7-974686e4f892 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:14.303420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac092305-ba7d-45de-bc36-958f71a7c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:14.304394 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac092305-ba7d-45de-bc36-958f71a7c820 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:14.304861 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac092305-ba7d-45de-bc36-958f71a7c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:14.305317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac092305-ba7d-45de-bc36-958f71a7c820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:14.306391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac092305-ba7d-45de-bc36-958f71a7c820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:14.312579 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac092305-ba7d-45de-bc36-958f71a7c820 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:14.334734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 826/1645] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:14.339368 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72c4b9-1ad6-4b83-ae35-b073e2c2a975 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:14.356849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72c4b9-1ad6-4b83-ae35-b073e2c2a975 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:14.372649 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2933b-79d3-4c9a-997e-33b75eba7540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:14.373931 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2933b-79d3-4c9a-997e-33b75eba7540 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:14.374658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2933b-79d3-4c9a-997e-33b75eba7540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:14.375010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2933b-79d3-4c9a-997e-33b75eba7540 admin admin] PATH_INFO: `/v3/projects/7a56434fad784774bcd68f444114d409/users/0166fbf931ba487fa170f3e0af36d76c/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:14.406027 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2933b-79d3-4c9a-997e-33b75eba7540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a56434fad784774bcd68f444114d409, user_id=0166fbf931ba487fa170f3e0af36d76c, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:14.412116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2933b-79d3-4c9a-997e-33b75eba7540 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:14.431384 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:14.440063 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 820/1646] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:14 2022] PUT /identity/v3/projects/7a56434fad784774bcd68f444114d409/users/0166fbf931ba487fa170f3e0af36d76c/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:14.444215 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac092305-ba7d-45de-bc36-958f71a7c820 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:14.459698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac092305-ba7d-45de-bc36-958f71a7c820 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:14.608492 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094671b3-2c7b-4aba-ac3d-8c444c2838e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:14.609202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094671b3-2c7b-4aba-ac3d-8c444c2838e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:14.609550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094671b3-2c7b-4aba-ac3d-8c444c2838e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:14.609827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094671b3-2c7b-4aba-ac3d-8c444c2838e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:14.610606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094671b3-2c7b-4aba-ac3d-8c444c2838e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:14.614549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094671b3-2c7b-4aba-ac3d-8c444c2838e7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:14.640118 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 827/1647] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:14.644391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2933b-79d3-4c9a-997e-33b75eba7540 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:14.656071 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2933b-79d3-4c9a-997e-33b75eba7540 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:14.669757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31c945-6d49-4bdf-b113-777824504e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:14.672089 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c945-6d49-4bdf-b113-777824504e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:14.673528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c945-6d49-4bdf-b113-777824504e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:14.674062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c945-6d49-4bdf-b113-777824504e55 admin admin] PATH_INFO: `/v3/projects/7a56434fad784774bcd68f444114d409/users/0166fbf931ba487fa170f3e0af36d76c/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:14.681313 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31c945-6d49-4bdf-b113-777824504e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a56434fad784774bcd68f444114d409, user_id=0166fbf931ba487fa170f3e0af36d76c, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:14.691839 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31c945-6d49-4bdf-b113-777824504e55 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:14.727621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 821/1648] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:14 2022] PUT /identity/v3/projects/7a56434fad784774bcd68f444114d409/users/0166fbf931ba487fa170f3e0af36d76c/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:14.739693 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b40415-6794-43cc-b58e-0c032c831621 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:14.740251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b40415-6794-43cc-b58e-0c032c831621 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:14.740746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b40415-6794-43cc-b58e-0c032c831621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:14.797057 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-41b40415-6794-43cc-b58e-0c032c831621 None None] MFA Rules not processed for user `0166fbf931ba487fa170f3e0af36d76c`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:14.800076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-41b40415-6794-43cc-b58e-0c032c831621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:14.975719 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 828/1649] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:14 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:15.005725 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31c945-6d49-4bdf-b113-777824504e55 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:15.007826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3c31c945-6d49-4bdf-b113-777824504e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:15.160604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31c945-6d49-4bdf-b113-777824504e55 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:15.172871 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a89ba1-1995-4c4b-b3f6-9af2ff5aabd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:15.180467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a89ba1-1995-4c4b-b3f6-9af2ff5aabd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:15.181768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a89ba1-1995-4c4b-b3f6-9af2ff5aabd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:15.183160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a89ba1-1995-4c4b-b3f6-9af2ff5aabd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:15.222289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a89ba1-1995-4c4b-b3f6-9af2ff5aabd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:15.225798 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a89ba1-1995-4c4b-b3f6-9af2ff5aabd9 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:15.248190 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 822/1650] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:15 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:18.766914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b40415-6794-43cc-b58e-0c032c831621 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:18.837042 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:18.983553 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b40415-6794-43cc-b58e-0c032c831621 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:18.994300 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e239b-8fdf-47ec-a6a6-5eacfd2c6192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:18.997236 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e239b-8fdf-47ec-a6a6-5eacfd2c6192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:18.998008 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e239b-8fdf-47ec-a6a6-5eacfd2c6192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:18.998579 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e239b-8fdf-47ec-a6a6-5eacfd2c6192 admin admin] PATH_INFO: `/v3/users/86a0638f9e2c4bb584cc80cee58eca5b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:19.000813 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e239b-8fdf-47ec-a6a6-5eacfd2c6192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a0638f9e2c4bb584cc80cee58eca5b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:19.002869 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-d82e239b-8fdf-47ec-a6a6-5eacfd2c6192 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 11:09:19.002869 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Jun 27 11:09:19.002869 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: Jun 27 11:09:19.012515 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e239b-8fdf-47ec-a6a6-5eacfd2c6192 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:19.181343 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d82e239b-8fdf-47ec-a6a6-5eacfd2c6192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a0638f9e2c4bb584cc80cee58eca5b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:19.264690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1f0db-2556-49e1-a692-01df2faed026 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:19.265597 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1f0db-2556-49e1-a692-01df2faed026 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:19.270480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1f0db-2556-49e1-a692-01df2faed026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:19.270738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d82e239b-8fdf-47ec-a6a6-5eacfd2c6192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a0638f9e2c4bb584cc80cee58eca5b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:19.275927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d82e239b-8fdf-47ec-a6a6-5eacfd2c6192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a0638f9e2c4bb584cc80cee58eca5b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:19.276817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d82e239b-8fdf-47ec-a6a6-5eacfd2c6192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a0638f9e2c4bb584cc80cee58eca5b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:19.300850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d82e239b-8fdf-47ec-a6a6-5eacfd2c6192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a0638f9e2c4bb584cc80cee58eca5b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:19.336573 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d6e1f0db-2556-49e1-a692-01df2faed026 None None] MFA Rules not processed for user `28dd1fefe1ab4904b83e9fdbd08d3bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:19.338589 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d6e1f0db-2556-49e1-a692-01df2faed026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:19.364499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 829/1651] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:09:18 2022] DELETE /identity/v3/users/86a0638f9e2c4bb584cc80cee58eca5b => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:19.368693 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841b92d-dd5a-4d0b-aade-14028c9925b7 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:19.368999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841b92d-dd5a-4d0b-aade-14028c9925b7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:19.369286 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841b92d-dd5a-4d0b-aade-14028c9925b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:19.418972 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6841b92d-dd5a-4d0b-aade-14028c9925b7 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:19.420238 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6841b92d-dd5a-4d0b-aade-14028c9925b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:19.543706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 823/1652] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:19.560732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa77c-4646-4cbc-b162-c1b54cd9cbe9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:19.561538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa77c-4646-4cbc-b162-c1b54cd9cbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:19.561827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa77c-4646-4cbc-b162-c1b54cd9cbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:19.631866 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-191fa77c-4646-4cbc-b162-c1b54cd9cbe9 None None] MFA Rules not processed for user `28dd1fefe1ab4904b83e9fdbd08d3bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:19.640161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-191fa77c-4646-4cbc-b162-c1b54cd9cbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:19.688372 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 830/1653] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:19.752605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841b92d-dd5a-4d0b-aade-14028c9925b7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:19.754351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6841b92d-dd5a-4d0b-aade-14028c9925b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:19.816688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 824/1654] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:19.837805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa77c-4646-4cbc-b162-c1b54cd9cbe9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:19.839546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-191fa77c-4646-4cbc-b162-c1b54cd9cbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:19.839654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:19.916471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:19.917393 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841b92d-dd5a-4d0b-aade-14028c9925b7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:19.942852 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d03167-0daf-4364-931d-485d40d4e616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:19.944090 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d03167-0daf-4364-931d-485d40d4e616 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:19.946032 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d03167-0daf-4364-931d-485d40d4e616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:19.946655 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d03167-0daf-4364-931d-485d40d4e616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:19.977643 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d03167-0daf-4364-931d-485d40d4e616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:19.985162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d03167-0daf-4364-931d-485d40d4e616 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:20.002964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 831/1655] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:20.087369 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa77c-4646-4cbc-b162-c1b54cd9cbe9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:20.101895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c8f15-c837-49d3-b6ed-e07049c5dadf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:20.102656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c8f15-c837-49d3-b6ed-e07049c5dadf service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:20.103499 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c8f15-c837-49d3-b6ed-e07049c5dadf service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:20.103499 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c8f15-c837-49d3-b6ed-e07049c5dadf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:20.117245 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c8f15-c837-49d3-b6ed-e07049c5dadf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:20.118967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c8f15-c837-49d3-b6ed-e07049c5dadf service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:20.145947 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 825/1656] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:20.539871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223ddd3-af3f-4811-ae99-8d24fcd68928 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:20.540100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223ddd3-af3f-4811-ae99-8d24fcd68928 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:20.540395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223ddd3-af3f-4811-ae99-8d24fcd68928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:20.942550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e223ddd3-af3f-4811-ae99-8d24fcd68928 None None] MFA Rules not processed for user `38dde6fe09ca4266af31f3e1bc19e18c`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:20.946541 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e223ddd3-af3f-4811-ae99-8d24fcd68928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:21.134011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 832/1657] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 586 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:21.137051 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de046c87-a33c-4428-a5f5-a68eaf157666 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:21.137545 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de046c87-a33c-4428-a5f5-a68eaf157666 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:21.137811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de046c87-a33c-4428-a5f5-a68eaf157666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:21.199579 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-de046c87-a33c-4428-a5f5-a68eaf157666 None None] MFA Rules not processed for user `38dde6fe09ca4266af31f3e1bc19e18c`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:21.207595 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-de046c87-a33c-4428-a5f5-a68eaf157666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:21.244692 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 826/1658] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:21.360304 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223ddd3-af3f-4811-ae99-8d24fcd68928 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:21.362489 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e223ddd3-af3f-4811-ae99-8d24fcd68928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:21.395094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223ddd3-af3f-4811-ae99-8d24fcd68928 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:21.408942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8484d2d-7b4c-4b2c-8fa0-9af98118eef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:21.412232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8484d2d-7b4c-4b2c-8fa0-9af98118eef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:21.413166 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8484d2d-7b4c-4b2c-8fa0-9af98118eef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:21.437414 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8484d2d-7b4c-4b2c-8fa0-9af98118eef2 admin admin] PATH_INFO: `/v3/users/c4a4dd8d8f624a1e94226a4025f5dd3f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:21.448309 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8484d2d-7b4c-4b2c-8fa0-9af98118eef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a4dd8d8f624a1e94226a4025f5dd3f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:21.454706 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8484d2d-7b4c-4b2c-8fa0-9af98118eef2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:21.570088 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2063bb2-3833-48a0-840d-4fc9fdb05a24 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:21.570476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2063bb2-3833-48a0-840d-4fc9fdb05a24 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:21.570836 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2063bb2-3833-48a0-840d-4fc9fdb05a24 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:21.572418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 827/1659] 10.222.0.18 () {54 vars in 912 bytes} [Mon Jun 27 11:09:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 11:09:21.579529 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c675d-ea85-4da1-b3b5-57a10f8da5ed None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:21.580699 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c675d-ea85-4da1-b3b5-57a10f8da5ed None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:21.581096 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c675d-ea85-4da1-b3b5-57a10f8da5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:21.612181 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e8484d2d-7b4c-4b2c-8fa0-9af98118eef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a4dd8d8f624a1e94226a4025f5dd3f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:21.643335 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e8484d2d-7b4c-4b2c-8fa0-9af98118eef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a4dd8d8f624a1e94226a4025f5dd3f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:21.644175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e8484d2d-7b4c-4b2c-8fa0-9af98118eef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a4dd8d8f624a1e94226a4025f5dd3f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:21.644879 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e8484d2d-7b4c-4b2c-8fa0-9af98118eef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a4dd8d8f624a1e94226a4025f5dd3f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:21.660552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e8484d2d-7b4c-4b2c-8fa0-9af98118eef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a4dd8d8f624a1e94226a4025f5dd3f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:21.681328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a24c675d-ea85-4da1-b3b5-57a10f8da5ed None None] MFA Rules not processed for user `cb2d4050a05f4517ab165c74f9e6cae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:21.691653 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 833/1660] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:09:21 2022] DELETE /identity/v3/users/c4a4dd8d8f624a1e94226a4025f5dd3f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:21.692456 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8484d2d-7b4c-4b2c-8fa0-9af98118eef2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:21.694681 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e8484d2d-7b4c-4b2c-8fa0-9af98118eef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:21.705930 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a24c675d-ea85-4da1-b3b5-57a10f8da5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:21.804397 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:21.832477 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 828/1661] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jun 27 11:09:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:21.834519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6097d22-0af7-4eb8-b10c-bee3dec2da77 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:21.835188 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6097d22-0af7-4eb8-b10c-bee3dec2da77 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:21.835353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6097d22-0af7-4eb8-b10c-bee3dec2da77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:21.875286 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8484d2d-7b4c-4b2c-8fa0-9af98118eef2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:21.882996 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0c85f-b75b-4915-b428-d5d8b0c57e5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:21.883314 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0c85f-b75b-4915-b428-d5d8b0c57e5b service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:21.883552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f6097d22-0af7-4eb8-b10c-bee3dec2da77 None None] MFA Rules not processed for user `fcbcaa64592b45d2a4db33a592ca3d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:21.883677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0c85f-b75b-4915-b428-d5d8b0c57e5b service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:21.884670 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0c85f-b75b-4915-b428-d5d8b0c57e5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:21.884916 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f6097d22-0af7-4eb8-b10c-bee3dec2da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:21.886709 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-30d0c85f-b75b-4915-b428-d5d8b0c57e5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:21.975867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0c85f-b75b-4915-b428-d5d8b0c57e5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:21.977965 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0c85f-b75b-4915-b428-d5d8b0c57e5b service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:21.992026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 834/1662] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:21.993988 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826687b-f5bc-4a76-b034-fc88675d120f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:21.994379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826687b-f5bc-4a76-b034-fc88675d120f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:21.994826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826687b-f5bc-4a76-b034-fc88675d120f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:22.019851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f826687b-f5bc-4a76-b034-fc88675d120f None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:22.021445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f826687b-f5bc-4a76-b034-fc88675d120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:22.040191 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 829/1663] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:22.041826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6097d22-0af7-4eb8-b10c-bee3dec2da77 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:22.049011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f6097d22-0af7-4eb8-b10c-bee3dec2da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:22.105576 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6097d22-0af7-4eb8-b10c-bee3dec2da77 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:22.113986 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543913d-f667-4451-963a-eefdd1ad3cde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:22.115324 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543913d-f667-4451-963a-eefdd1ad3cde service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:22.117919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543913d-f667-4451-963a-eefdd1ad3cde service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:22.118438 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543913d-f667-4451-963a-eefdd1ad3cde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:22.131335 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543913d-f667-4451-963a-eefdd1ad3cde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:22.133056 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543913d-f667-4451-963a-eefdd1ad3cde service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:22.147284 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 830/1664] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:22.150052 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6fcb3-c800-4128-a291-f0157d1135d9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:22.150597 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6fcb3-c800-4128-a291-f0157d1135d9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:22.151084 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6fcb3-c800-4128-a291-f0157d1135d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:22.176820 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 835/1665] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:22.177791 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826687b-f5bc-4a76-b034-fc88675d120f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:22.180305 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f826687b-f5bc-4a76-b034-fc88675d120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:22.201645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826687b-f5bc-4a76-b034-fc88675d120f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:22.205381 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:22.214414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e0b6fcb3-c800-4128-a291-f0157d1135d9 None None] MFA Rules not processed for user `1a6f74ad17db45bf8d2e4f0631d1a55e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:22.215260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7652d03-86b1-4b0f-b78d-867660dab5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:22.217258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7652d03-86b1-4b0f-b78d-867660dab5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:22.217995 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e0b6fcb3-c800-4128-a291-f0157d1135d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:22.218430 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7652d03-86b1-4b0f-b78d-867660dab5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:22.218856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7652d03-86b1-4b0f-b78d-867660dab5d4 admin admin] PATH_INFO: `/v3/projects/c46df6de8e1e48f79ff227edbdc44ba0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:22.234333 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7652d03-86b1-4b0f-b78d-867660dab5d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c46df6de8e1e48f79ff227edbdc44ba0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:22.237023 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7652d03-86b1-4b0f-b78d-867660dab5d4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:22.364582 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c7652d03-86b1-4b0f-b78d-867660dab5d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c46df6de8e1e48f79ff227edbdc44ba0', 'request_id': 'req-c7652d03-86b1-4b0f-b78d-867660dab5d4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:22.380194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c7652d03-86b1-4b0f-b78d-867660dab5d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c46df6de8e1e48f79ff227edbdc44ba0', 'request_id': 'req-c7652d03-86b1-4b0f-b78d-867660dab5d4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:22.395168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 831/1666] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:22.396227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6fcb3-c800-4128-a291-f0157d1135d9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:22.397757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e0b6fcb3-c800-4128-a291-f0157d1135d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:22.397970 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c7652d03-86b1-4b0f-b78d-867660dab5d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c46df6de8e1e48f79ff227edbdc44ba0', 'request_id': 'req-c7652d03-86b1-4b0f-b78d-867660dab5d4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:22.405305 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:22.423403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c7652d03-86b1-4b0f-b78d-867660dab5d4 admin admin] The token cache is being invalidate because project c46df6de8e1e48f79ff227edbdc44ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:09:22.423702 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c7652d03-86b1-4b0f-b78d-867660dab5d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:22.427431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c7652d03-86b1-4b0f-b78d-867660dab5d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:22.429310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 836/1667] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:09:22 2022] DELETE /identity/v3/projects/c46df6de8e1e48f79ff227edbdc44ba0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:22.433038 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7652d03-86b1-4b0f-b78d-867660dab5d4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:22.435392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c7652d03-86b1-4b0f-b78d-867660dab5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:22.445893 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6fcb3-c800-4128-a291-f0157d1135d9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:22.580517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba432650-e13f-418c-a0dd-1098e518ec46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:22.581187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba432650-e13f-418c-a0dd-1098e518ec46 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:22.581540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba432650-e13f-418c-a0dd-1098e518ec46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:22.581809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba432650-e13f-418c-a0dd-1098e518ec46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:22.589057 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ba432650-e13f-418c-a0dd-1098e518ec46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:22.603048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7652d03-86b1-4b0f-b78d-867660dab5d4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:22.614717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba432650-e13f-418c-a0dd-1098e518ec46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:22.616381 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba432650-e13f-418c-a0dd-1098e518ec46 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:22.631988 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50031f-6ce5-42c0-bcbf-ea0a32661108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:22.633141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50031f-6ce5-42c0-bcbf-ea0a32661108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:22.633612 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50031f-6ce5-42c0-bcbf-ea0a32661108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:22.634053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50031f-6ce5-42c0-bcbf-ea0a32661108 admin admin] PATH_INFO: `/v3/users/0166fbf931ba487fa170f3e0af36d76c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:22.635464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 832/1668] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:22.635927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50031f-6ce5-42c0-bcbf-ea0a32661108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0166fbf931ba487fa170f3e0af36d76c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:22.638051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50031f-6ce5-42c0-bcbf-ea0a32661108 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:22.650588 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c4d0b-0149-4de9-b051-bc1862bfd642 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:22.650979 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c4d0b-0149-4de9-b051-bc1862bfd642 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:22.651536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c4d0b-0149-4de9-b051-bc1862bfd642 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:22.654849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 833/1669] 10.222.0.18 () {54 vars in 912 bytes} [Mon Jun 27 11:09:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:09:22.659223 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae43bc-5f48-4fd0-b548-9ea9eb044944 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:22.659591 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae43bc-5f48-4fd0-b548-9ea9eb044944 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:22.660100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae43bc-5f48-4fd0-b548-9ea9eb044944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:22.685644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-eeae43bc-5f48-4fd0-b548-9ea9eb044944 None None] MFA Rules not processed for user `cb2d4050a05f4517ab165c74f9e6cae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:22.687137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-eeae43bc-5f48-4fd0-b548-9ea9eb044944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:22.697251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 834/1670] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jun 27 11:09:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:09:22.718407 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2e50031f-6ce5-42c0-bcbf-ea0a32661108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0166fbf931ba487fa170f3e0af36d76c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:22.722415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae43bc-5f48-4fd0-b548-9ea9eb044944 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:22.724403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-eeae43bc-5f48-4fd0-b548-9ea9eb044944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:22.739362 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae43bc-5f48-4fd0-b548-9ea9eb044944 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:22.743613 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb711a5a-5c50-483a-8b4e-993c1b75793c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:22.744659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb711a5a-5c50-483a-8b4e-993c1b75793c service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:22.745231 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb711a5a-5c50-483a-8b4e-993c1b75793c service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:22.745816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb711a5a-5c50-483a-8b4e-993c1b75793c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:22.745936 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2e50031f-6ce5-42c0-bcbf-ea0a32661108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0166fbf931ba487fa170f3e0af36d76c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:22.750655 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2e50031f-6ce5-42c0-bcbf-ea0a32661108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0166fbf931ba487fa170f3e0af36d76c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:22.751354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2e50031f-6ce5-42c0-bcbf-ea0a32661108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0166fbf931ba487fa170f3e0af36d76c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:22.755344 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb711a5a-5c50-483a-8b4e-993c1b75793c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:22.757351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb711a5a-5c50-483a-8b4e-993c1b75793c service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:22.769156 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2e50031f-6ce5-42c0-bcbf-ea0a32661108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0166fbf931ba487fa170f3e0af36d76c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:22.773767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 835/1671] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:22.788015 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 837/1672] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:09:22 2022] DELETE /identity/v3/users/0166fbf931ba487fa170f3e0af36d76c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:23.100453 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b8cc-5a6a-464b-8c87-8fcbf295f42c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:23.100988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b8cc-5a6a-464b-8c87-8fcbf295f42c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:23.101387 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b8cc-5a6a-464b-8c87-8fcbf295f42c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:23.103878 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 836/1673] 10.222.0.18 () {54 vars in 960 bytes} [Mon Jun 27 11:09:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:09:23.110243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a5098-4901-485d-bb78-697f6c1840b1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:23.111015 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a5098-4901-485d-bb78-697f6c1840b1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:23.111946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a5098-4901-485d-bb78-697f6c1840b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:23.154589 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7a0a5098-4901-485d-bb78-697f6c1840b1 None None] MFA Rules not processed for user `d8673c91abf14c0b9a237f0499fdf20e`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:23.156481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7a0a5098-4901-485d-bb78-697f6c1840b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:23.225550 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837b8cc-5a6a-464b-8c87-8fcbf295f42c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:23.227898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b837b8cc-5a6a-464b-8c87-8fcbf295f42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:23.311470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 838/1674] 10.222.0.18 () {58 vars in 1057 bytes} [Mon Jun 27 11:09:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:23.312190 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a5098-4901-485d-bb78-697f6c1840b1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:23.317679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7a0a5098-4901-485d-bb78-697f6c1840b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:23.348852 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:23.431674 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837b8cc-5a6a-464b-8c87-8fcbf295f42c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:23.449997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4cd70-aa3d-4f47-986a-15fdce30d8b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:23.450829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4cd70-aa3d-4f47-986a-15fdce30d8b9 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:23.451110 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4cd70-aa3d-4f47-986a-15fdce30d8b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:23.451955 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4cd70-aa3d-4f47-986a-15fdce30d8b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:23.456235 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6bd4cd70-aa3d-4f47-986a-15fdce30d8b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:23.483056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a5098-4901-485d-bb78-697f6c1840b1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:23.497920 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b1e2b-1814-4c1d-af0b-50171188ea95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:23.498862 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b1e2b-1814-4c1d-af0b-50171188ea95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:23.499192 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b1e2b-1814-4c1d-af0b-50171188ea95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:23.499464 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b1e2b-1814-4c1d-af0b-50171188ea95 admin admin] PATH_INFO: `/v3/projects/7a56434fad784774bcd68f444114d409` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:23.501448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b1e2b-1814-4c1d-af0b-50171188ea95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a56434fad784774bcd68f444114d409)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:23.503839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b1e2b-1814-4c1d-af0b-50171188ea95 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:23.524929 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:23.628007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4cd70-aa3d-4f47-986a-15fdce30d8b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:23.629834 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4cd70-aa3d-4f47-986a-15fdce30d8b9 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:23.634092 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d10b1e2b-1814-4c1d-af0b-50171188ea95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a56434fad784774bcd68f444114d409', 'request_id': 'req-d10b1e2b-1814-4c1d-af0b-50171188ea95'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:23.642317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d10b1e2b-1814-4c1d-af0b-50171188ea95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a56434fad784774bcd68f444114d409', 'request_id': 'req-d10b1e2b-1814-4c1d-af0b-50171188ea95'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:23.664337 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d10b1e2b-1814-4c1d-af0b-50171188ea95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a56434fad784774bcd68f444114d409', 'request_id': 'req-d10b1e2b-1814-4c1d-af0b-50171188ea95'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:23.665058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 837/1675] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:09:23.665998 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4cd70-aa3d-4f47-986a-15fdce30d8b9 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:23.682538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4cd70-aa3d-4f47-986a-15fdce30d8b9 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:23.687728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d10b1e2b-1814-4c1d-af0b-50171188ea95 admin admin] The token cache is being invalidate because project 7a56434fad784774bcd68f444114d409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:09:23.688061 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d10b1e2b-1814-4c1d-af0b-50171188ea95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:23.692640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d10b1e2b-1814-4c1d-af0b-50171188ea95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:23.694770 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 839/1676] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:09:23 2022] DELETE /identity/v3/projects/7a56434fad784774bcd68f444114d409 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:23.695691 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b1e2b-1814-4c1d-af0b-50171188ea95 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:23.697049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d10b1e2b-1814-4c1d-af0b-50171188ea95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:23.820435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318b389-db2e-4433-a19f-12f264434b2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8673c91abf14c0b9a237f0499fdf20e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:23.821102 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318b389-db2e-4433-a19f-12f264434b2e service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:23.821416 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318b389-db2e-4433-a19f-12f264434b2e service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:23.821706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318b389-db2e-4433-a19f-12f264434b2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:23.823712 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b318b389-db2e-4433-a19f-12f264434b2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:23.837881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318b389-db2e-4433-a19f-12f264434b2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:23.842420 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318b389-db2e-4433-a19f-12f264434b2e service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:23.868992 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b1e2b-1814-4c1d-af0b-50171188ea95 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:23.872663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 838/1677] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:23.874041 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dd7bd-5a8f-4a99-afd7-71399036db9b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:23.874155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27396d8-3162-4d83-bec5-393f310dc79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:23.874340 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dd7bd-5a8f-4a99-afd7-71399036db9b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:23.874596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dd7bd-5a8f-4a99-afd7-71399036db9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:23.874954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27396d8-3162-4d83-bec5-393f310dc79d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:23.875243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27396d8-3162-4d83-bec5-393f310dc79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:23.875517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27396d8-3162-4d83-bec5-393f310dc79d admin admin] PATH_INFO: `/v3/projects/a705e677ae29454b8a0a3f5df57d90e7` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:23.876726 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27396d8-3162-4d83-bec5-393f310dc79d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a705e677ae29454b8a0a3f5df57d90e7)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:23.879281 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27396d8-3162-4d83-bec5-393f310dc79d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:23.922242 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-731dd7bd-5a8f-4a99-afd7-71399036db9b None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:23.923486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-731dd7bd-5a8f-4a99-afd7-71399036db9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:23.968854 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:23.980888 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 839/1678] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:23.989118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dd7bd-5a8f-4a99-afd7-71399036db9b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:23.990173 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-731dd7bd-5a8f-4a99-afd7-71399036db9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:23.992291 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b27396d8-3162-4d83-bec5-393f310dc79d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a705e677ae29454b8a0a3f5df57d90e7', 'request_id': 'req-b27396d8-3162-4d83-bec5-393f310dc79d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:24.005526 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b27396d8-3162-4d83-bec5-393f310dc79d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a705e677ae29454b8a0a3f5df57d90e7', 'request_id': 'req-b27396d8-3162-4d83-bec5-393f310dc79d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:24.023274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b27396d8-3162-4d83-bec5-393f310dc79d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a705e677ae29454b8a0a3f5df57d90e7', 'request_id': 'req-b27396d8-3162-4d83-bec5-393f310dc79d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:24.064835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b27396d8-3162-4d83-bec5-393f310dc79d admin admin] The token cache is being invalidate because project a705e677ae29454b8a0a3f5df57d90e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:09:24.065171 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b27396d8-3162-4d83-bec5-393f310dc79d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:24.065935 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b27396d8-3162-4d83-bec5-393f310dc79d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:24.067670 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 840/1679] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:09:23 2022] DELETE /identity/v3/projects/a705e677ae29454b8a0a3f5df57d90e7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:24.069329 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8469-42eb-4b6a-8515-1e145b018e6c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:24.069648 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8469-42eb-4b6a-8515-1e145b018e6c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:24.069925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8469-42eb-4b6a-8515-1e145b018e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:24.143194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d32d8469-42eb-4b6a-8515-1e145b018e6c None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:24.144617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d32d8469-42eb-4b6a-8515-1e145b018e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:24.318859 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dd7bd-5a8f-4a99-afd7-71399036db9b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:24.343812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 841/1680] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:24.347009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21691d29-94d0-49a2-bde1-091642faa166 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:24.347515 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21691d29-94d0-49a2-bde1-091642faa166 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:24.347987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21691d29-94d0-49a2-bde1-091642faa166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:24.382132 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-21691d29-94d0-49a2-bde1-091642faa166 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:24.384417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-21691d29-94d0-49a2-bde1-091642faa166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:24.417332 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 842/1681] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:24.424534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21691d29-94d0-49a2-bde1-091642faa166 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:24.448805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:24.478162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21691d29-94d0-49a2-bde1-091642faa166 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:24.506100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde97b0-4727-4ac4-bf14-8642426941f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:24.506773 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde97b0-4727-4ac4-bf14-8642426941f8 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:24.506877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f3c66-94f4-4b54-8c39-ed0ee487bbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:24.507088 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde97b0-4727-4ac4-bf14-8642426941f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:24.507333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde97b0-4727-4ac4-bf14-8642426941f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:24.511274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f3c66-94f4-4b54-8c39-ed0ee487bbda admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:24.511411 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7fde97b0-4727-4ac4-bf14-8642426941f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:24.511487 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f3c66-94f4-4b54-8c39-ed0ee487bbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:24.511660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f3c66-94f4-4b54-8c39-ed0ee487bbda admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:24.512428 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f3c66-94f4-4b54-8c39-ed0ee487bbda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:09:24.527366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f3c66-94f4-4b54-8c39-ed0ee487bbda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:24.538040 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f3c66-94f4-4b54-8c39-ed0ee487bbda admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:24.596613 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 843/1682] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:09:24.604154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256fff3-310c-4709-ae96-ebef1284a2fc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:24.604447 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256fff3-310c-4709-ae96-ebef1284a2fc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:24.604737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256fff3-310c-4709-ae96-ebef1284a2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:24.699227 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3256fff3-310c-4709-ae96-ebef1284a2fc None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:24.700482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3256fff3-310c-4709-ae96-ebef1284a2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:24.701789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde97b0-4727-4ac4-bf14-8642426941f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:24.703583 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde97b0-4727-4ac4-bf14-8642426941f8 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:24.727353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 840/1683] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 746 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:24.728409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde97b0-4727-4ac4-bf14-8642426941f8 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:24.739256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 844/1684] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:24.740204 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256fff3-310c-4709-ae96-ebef1284a2fc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:24.741825 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde97b0-4727-4ac4-bf14-8642426941f8 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:24.746911 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc3698-8684-4118-ad1a-09b3a14fc583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:24.747975 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3698-8684-4118-ad1a-09b3a14fc583 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:24.748457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3698-8684-4118-ad1a-09b3a14fc583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:24.748956 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3698-8684-4118-ad1a-09b3a14fc583 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:24.749895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc3698-8684-4118-ad1a-09b3a14fc583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:24.752044 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc3698-8684-4118-ad1a-09b3a14fc583 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:24.761660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256fff3-310c-4709-ae96-ebef1284a2fc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:24.782495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7a7c2-d770-4b9e-ac2c-aa8c366e4e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:24.783185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7a7c2-d770-4b9e-ac2c-aa8c366e4e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:24.784155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7a7c2-d770-4b9e-ac2c-aa8c366e4e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:24.784326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7a7c2-d770-4b9e-ac2c-aa8c366e4e35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:24.785033 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7a7c2-d770-4b9e-ac2c-aa8c366e4e35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:09:24.785404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7a7c2-d770-4b9e-ac2c-aa8c366e4e35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:24.786956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7a7c2-d770-4b9e-ac2c-aa8c366e4e35 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:24.810336 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 841/1685] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:24 2022] POST /identity/v3/projects => generated 405 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:24.817430 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc3698-8684-4118-ad1a-09b3a14fc583 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:24.884410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 845/1686] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:09:24.885599 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7a7c2-d770-4b9e-ac2c-aa8c366e4e35 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:24.911050 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7a7c2-d770-4b9e-ac2c-aa8c366e4e35 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:25.110817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc3698-8684-4118-ad1a-09b3a14fc583 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:25.119402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c306180-ae7c-4a82-a799-39710102d81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:25.123992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c306180-ae7c-4a82-a799-39710102d81e admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:25.124394 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c306180-ae7c-4a82-a799-39710102d81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:25.124849 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c306180-ae7c-4a82-a799-39710102d81e admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:25.125897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c306180-ae7c-4a82-a799-39710102d81e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:25.132736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c306180-ae7c-4a82-a799-39710102d81e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:25.197853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1b068-e67a-45bd-b67f-cd8fe2cb6afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:25.204893 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1b068-e67a-45bd-b67f-cd8fe2cb6afd admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:25.209077 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1b068-e67a-45bd-b67f-cd8fe2cb6afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:25.211120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1b068-e67a-45bd-b67f-cd8fe2cb6afd admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:25.212178 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1b068-e67a-45bd-b67f-cd8fe2cb6afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:25.222289 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1b068-e67a-45bd-b67f-cd8fe2cb6afd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:25.244280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 842/1687] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:24 2022] POST /identity/v3/users => generated 303 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:25.286024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a42f0f-cd8e-4253-98ee-550599bf50de None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:25.286479 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a42f0f-cd8e-4253-98ee-550599bf50de None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:25.286796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a42f0f-cd8e-4253-98ee-550599bf50de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:25.356092 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 846/1688] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:24 2022] POST /identity/v3/projects => generated 363 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:25.357624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1b068-e67a-45bd-b67f-cd8fe2cb6afd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:25.360663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9bf1b068-e67a-45bd-b67f-cd8fe2cb6afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:25.402589 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a8a42f0f-cd8e-4253-98ee-550599bf50de None None] MFA Rules not processed for user `38dde6fe09ca4266af31f3e1bc19e18c`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:25.432333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a8a42f0f-cd8e-4253-98ee-550599bf50de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:25.456655 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:25.573069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:25.619318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 843/1689] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:25.620407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a42f0f-cd8e-4253-98ee-550599bf50de None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:25.723338 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1b068-e67a-45bd-b67f-cd8fe2cb6afd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:25.748981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d6c43-79d2-4df6-b1a6-4912c4a139ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:25.750396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d6c43-79d2-4df6-b1a6-4912c4a139ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:25.750891 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d6c43-79d2-4df6-b1a6-4912c4a139ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:25.753884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d6c43-79d2-4df6-b1a6-4912c4a139ff admin admin] PATH_INFO: `/v3/users/7869177071064c9998abdae9d350f051` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:25.755758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d6c43-79d2-4df6-b1a6-4912c4a139ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=7869177071064c9998abdae9d350f051)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:25.758535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d6c43-79d2-4df6-b1a6-4912c4a139ff admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:25.831852 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a42f0f-cd8e-4253-98ee-550599bf50de None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:25.843023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdfeb0-460d-444b-a656-0a558fafb5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:25.843715 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdfeb0-460d-444b-a656-0a558fafb5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:25.844027 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdfeb0-460d-444b-a656-0a558fafb5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:25.844362 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdfeb0-460d-444b-a656-0a558fafb5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:25.845216 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdfeb0-460d-444b-a656-0a558fafb5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:25.846930 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdfeb0-460d-444b-a656-0a558fafb5f1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:25.874375 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a24d6c43-79d2-4df6-b1a6-4912c4a139ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7869177071064c9998abdae9d350f051'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:25.880563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 844/1690] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:25.881736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdfeb0-460d-444b-a656-0a558fafb5f1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:25.905277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a24d6c43-79d2-4df6-b1a6-4912c4a139ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7869177071064c9998abdae9d350f051'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:25.906107 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a24d6c43-79d2-4df6-b1a6-4912c4a139ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7869177071064c9998abdae9d350f051'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:25.907825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a24d6c43-79d2-4df6-b1a6-4912c4a139ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7869177071064c9998abdae9d350f051'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:25.912365 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdfeb0-460d-444b-a656-0a558fafb5f1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:25.920167 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820233e-a812-4f70-87c8-178870f59cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:25.923032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820233e-a812-4f70-87c8-178870f59cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:25.923365 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820233e-a812-4f70-87c8-178870f59cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:25.923687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820233e-a812-4f70-87c8-178870f59cfb admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:25.924675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820233e-a812-4f70-87c8-178870f59cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:25.926988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820233e-a812-4f70-87c8-178870f59cfb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:25.930982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a24d6c43-79d2-4df6-b1a6-4912c4a139ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7869177071064c9998abdae9d350f051'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:25.958149 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 845/1691] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:25 2022] POST /identity/v3/users => generated 282 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:25.959407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820233e-a812-4f70-87c8-178870f59cfb admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:25.963060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e820233e-a812-4f70-87c8-178870f59cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:25.979556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820233e-a812-4f70-87c8-178870f59cfb admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:25.982447 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 847/1692] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:09:25 2022] DELETE /identity/v3/users/7869177071064c9998abdae9d350f051 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:25.983858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d6c43-79d2-4df6-b1a6-4912c4a139ff admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:25.988857 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e3a05-279e-4721-ac3f-3e756fb0ec3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:25.989796 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e3a05-279e-4721-ac3f-3e756fb0ec3b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:25.990607 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e3a05-279e-4721-ac3f-3e756fb0ec3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:25.991217 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a24d6c43-79d2-4df6-b1a6-4912c4a139ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:25.991518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e3a05-279e-4721-ac3f-3e756fb0ec3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:25.994691 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e3a05-279e-4721-ac3f-3e756fb0ec3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:25.997305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e3a05-279e-4721-ac3f-3e756fb0ec3b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:26.017464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 846/1693] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:26.019525 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583f130-a676-467d-9b96-b38a4f31f929 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:26.019996 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583f130-a676-467d-9b96-b38a4f31f929 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:26.020840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583f130-a676-467d-9b96-b38a4f31f929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:26.044735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a583f130-a676-467d-9b96-b38a4f31f929 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:26.047025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a583f130-a676-467d-9b96-b38a4f31f929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:26.189886 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d6c43-79d2-4df6-b1a6-4912c4a139ff admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:26.201979 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b627ff1-8dad-4055-a8d7-817dafa53041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:26.203369 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b627ff1-8dad-4055-a8d7-817dafa53041 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:26.203981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b627ff1-8dad-4055-a8d7-817dafa53041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:26.204401 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b627ff1-8dad-4055-a8d7-817dafa53041 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:26.208574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b627ff1-8dad-4055-a8d7-817dafa53041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:26.210270 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b627ff1-8dad-4055-a8d7-817dafa53041 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:26.212281 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 847/1694] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:26.213197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583f130-a676-467d-9b96-b38a4f31f929 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:26.240130 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583f130-a676-467d-9b96-b38a4f31f929 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:26.240320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 848/1695] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:26.240527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b627ff1-8dad-4055-a8d7-817dafa53041 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:26.247752 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1b627ff1-8dad-4055-a8d7-817dafa53041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:26.251747 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86d53a-c76d-4f51-abe6-db56f4a583f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:26.255178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86d53a-c76d-4f51-abe6-db56f4a583f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:26.255602 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86d53a-c76d-4f51-abe6-db56f4a583f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:26.255881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86d53a-c76d-4f51-abe6-db56f4a583f1 admin admin] PATH_INFO: `/v3/projects/c8fbcd1013884f25920b1322d3785e06/users/db31652ef12f494d8c9574c0261b8daf/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:26.309734 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86d53a-c76d-4f51-abe6-db56f4a583f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fbcd1013884f25920b1322d3785e06, user_id=db31652ef12f494d8c9574c0261b8daf, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:26.314010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86d53a-c76d-4f51-abe6-db56f4a583f1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:26.356710 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 848/1696] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:26 2022] PUT /identity/v3/projects/c8fbcd1013884f25920b1322d3785e06/users/db31652ef12f494d8c9574c0261b8daf/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:26.358515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86d53a-c76d-4f51-abe6-db56f4a583f1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:26.363669 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:26.437819 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b627ff1-8dad-4055-a8d7-817dafa53041 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:26.481100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:26.548012 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86d53a-c76d-4f51-abe6-db56f4a583f1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:26.548382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893a01b-b650-4497-9d66-59a2ae7075d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:26.549765 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893a01b-b650-4497-9d66-59a2ae7075d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:26.550121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893a01b-b650-4497-9d66-59a2ae7075d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:26.550516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893a01b-b650-4497-9d66-59a2ae7075d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:26.574956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893a01b-b650-4497-9d66-59a2ae7075d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:26.575904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893a01b-b650-4497-9d66-59a2ae7075d1 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:26.578222 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a05ec8-cf7d-4845-a2e0-d8e98bf2b939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:26.578923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a05ec8-cf7d-4845-a2e0-d8e98bf2b939 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:26.579207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a05ec8-cf7d-4845-a2e0-d8e98bf2b939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:26.579484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a05ec8-cf7d-4845-a2e0-d8e98bf2b939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:26.580307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a05ec8-cf7d-4845-a2e0-d8e98bf2b939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:26.581977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a05ec8-cf7d-4845-a2e0-d8e98bf2b939 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:26.604378 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 849/1697] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:26.607851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef9f55-78a5-4079-8cf8-9faa83fc3cb4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:26.607851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef9f55-78a5-4079-8cf8-9faa83fc3cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:26.607851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef9f55-78a5-4079-8cf8-9faa83fc3cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:26.632841 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 849/1698] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:26.637139 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a05ec8-cf7d-4845-a2e0-d8e98bf2b939 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:26.642636 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5bef9f55-78a5-4079-8cf8-9faa83fc3cb4 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:26.644025 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5bef9f55-78a5-4079-8cf8-9faa83fc3cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:26.656152 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 850/1699] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:26.679071 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a05ec8-cf7d-4845-a2e0-d8e98bf2b939 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:26.710223 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69af43-76bf-4737-8c61-67db387eadca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:26.711219 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69af43-76bf-4737-8c61-67db387eadca admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:26.711502 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69af43-76bf-4737-8c61-67db387eadca admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:26.711774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69af43-76bf-4737-8c61-67db387eadca admin admin] PATH_INFO: `/v3/projects/160d8d69f84446b4a2bc8e980ed7466d/users/a9200287e5ca494ebdf97a7d6a43730c/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:26.733008 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef9f55-78a5-4079-8cf8-9faa83fc3cb4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:26.734997 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5bef9f55-78a5-4079-8cf8-9faa83fc3cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:26.745845 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69af43-76bf-4737-8c61-67db387eadca admin admin] RBAC: Authorizing `identity:create_grant(project_id=160d8d69f84446b4a2bc8e980ed7466d, user_id=a9200287e5ca494ebdf97a7d6a43730c, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:26.748843 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69af43-76bf-4737-8c61-67db387eadca admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:26.777228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 850/1700] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:26 2022] PUT /identity/v3/projects/160d8d69f84446b4a2bc8e980ed7466d/users/a9200287e5ca494ebdf97a7d6a43730c/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:26.787519 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef9f55-78a5-4079-8cf8-9faa83fc3cb4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:26.787800 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e358e04-4cc2-4055-be14-99ee94841a3d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:26.788099 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e358e04-4cc2-4055-be14-99ee94841a3d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:26.788377 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e358e04-4cc2-4055-be14-99ee94841a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:26.884121 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0e358e04-4cc2-4055-be14-99ee94841a3d None None] MFA Rules not processed for user `a9200287e5ca494ebdf97a7d6a43730c`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:26.885345 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0e358e04-4cc2-4055-be14-99ee94841a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:27.011140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36335b8-2db0-46cd-abe9-de4311a52263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:27.011829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36335b8-2db0-46cd-abe9-de4311a52263 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:27.012165 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36335b8-2db0-46cd-abe9-de4311a52263 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:27.012485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36335b8-2db0-46cd-abe9-de4311a52263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:27.037930 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 851/1701] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:27.041318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e358e04-4cc2-4055-be14-99ee94841a3d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:27.182964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36335b8-2db0-46cd-abe9-de4311a52263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:27.185191 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36335b8-2db0-46cd-abe9-de4311a52263 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:27.194596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e358e04-4cc2-4055-be14-99ee94841a3d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:27.199673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 851/1702] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:27.207393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f907a9-f57d-4626-a062-173899d0c940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:27.217882 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f907a9-f57d-4626-a062-173899d0c940 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:27.218181 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f907a9-f57d-4626-a062-173899d0c940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:27.218463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f907a9-f57d-4626-a062-173899d0c940 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:27.219231 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f907a9-f57d-4626-a062-173899d0c940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:27.221829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f907a9-f57d-4626-a062-173899d0c940 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:27.269501 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 852/1703] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:27 2022] POST /identity/v3/projects => generated 363 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:27.273729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36335b8-2db0-46cd-abe9-de4311a52263 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:27.291499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36335b8-2db0-46cd-abe9-de4311a52263 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:27.424336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:27.509676 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf8168-ad10-4a1f-9dce-6d1419dd4c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:27.510289 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf8168-ad10-4a1f-9dce-6d1419dd4c28 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:27.510570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf8168-ad10-4a1f-9dce-6d1419dd4c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:27.510844 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf8168-ad10-4a1f-9dce-6d1419dd4c28 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:27.511549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf8168-ad10-4a1f-9dce-6d1419dd4c28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:27.515611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf8168-ad10-4a1f-9dce-6d1419dd4c28 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:27.570265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 852/1704] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:27 2022] POST /identity/v3/users => generated 288 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:09:27.573737 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f907a9-f57d-4626-a062-173899d0c940 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:27.595409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f907a9-f57d-4626-a062-173899d0c940 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:27.609279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3239445-91bd-412c-a02f-3fb1a7aaaa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:27.612455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239445-91bd-412c-a02f-3fb1a7aaaa90 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:27.613072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239445-91bd-412c-a02f-3fb1a7aaaa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:27.614247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239445-91bd-412c-a02f-3fb1a7aaaa90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:27.615793 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3239445-91bd-412c-a02f-3fb1a7aaaa90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:27.621614 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3239445-91bd-412c-a02f-3fb1a7aaaa90 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:27.645483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 853/1705] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:27.649151 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf8168-ad10-4a1f-9dce-6d1419dd4c28 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:27.662368 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf8168-ad10-4a1f-9dce-6d1419dd4c28 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:27.668037 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9a654-232d-4524-aee5-b98610e60784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:27.669060 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9a654-232d-4524-aee5-b98610e60784 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:27.669336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9a654-232d-4524-aee5-b98610e60784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:27.669642 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9a654-232d-4524-aee5-b98610e60784 admin admin] PATH_INFO: `/v3/projects/fc1f4056971644b79634563634b174c0/users/02b5abcc52ca484c832cba5c54e576fc/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:27.690406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9a654-232d-4524-aee5-b98610e60784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1f4056971644b79634563634b174c0, user_id=02b5abcc52ca484c832cba5c54e576fc, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:27.693924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9a654-232d-4524-aee5-b98610e60784 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:27.714014 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 853/1706] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:27 2022] PUT /identity/v3/projects/fc1f4056971644b79634563634b174c0/users/02b5abcc52ca484c832cba5c54e576fc/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:27.717469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3239445-91bd-412c-a02f-3fb1a7aaaa90 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:27.735575 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3239445-91bd-412c-a02f-3fb1a7aaaa90 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:27.760742 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:27.884557 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343f10d-df0b-406a-b2b9-551d859e9d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:27.885516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343f10d-df0b-406a-b2b9-551d859e9d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:27.885883 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343f10d-df0b-406a-b2b9-551d859e9d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:27.886251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343f10d-df0b-406a-b2b9-551d859e9d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:27.887829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343f10d-df0b-406a-b2b9-551d859e9d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:27.890821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343f10d-df0b-406a-b2b9-551d859e9d2d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:27.907645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 854/1707] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:27.911748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9a654-232d-4524-aee5-b98610e60784 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:27.925633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9a654-232d-4524-aee5-b98610e60784 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:27.947272 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6beeb-1246-419e-8ea1-adea25ae13b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:27.948500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6beeb-1246-419e-8ea1-adea25ae13b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:27.948979 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6beeb-1246-419e-8ea1-adea25ae13b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:27.949791 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6beeb-1246-419e-8ea1-adea25ae13b2 admin admin] PATH_INFO: `/v3/projects/fc1f4056971644b79634563634b174c0/users/02b5abcc52ca484c832cba5c54e576fc/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:27.954124 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6beeb-1246-419e-8ea1-adea25ae13b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1f4056971644b79634563634b174c0, user_id=02b5abcc52ca484c832cba5c54e576fc, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:27.962971 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6beeb-1246-419e-8ea1-adea25ae13b2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:27.989273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 854/1708] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:27 2022] PUT /identity/v3/projects/fc1f4056971644b79634563634b174c0/users/02b5abcc52ca484c832cba5c54e576fc/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:28.000449 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f742ee6-6991-4a2d-9bb2-ba210a9b7810 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:28.000449 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f742ee6-6991-4a2d-9bb2-ba210a9b7810 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:28.000662 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f742ee6-6991-4a2d-9bb2-ba210a9b7810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:28.116498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3f742ee6-6991-4a2d-9bb2-ba210a9b7810 None None] MFA Rules not processed for user `02b5abcc52ca484c832cba5c54e576fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:28.119638 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3f742ee6-6991-4a2d-9bb2-ba210a9b7810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:28.120666 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf22d1e-90ee-44ae-ba9b-3bc93ccf5a1e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:28.120944 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf22d1e-90ee-44ae-ba9b-3bc93ccf5a1e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:28.121231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf22d1e-90ee-44ae-ba9b-3bc93ccf5a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:28.170329 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-fdf22d1e-90ee-44ae-ba9b-3bc93ccf5a1e None None] MFA Rules not processed for user `40c6739db5404d59a6799b2ace1c7982`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:28.175632 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fdf22d1e-90ee-44ae-ba9b-3bc93ccf5a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:28.272553 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 855/1709] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jun 27 11:09:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:09:28.296556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 855/1710] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:27 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:28.309246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf22d1e-90ee-44ae-ba9b-3bc93ccf5a1e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:28.311544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fdf22d1e-90ee-44ae-ba9b-3bc93ccf5a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:28.426288 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf22d1e-90ee-44ae-ba9b-3bc93ccf5a1e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:28.433186 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71484bae-6b07-44fa-bb39-968a5146e205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:28.434800 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71484bae-6b07-44fa-bb39-968a5146e205 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:28.435409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71484bae-6b07-44fa-bb39-968a5146e205 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:28.436842 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71484bae-6b07-44fa-bb39-968a5146e205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:28.464412 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71484bae-6b07-44fa-bb39-968a5146e205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:28.469222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71484bae-6b07-44fa-bb39-968a5146e205 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:28.510986 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 856/1711] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:28 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:28.541160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f742ee6-6991-4a2d-9bb2-ba210a9b7810 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:28.543012 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3f742ee6-6991-4a2d-9bb2-ba210a9b7810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:28.706523 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71484bae-6b07-44fa-bb39-968a5146e205 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:28.707970 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-71484bae-6b07-44fa-bb39-968a5146e205 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:28.776451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f742ee6-6991-4a2d-9bb2-ba210a9b7810 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:28.790891 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570a69d-d1fd-476c-84b4-b2e9282308b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189af68908944b5e9a7cb35fde0e1bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:28.792224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570a69d-d1fd-476c-84b4-b2e9282308b4 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:28.792520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570a69d-d1fd-476c-84b4-b2e9282308b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:28.792805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570a69d-d1fd-476c-84b4-b2e9282308b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:28.833617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570a69d-d1fd-476c-84b4-b2e9282308b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:28.834305 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:28.835886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570a69d-d1fd-476c-84b4-b2e9282308b4 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:28.853320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 856/1712] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jun 27 11:09:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 11:09:28.854470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570a69d-d1fd-476c-84b4-b2e9282308b4 service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:28.873530 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570a69d-d1fd-476c-84b4-b2e9282308b4 service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:28.886325 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703e752-cbc9-411e-98a7-868048556a93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:28.888759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703e752-cbc9-411e-98a7-868048556a93 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:28.889322 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703e752-cbc9-411e-98a7-868048556a93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:28.889828 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703e752-cbc9-411e-98a7-868048556a93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:28.919596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71484bae-6b07-44fa-bb39-968a5146e205 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:28.935668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1b7c4-6780-440e-bd24-36e9a018f1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:28.937194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1b7c4-6780-440e-bd24-36e9a018f1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:28.937194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1b7c4-6780-440e-bd24-36e9a018f1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:28.937829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1b7c4-6780-440e-bd24-36e9a018f1f8 admin admin] PATH_INFO: `/v3/projects/3f254c1d62a14737904b16384808e795` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:28.949446 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1b7c4-6780-440e-bd24-36e9a018f1f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f254c1d62a14737904b16384808e795)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:28.951538 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1b7c4-6780-440e-bd24-36e9a018f1f8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:28.958754 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:29.092042 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-87c1b7c4-6780-440e-bd24-36e9a018f1f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f254c1d62a14737904b16384808e795', 'request_id': 'req-87c1b7c4-6780-440e-bd24-36e9a018f1f8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:29.114010 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-87c1b7c4-6780-440e-bd24-36e9a018f1f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f254c1d62a14737904b16384808e795', 'request_id': 'req-87c1b7c4-6780-440e-bd24-36e9a018f1f8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:29.130012 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-87c1b7c4-6780-440e-bd24-36e9a018f1f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f254c1d62a14737904b16384808e795', 'request_id': 'req-87c1b7c4-6780-440e-bd24-36e9a018f1f8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:29.154580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-87c1b7c4-6780-440e-bd24-36e9a018f1f8 admin admin] The token cache is being invalidate because project 3f254c1d62a14737904b16384808e795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:09:29.154759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-87c1b7c4-6780-440e-bd24-36e9a018f1f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:29.155411 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-87c1b7c4-6780-440e-bd24-36e9a018f1f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:29.157791 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 857/1713] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:09:28 2022] DELETE /identity/v3/projects/3f254c1d62a14737904b16384808e795 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:29.163543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb62484-b59f-4867-827b-35996f2c2ee5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:29.163831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb62484-b59f-4867-827b-35996f2c2ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:29.164112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb62484-b59f-4867-827b-35996f2c2ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:29.164237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703e752-cbc9-411e-98a7-868048556a93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:29.165702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703e752-cbc9-411e-98a7-868048556a93 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:29.225505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-acb62484-b59f-4867-827b-35996f2c2ee5 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:29.225505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-acb62484-b59f-4867-827b-35996f2c2ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:29.228583 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 857/1714] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:28 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:29.358005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 858/1715] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:09:29.368455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7709d-983e-41dc-82cd-19d9e5c5b900 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:29.369438 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7709d-983e-41dc-82cd-19d9e5c5b900 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:29.369914 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7709d-983e-41dc-82cd-19d9e5c5b900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:29.396451 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb62484-b59f-4867-827b-35996f2c2ee5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:29.398117 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-acb62484-b59f-4867-827b-35996f2c2ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:29.421924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb62484-b59f-4867-827b-35996f2c2ee5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:29.436634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b730e1e-faff-419f-b12b-2b25af5b80f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:29.437567 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730e1e-faff-419f-b12b-2b25af5b80f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:29.437945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730e1e-faff-419f-b12b-2b25af5b80f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:29.438109 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730e1e-faff-419f-b12b-2b25af5b80f9 admin admin] PATH_INFO: `/v3/users/4d4dcc61d97942388468d6996f70e492` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:29.441954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b730e1e-faff-419f-b12b-2b25af5b80f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d4dcc61d97942388468d6996f70e492)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:29.444472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b730e1e-faff-419f-b12b-2b25af5b80f9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:29.469617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a0e7709d-983e-41dc-82cd-19d9e5c5b900 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:29.489773 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a0e7709d-983e-41dc-82cd-19d9e5c5b900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:29.567984 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 858/1716] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:29.569079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7709d-983e-41dc-82cd-19d9e5c5b900 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:29.572047 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4b730e1e-faff-419f-b12b-2b25af5b80f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d4dcc61d97942388468d6996f70e492'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:29.608622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7709d-983e-41dc-82cd-19d9e5c5b900 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:29.616973 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:29.625383 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4b730e1e-faff-419f-b12b-2b25af5b80f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d4dcc61d97942388468d6996f70e492'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:29.628249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4b730e1e-faff-419f-b12b-2b25af5b80f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d4dcc61d97942388468d6996f70e492'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:29.628249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4b730e1e-faff-419f-b12b-2b25af5b80f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d4dcc61d97942388468d6996f70e492'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:29.629890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b6b27-66fc-48d2-a027-b3d7aace302a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:29.630749 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b6b27-66fc-48d2-a027-b3d7aace302a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:29.631180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b6b27-66fc-48d2-a027-b3d7aace302a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:29.631651 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b6b27-66fc-48d2-a027-b3d7aace302a admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:29.632606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b6b27-66fc-48d2-a027-b3d7aace302a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:09:29.634881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b6b27-66fc-48d2-a027-b3d7aace302a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:29.640445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b6b27-66fc-48d2-a027-b3d7aace302a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:29.647936 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4b730e1e-faff-419f-b12b-2b25af5b80f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d4dcc61d97942388468d6996f70e492'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:29.693403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 859/1717] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:09:29.700992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b6b27-66fc-48d2-a027-b3d7aace302a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:29.703891 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c83b6b27-66fc-48d2-a027-b3d7aace302a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:29.751180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b6b27-66fc-48d2-a027-b3d7aace302a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:29.756239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 859/1718] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:09:29 2022] DELETE /identity/v3/users/4d4dcc61d97942388468d6996f70e492 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:29.776192 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d3538-bb7f-4d7f-8d7c-c0720e3a1981 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:29.776192 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d3538-bb7f-4d7f-8d7c-c0720e3a1981 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:29.776192 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d3538-bb7f-4d7f-8d7c-c0720e3a1981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:29.942422 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f30d3538-bb7f-4d7f-8d7c-c0720e3a1981 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:29.955816 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f30d3538-bb7f-4d7f-8d7c-c0720e3a1981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:29.978302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494db73-2253-4f43-9ae6-2bc2abe638d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:29.983855 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494db73-2253-4f43-9ae6-2bc2abe638d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:29.984352 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494db73-2253-4f43-9ae6-2bc2abe638d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:29.984855 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494db73-2253-4f43-9ae6-2bc2abe638d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:29.985820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494db73-2253-4f43-9ae6-2bc2abe638d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:29.989316 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494db73-2253-4f43-9ae6-2bc2abe638d5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:29.993931 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 860/1719] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:30.051171 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d3538-bb7f-4d7f-8d7c-c0720e3a1981 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:30.052661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f30d3538-bb7f-4d7f-8d7c-c0720e3a1981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:30.091779 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 860/1720] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:29 2022] POST /identity/v3/projects => generated 375 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:30.094127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494db73-2253-4f43-9ae6-2bc2abe638d5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:30.234541 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d3538-bb7f-4d7f-8d7c-c0720e3a1981 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:30.273141 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494db73-2253-4f43-9ae6-2bc2abe638d5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:30.286983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398006f0-c8f0-4696-8664-7fc16fcdfaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:30.287779 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398006f0-c8f0-4696-8664-7fc16fcdfaea admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:30.288158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398006f0-c8f0-4696-8664-7fc16fcdfaea admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:30.288528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398006f0-c8f0-4696-8664-7fc16fcdfaea admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:30.289324 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398006f0-c8f0-4696-8664-7fc16fcdfaea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:30.291384 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398006f0-c8f0-4696-8664-7fc16fcdfaea admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:30.380619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 861/1721] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:30 2022] POST /identity/v3/users => generated 288 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:30.389500 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398006f0-c8f0-4696-8664-7fc16fcdfaea admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:30.429333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398006f0-c8f0-4696-8664-7fc16fcdfaea admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:30.446413 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd188c46-107d-4a20-8527-d8be736fa0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:30.447671 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd188c46-107d-4a20-8527-d8be736fa0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:30.448247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd188c46-107d-4a20-8527-d8be736fa0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:30.448769 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd188c46-107d-4a20-8527-d8be736fa0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:30.450276 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd188c46-107d-4a20-8527-d8be736fa0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:30.452580 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd188c46-107d-4a20-8527-d8be736fa0d3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:30.480380 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 862/1722] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:30.482409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd188c46-107d-4a20-8527-d8be736fa0d3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:30.501432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc1238-b6f1-470c-ac42-c4d1c4719ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:30.502337 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc1238-b6f1-470c-ac42-c4d1c4719ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:30.502626 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc1238-b6f1-470c-ac42-c4d1c4719ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:30.503208 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc1238-b6f1-470c-ac42-c4d1c4719ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:30.517031 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd188c46-107d-4a20-8527-d8be736fa0d3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:30.533789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69243d02-56b7-408d-ba94-00e8629ed787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:30.536049 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69243d02-56b7-408d-ba94-00e8629ed787 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:30.537754 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69243d02-56b7-408d-ba94-00e8629ed787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:30.538215 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69243d02-56b7-408d-ba94-00e8629ed787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:30.539951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69243d02-56b7-408d-ba94-00e8629ed787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:30.544003 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69243d02-56b7-408d-ba94-00e8629ed787 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:30.549325 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:30.550393 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc1238-b6f1-470c-ac42-c4d1c4719ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:30.551776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc1238-b6f1-470c-ac42-c4d1c4719ce2 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:30.586522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 863/1723] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:30.588044 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69243d02-56b7-408d-ba94-00e8629ed787 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:30.596222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 861/1724] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:30.612175 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69243d02-56b7-408d-ba94-00e8629ed787 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:30.635499 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a87997-337a-4d3a-b9a5-9c452f063c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:30.636552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a87997-337a-4d3a-b9a5-9c452f063c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:30.636920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a87997-337a-4d3a-b9a5-9c452f063c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:30.637282 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a87997-337a-4d3a-b9a5-9c452f063c72 admin admin] PATH_INFO: `/v3/projects/956623cc467b4b78bdae893ef4dec5df/users/6338ad7870224e649de91bbe05122a28/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:30.653025 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047de59-363d-4688-a13a-9596b1d22a6a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:30.653450 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047de59-363d-4688-a13a-9596b1d22a6a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:30.653761 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047de59-363d-4688-a13a-9596b1d22a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:30.697258 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a87997-337a-4d3a-b9a5-9c452f063c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=956623cc467b4b78bdae893ef4dec5df, user_id=6338ad7870224e649de91bbe05122a28, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:30.709276 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a87997-337a-4d3a-b9a5-9c452f063c72 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:30.729109 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c047de59-363d-4688-a13a-9596b1d22a6a None None] MFA Rules not processed for user `cb2d4050a05f4517ab165c74f9e6cae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:30.734874 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c047de59-363d-4688-a13a-9596b1d22a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:30.755489 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 864/1725] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:30 2022] PUT /identity/v3/projects/956623cc467b4b78bdae893ef4dec5df/users/6338ad7870224e649de91bbe05122a28/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:30.761812 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb136da1-e322-4a5a-bfad-32e3a0051070 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:30.761812 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb136da1-e322-4a5a-bfad-32e3a0051070 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:30.761812 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb136da1-e322-4a5a-bfad-32e3a0051070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:30.869755 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-eb136da1-e322-4a5a-bfad-32e3a0051070 None None] MFA Rules not processed for user `6338ad7870224e649de91bbe05122a28`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:30.871977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-eb136da1-e322-4a5a-bfad-32e3a0051070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:30.936030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 862/1726] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Jun 27 11:09:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:30.975831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047de59-363d-4688-a13a-9596b1d22a6a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:30.977728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c047de59-363d-4688-a13a-9596b1d22a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:30.993140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047de59-363d-4688-a13a-9596b1d22a6a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:31.006073 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d70d3-8829-40dc-9cc6-2f22994cc4a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:31.006742 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d70d3-8829-40dc-9cc6-2f22994cc4a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:31.007026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d70d3-8829-40dc-9cc6-2f22994cc4a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:31.007299 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d70d3-8829-40dc-9cc6-2f22994cc4a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:31.037430 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d70d3-8829-40dc-9cc6-2f22994cc4a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:31.053756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d70d3-8829-40dc-9cc6-2f22994cc4a2 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:31.078840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 863/1727] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:09:31.220314 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 865/1728] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:31.220938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d70d3-8829-40dc-9cc6-2f22994cc4a2 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:31.349129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:31.464576 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d70d3-8829-40dc-9cc6-2f22994cc4a2 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:31.505595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a008-9b91-4df7-bb5f-8637111f3b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:31.506292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a008-9b91-4df7-bb5f-8637111f3b62 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:31.506691 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a008-9b91-4df7-bb5f-8637111f3b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:31.506691 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a008-9b91-4df7-bb5f-8637111f3b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:31.507495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510a008-9b91-4df7-bb5f-8637111f3b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:31.522196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510a008-9b91-4df7-bb5f-8637111f3b62 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:31.610359 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb136da1-e322-4a5a-bfad-32e3a0051070 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:31.613201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 864/1729] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:31 2022] POST /identity/v3/projects => generated 375 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:31.628273 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb136da1-e322-4a5a-bfad-32e3a0051070 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:31.774608 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c50c2-d1f4-4fb0-8535-423a921e0ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:31.775749 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c50c2-d1f4-4fb0-8535-423a921e0ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:31.777086 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c50c2-d1f4-4fb0-8535-423a921e0ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:31.777631 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c50c2-d1f4-4fb0-8535-423a921e0ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:31.778578 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c50c2-d1f4-4fb0-8535-423a921e0ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:31.795405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c50c2-d1f4-4fb0-8535-423a921e0ca9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:31.833083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 866/1730] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:31 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:09:31.834361 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a008-9b91-4df7-bb5f-8637111f3b62 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:31.850602 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a008-9b91-4df7-bb5f-8637111f3b62 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:31.879043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab97e4-d75a-473e-b39d-eff0d510ceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:31.879744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab97e4-d75a-473e-b39d-eff0d510ceed admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:31.880022 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab97e4-d75a-473e-b39d-eff0d510ceed admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:31.880295 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab97e4-d75a-473e-b39d-eff0d510ceed admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:31.887267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab97e4-d75a-473e-b39d-eff0d510ceed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:31.895353 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab97e4-d75a-473e-b39d-eff0d510ceed admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:31.949638 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 865/1731] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:09:31.950728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c50c2-d1f4-4fb0-8535-423a921e0ca9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:31.987886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c50c2-d1f4-4fb0-8535-423a921e0ca9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:32.022790 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb4ecc-a928-477a-b6c3-11cfae231d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:32.030354 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb4ecc-a928-477a-b6c3-11cfae231d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:32.031275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb4ecc-a928-477a-b6c3-11cfae231d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:32.035645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb4ecc-a928-477a-b6c3-11cfae231d24 admin admin] PATH_INFO: `/v3/projects/f1ba7cf6b03c490e87bc0fe569b4fe27/users/8a4d431e58e14d22bad7ecbd70d5b09c/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:32.136306 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb4ecc-a928-477a-b6c3-11cfae231d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ba7cf6b03c490e87bc0fe569b4fe27, user_id=8a4d431e58e14d22bad7ecbd70d5b09c, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:32.149454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb4ecc-a928-477a-b6c3-11cfae231d24 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:32.221737 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 867/1732] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:31 2022] PUT /identity/v3/projects/f1ba7cf6b03c490e87bc0fe569b4fe27/users/8a4d431e58e14d22bad7ecbd70d5b09c/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:32.225394 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab97e4-d75a-473e-b39d-eff0d510ceed admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:32.249199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab97e4-d75a-473e-b39d-eff0d510ceed admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:32.467064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31946b1c-d363-4484-a0c4-0fdd138743f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:32.468585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946b1c-d363-4484-a0c4-0fdd138743f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:32.469418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946b1c-d363-4484-a0c4-0fdd138743f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:32.469913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946b1c-d363-4484-a0c4-0fdd138743f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:32.471586 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31946b1c-d363-4484-a0c4-0fdd138743f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:32.473499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31946b1c-d363-4484-a0c4-0fdd138743f8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:32.498957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 866/1733] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:32.502180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb4ecc-a928-477a-b6c3-11cfae231d24 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:32.524254 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb4ecc-a928-477a-b6c3-11cfae231d24 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:32.534084 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b537b16-25a9-4569-b86e-222f824d5990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:32.535145 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b537b16-25a9-4569-b86e-222f824d5990 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:32.535537 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b537b16-25a9-4569-b86e-222f824d5990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:32.535919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b537b16-25a9-4569-b86e-222f824d5990 admin admin] PATH_INFO: `/v3/projects/f1ba7cf6b03c490e87bc0fe569b4fe27/users/8a4d431e58e14d22bad7ecbd70d5b09c/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:32.543374 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b537b16-25a9-4569-b86e-222f824d5990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ba7cf6b03c490e87bc0fe569b4fe27, user_id=8a4d431e58e14d22bad7ecbd70d5b09c, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:32.546468 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b537b16-25a9-4569-b86e-222f824d5990 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:32.574464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 868/1734] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:32 2022] PUT /identity/v3/projects/f1ba7cf6b03c490e87bc0fe569b4fe27/users/8a4d431e58e14d22bad7ecbd70d5b09c/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:32.585941 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473462b7-9c85-4374-bfaf-88cb4614d6a8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:32.586492 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473462b7-9c85-4374-bfaf-88cb4614d6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:32.586575 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473462b7-9c85-4374-bfaf-88cb4614d6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:32.666814 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-473462b7-9c85-4374-bfaf-88cb4614d6a8 None None] MFA Rules not processed for user `8a4d431e58e14d22bad7ecbd70d5b09c`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:32.672836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-473462b7-9c85-4374-bfaf-88cb4614d6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:32.882522 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 867/1735] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:09:32.893546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b537b16-25a9-4569-b86e-222f824d5990 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:32.895840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9b537b16-25a9-4569-b86e-222f824d5990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:32.933163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:33.021589 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a2c3a-684e-4bf3-9a89-390c6294a73c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:33.028974 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a2c3a-684e-4bf3-9a89-390c6294a73c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:33.029610 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a2c3a-684e-4bf3-9a89-390c6294a73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:33.067000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ac6a2c3a-684e-4bf3-9a89-390c6294a73c None None] MFA Rules not processed for user `1a6f74ad17db45bf8d2e4f0631d1a55e`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:33.068244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ac6a2c3a-684e-4bf3-9a89-390c6294a73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:33.101245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:33.107068 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b537b16-25a9-4569-b86e-222f824d5990 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:33.114517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a28fed-6606-44e2-b852-0c62f2f23963 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:33.115547 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28fed-6606-44e2-b852-0c62f2f23963 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:33.116177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28fed-6606-44e2-b852-0c62f2f23963 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:33.116675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28fed-6606-44e2-b852-0c62f2f23963 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:33.253243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 868/1736] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:33.286247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a28fed-6606-44e2-b852-0c62f2f23963 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:33.291686 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a28fed-6606-44e2-b852-0c62f2f23963 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:33.354003 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 869/1737] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:34.201038 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a1c17-7006-40c1-82ef-71e05f45caea None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:34.201585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a1c17-7006-40c1-82ef-71e05f45caea None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:34.201852 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a1c17-7006-40c1-82ef-71e05f45caea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:34.287464 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-449a1c17-7006-40c1-82ef-71e05f45caea None None] MFA Rules not processed for user `fcbcaa64592b45d2a4db33a592ca3d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:34.295239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-449a1c17-7006-40c1-82ef-71e05f45caea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:34.651097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 869/1738] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:35.035564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31274245-2324-4b66-8701-2bc8fbf5952e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:35.036650 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31274245-2324-4b66-8701-2bc8fbf5952e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:35.037123 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31274245-2324-4b66-8701-2bc8fbf5952e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:35.039317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 870/1739] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jun 27 11:09:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:09:35.300163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157d56e-cd44-4c6d-9ba2-570420fa5c96 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:35.300766 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157d56e-cd44-4c6d-9ba2-570420fa5c96 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:35.300766 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157d56e-cd44-4c6d-9ba2-570420fa5c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:35.348297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6157d56e-cd44-4c6d-9ba2-570420fa5c96 None None] MFA Rules not processed for user `ed08c367a3d34207a51914ff77a93898`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:35.350288 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31274245-2324-4b66-8701-2bc8fbf5952e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:35.352405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-31274245-2324-4b66-8701-2bc8fbf5952e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:35.353247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6157d56e-cd44-4c6d-9ba2-570420fa5c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:35.553787 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 870/1740] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jun 27 11:09:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:09:35.628556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31274245-2324-4b66-8701-2bc8fbf5952e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:35.650254 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035e2d8-d59e-4afa-af84-bc69539a7d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:35.652950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035e2d8-d59e-4afa-af84-bc69539a7d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:35.653279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035e2d8-d59e-4afa-af84-bc69539a7d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:35.653598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035e2d8-d59e-4afa-af84-bc69539a7d26 admin admin] PATH_INFO: `/v3/projects/64915daac7324d9ba2a1a855a936542b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:35.662324 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035e2d8-d59e-4afa-af84-bc69539a7d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64915daac7324d9ba2a1a855a936542b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:35.663398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-5035e2d8-d59e-4afa-af84-bc69539a7d26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 11:09:35.663398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 27 11:09:35.663398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: Jun 27 11:09:35.667150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035e2d8-d59e-4afa-af84-bc69539a7d26 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:35.832207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5035e2d8-d59e-4afa-af84-bc69539a7d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64915daac7324d9ba2a1a855a936542b', 'request_id': 'req-5035e2d8-d59e-4afa-af84-bc69539a7d26'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:35.851832 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5035e2d8-d59e-4afa-af84-bc69539a7d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64915daac7324d9ba2a1a855a936542b', 'request_id': 'req-5035e2d8-d59e-4afa-af84-bc69539a7d26'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:35.868110 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5035e2d8-d59e-4afa-af84-bc69539a7d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64915daac7324d9ba2a1a855a936542b', 'request_id': 'req-5035e2d8-d59e-4afa-af84-bc69539a7d26'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:35.955204 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:35.967251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5035e2d8-d59e-4afa-af84-bc69539a7d26 admin admin] The token cache is being invalidate because project 64915daac7324d9ba2a1a855a936542b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:09:35.968046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5035e2d8-d59e-4afa-af84-bc69539a7d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:35.969192 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5035e2d8-d59e-4afa-af84-bc69539a7d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:35.973677 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 871/1741] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:09:35 2022] DELETE /identity/v3/projects/64915daac7324d9ba2a1a855a936542b => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:09:35.979672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155108bf-aee6-47b7-8eb9-97752f06b080 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:35.980556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155108bf-aee6-47b7-8eb9-97752f06b080 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:35.980903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155108bf-aee6-47b7-8eb9-97752f06b080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:36.043329 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-155108bf-aee6-47b7-8eb9-97752f06b080 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:36.045659 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-155108bf-aee6-47b7-8eb9-97752f06b080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:36.260813 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 871/1742] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:36.270019 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdba2af-720d-4a08-a4f3-ba0a8b110de4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:36.270843 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdba2af-720d-4a08-a4f3-ba0a8b110de4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:36.272482 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdba2af-720d-4a08-a4f3-ba0a8b110de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:36.331301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-fbdba2af-720d-4a08-a4f3-ba0a8b110de4 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:36.332863 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fbdba2af-720d-4a08-a4f3-ba0a8b110de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:36.348340 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 872/1743] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:36.352355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155108bf-aee6-47b7-8eb9-97752f06b080 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:36.361247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:36.392923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155108bf-aee6-47b7-8eb9-97752f06b080 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:36.416574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1a71b-d553-47e4-b735-df907c97aff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:36.425113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1a71b-d553-47e4-b735-df907c97aff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:36.425547 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1a71b-d553-47e4-b735-df907c97aff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:36.433902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1a71b-d553-47e4-b735-df907c97aff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:36.434713 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1a71b-d553-47e4-b735-df907c97aff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:09:36.435042 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1a71b-d553-47e4-b735-df907c97aff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:36.438564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1a71b-d553-47e4-b735-df907c97aff1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:36.522262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 872/1744] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:09:36.525100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdba2af-720d-4a08-a4f3-ba0a8b110de4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:36.557032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdba2af-720d-4a08-a4f3-ba0a8b110de4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:36.579006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d56d0-1c03-4b12-bcf8-690fa8aeb9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:36.583399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d56d0-1c03-4b12-bcf8-690fa8aeb9ce admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:36.584324 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d56d0-1c03-4b12-bcf8-690fa8aeb9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:36.586092 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d56d0-1c03-4b12-bcf8-690fa8aeb9ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:36.590269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d56d0-1c03-4b12-bcf8-690fa8aeb9ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:36.599284 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d56d0-1c03-4b12-bcf8-690fa8aeb9ce admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:36.695583 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 873/1745] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:36 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:09:36.699665 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1a71b-d553-47e4-b735-df907c97aff1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:36.729039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1a71b-d553-47e4-b735-df907c97aff1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:36.780237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2cb90-9441-4ad0-9804-a56133021cf1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:36.781884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2cb90-9441-4ad0-9804-a56133021cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:36.782388 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2cb90-9441-4ad0-9804-a56133021cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:36.890607 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-74f2cb90-9441-4ad0-9804-a56133021cf1 None None] MFA Rules not processed for user `db31652ef12f494d8c9574c0261b8daf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:36.900985 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-74f2cb90-9441-4ad0-9804-a56133021cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:36.934660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18752c-33bb-4782-82a7-9ec1beea4932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:36.935274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18752c-33bb-4782-82a7-9ec1beea4932 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:36.935559 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18752c-33bb-4782-82a7-9ec1beea4932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:36.940869 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18752c-33bb-4782-82a7-9ec1beea4932 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:36.942963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18752c-33bb-4782-82a7-9ec1beea4932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:36.947047 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18752c-33bb-4782-82a7-9ec1beea4932 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:36.981764 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 873/1746] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:36 2022] POST /identity/v3/users => generated 294 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:36.986072 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18752c-33bb-4782-82a7-9ec1beea4932 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:37.000767 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18752c-33bb-4782-82a7-9ec1beea4932 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:37.008698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e8a75-6f43-43cc-a6fb-db8223e55a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:37.010205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e8a75-6f43-43cc-a6fb-db8223e55a06 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:37.010205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e8a75-6f43-43cc-a6fb-db8223e55a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:37.011414 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e8a75-6f43-43cc-a6fb-db8223e55a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:37.012241 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e8a75-6f43-43cc-a6fb-db8223e55a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:37.016656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e8a75-6f43-43cc-a6fb-db8223e55a06 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:37.044435 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 874/1747] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:37.049438 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 874/1748] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:37.049589 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e8a75-6f43-43cc-a6fb-db8223e55a06 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:37.058940 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2cb90-9441-4ad0-9804-a56133021cf1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:37.063970 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-74f2cb90-9441-4ad0-9804-a56133021cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:37.079989 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e8a75-6f43-43cc-a6fb-db8223e55a06 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:37.090193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acacf5-4bf7-4eeb-bffd-a8f47a201ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:37.091053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acacf5-4bf7-4eeb-bffd-a8f47a201ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:37.091172 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acacf5-4bf7-4eeb-bffd-a8f47a201ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:37.092551 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2cb90-9441-4ad0-9804-a56133021cf1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:37.093338 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acacf5-4bf7-4eeb-bffd-a8f47a201ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:37.094378 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acacf5-4bf7-4eeb-bffd-a8f47a201ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:37.097813 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acacf5-4bf7-4eeb-bffd-a8f47a201ba3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:37.103538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3adb88-46b8-4d7b-a376-eb18630159c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:37.104413 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3adb88-46b8-4d7b-a376-eb18630159c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:37.104702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3adb88-46b8-4d7b-a376-eb18630159c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:37.105095 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3adb88-46b8-4d7b-a376-eb18630159c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:37.105909 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3adb88-46b8-4d7b-a376-eb18630159c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:37.108442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3adb88-46b8-4d7b-a376-eb18630159c0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:37.135570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 875/1749] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:37.136598 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acacf5-4bf7-4eeb-bffd-a8f47a201ba3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:37.160340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acacf5-4bf7-4eeb-bffd-a8f47a201ba3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:37.178341 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 875/1750] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:37 2022] POST /identity/v3/projects => generated 403 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:37.183969 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3adb88-46b8-4d7b-a376-eb18630159c0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:37.209570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a0a41-8070-44e3-822c-e00f76b007d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:37.212196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a0a41-8070-44e3-822c-e00f76b007d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:37.214982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a0a41-8070-44e3-822c-e00f76b007d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:37.215391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a0a41-8070-44e3-822c-e00f76b007d3 admin admin] PATH_INFO: `/v3/projects/9a18858346164106960ecf3aac8b46ef/users/3b2be3ba7a76439c8425007df92f6bae/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:37.250627 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a0a41-8070-44e3-822c-e00f76b007d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a18858346164106960ecf3aac8b46ef, user_id=3b2be3ba7a76439c8425007df92f6bae, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:37.253694 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a0a41-8070-44e3-822c-e00f76b007d3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:37.272057 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 876/1751] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:37 2022] PUT /identity/v3/projects/9a18858346164106960ecf3aac8b46ef/users/3b2be3ba7a76439c8425007df92f6bae/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:37.285545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6a9c3-2624-4ad9-b016-d39e7447b9d1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:37.286079 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6a9c3-2624-4ad9-b016-d39e7447b9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:37.286512 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6a9c3-2624-4ad9-b016-d39e7447b9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:37.344262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3adb88-46b8-4d7b-a376-eb18630159c0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:37.379346 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-acf6a9c3-2624-4ad9-b016-d39e7447b9d1 None None] MFA Rules not processed for user `3b2be3ba7a76439c8425007df92f6bae`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:37.382678 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-acf6a9c3-2624-4ad9-b016-d39e7447b9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:37.467775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:37.510860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3a013-6438-4eea-9a9e-3c5fdbb862f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:37.512833 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3a013-6438-4eea-9a9e-3c5fdbb862f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:37.513127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3a013-6438-4eea-9a9e-3c5fdbb862f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:37.513448 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3a013-6438-4eea-9a9e-3c5fdbb862f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:37.514164 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3a013-6438-4eea-9a9e-3c5fdbb862f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:37.517324 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3a013-6438-4eea-9a9e-3c5fdbb862f0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:37.589408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 876/1752] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:37 2022] POST /identity/v3/users => generated 308 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:37.589671 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 877/1753] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:37.594562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3a013-6438-4eea-9a9e-3c5fdbb862f0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:37.595010 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6a9c3-2624-4ad9-b016-d39e7447b9d1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:37.620644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3a013-6438-4eea-9a9e-3c5fdbb862f0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:37.624658 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6a9c3-2624-4ad9-b016-d39e7447b9d1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:37.634644 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cba414-a8b5-4ef2-80dc-02f8149317a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:37.635114 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e863ef-63d2-498c-8d41-90116ebb52a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:37.635804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e863ef-63d2-498c-8d41-90116ebb52a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:37.636092 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e863ef-63d2-498c-8d41-90116ebb52a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:37.636372 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e863ef-63d2-498c-8d41-90116ebb52a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:37.637125 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e863ef-63d2-498c-8d41-90116ebb52a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:37.637707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cba414-a8b5-4ef2-80dc-02f8149317a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:37.637990 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cba414-a8b5-4ef2-80dc-02f8149317a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:37.638257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cba414-a8b5-4ef2-80dc-02f8149317a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:37.638980 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cba414-a8b5-4ef2-80dc-02f8149317a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:37.640902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cba414-a8b5-4ef2-80dc-02f8149317a8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:37.644363 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e863ef-63d2-498c-8d41-90116ebb52a5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:37.693592 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 877/1754] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:37.694537 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e863ef-63d2-498c-8d41-90116ebb52a5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:37.701118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b4e863ef-63d2-498c-8d41-90116ebb52a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:37.741810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 878/1755] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:37 2022] POST /identity/v3/projects => generated 389 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:37.742871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cba414-a8b5-4ef2-80dc-02f8149317a8 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:37.752410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:37.910385 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e863ef-63d2-498c-8d41-90116ebb52a5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:37.962797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cba414-a8b5-4ef2-80dc-02f8149317a8 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:37.976061 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a7fb8-1e16-4e2b-b0ec-2e6b95e35571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:37.976954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a7fb8-1e16-4e2b-b0ec-2e6b95e35571 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:37.977206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a7fb8-1e16-4e2b-b0ec-2e6b95e35571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:37.977511 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a7fb8-1e16-4e2b-b0ec-2e6b95e35571 admin admin] PATH_INFO: `/v3/projects/f06a096a489641f9bb8b4b034eab63b1/users/0fed5b130ba543d896ac3a3db61f0c34/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:38.011102 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a7fb8-1e16-4e2b-b0ec-2e6b95e35571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06a096a489641f9bb8b4b034eab63b1, user_id=0fed5b130ba543d896ac3a3db61f0c34, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:38.018462 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a7fb8-1e16-4e2b-b0ec-2e6b95e35571 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:38.054491 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 879/1756] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:37 2022] PUT /identity/v3/projects/f06a096a489641f9bb8b4b034eab63b1/users/0fed5b130ba543d896ac3a3db61f0c34/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:38.057232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a7fb8-1e16-4e2b-b0ec-2e6b95e35571 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:38.076720 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbae4ac-7859-45f6-8141-35b1bec1e3a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:38.077800 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbae4ac-7859-45f6-8141-35b1bec1e3a4 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:38.078090 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbae4ac-7859-45f6-8141-35b1bec1e3a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:38.078513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbae4ac-7859-45f6-8141-35b1bec1e3a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:38.081392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fcbae4ac-7859-45f6-8141-35b1bec1e3a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:38.102485 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbae4ac-7859-45f6-8141-35b1bec1e3a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:38.104670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbae4ac-7859-45f6-8141-35b1bec1e3a4 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:38.148526 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 878/1757] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:38.149782 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbae4ac-7859-45f6-8141-35b1bec1e3a4 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:38.163818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbae4ac-7859-45f6-8141-35b1bec1e3a4 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:38.261820 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a7fb8-1e16-4e2b-b0ec-2e6b95e35571 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:38.276943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:38.284263 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00720d5c-29f8-4d67-8502-a5e53cf249b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:38.288326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00720d5c-29f8-4d67-8502-a5e53cf249b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:38.289312 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00720d5c-29f8-4d67-8502-a5e53cf249b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:38.290745 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00720d5c-29f8-4d67-8502-a5e53cf249b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:38.293415 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00720d5c-29f8-4d67-8502-a5e53cf249b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:38.300351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00720d5c-29f8-4d67-8502-a5e53cf249b8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:38.323342 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf07cc-c60f-4130-8367-f3af8b0773dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:38.324231 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf07cc-c60f-4130-8367-f3af8b0773dc admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:38.324656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf07cc-c60f-4130-8367-f3af8b0773dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:38.325089 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf07cc-c60f-4130-8367-f3af8b0773dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:38.326031 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf07cc-c60f-4130-8367-f3af8b0773dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:38.327840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf07cc-c60f-4130-8367-f3af8b0773dc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:38.350163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 879/1758] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:38.351518 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 880/1759] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:38 2022] POST /identity/v3/users => generated 301 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:38.357088 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00720d5c-29f8-4d67-8502-a5e53cf249b8 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:38.358367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf07cc-c60f-4130-8367-f3af8b0773dc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:38.371641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00720d5c-29f8-4d67-8502-a5e53cf249b8 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:38.377772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2221727-9e7e-4d41-90dc-befe33eb7c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:38.378899 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2221727-9e7e-4d41-90dc-befe33eb7c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:38.379316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2221727-9e7e-4d41-90dc-befe33eb7c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:38.379778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2221727-9e7e-4d41-90dc-befe33eb7c7b admin admin] PATH_INFO: `/v3/projects/f06a096a489641f9bb8b4b034eab63b1/users/0fed5b130ba543d896ac3a3db61f0c34/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:38.382440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf07cc-c60f-4130-8367-f3af8b0773dc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:38.382910 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2221727-9e7e-4d41-90dc-befe33eb7c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06a096a489641f9bb8b4b034eab63b1, user_id=0fed5b130ba543d896ac3a3db61f0c34, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:38.387075 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2221727-9e7e-4d41-90dc-befe33eb7c7b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:38.387854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b44b1-f6cd-4e5e-8cb1-7f395ebea36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:38.388518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b44b1-f6cd-4e5e-8cb1-7f395ebea36c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:38.388800 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b44b1-f6cd-4e5e-8cb1-7f395ebea36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:38.389077 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b44b1-f6cd-4e5e-8cb1-7f395ebea36c admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:38.389990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b44b1-f6cd-4e5e-8cb1-7f395ebea36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:38.392402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b44b1-f6cd-4e5e-8cb1-7f395ebea36c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:38.400057 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 881/1760] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:38 2022] PUT /identity/v3/projects/f06a096a489641f9bb8b4b034eab63b1/users/0fed5b130ba543d896ac3a3db61f0c34/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:38.404234 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 880/1761] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:38.408797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2221727-9e7e-4d41-90dc-befe33eb7c7b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:38.488485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2221727-9e7e-4d41-90dc-befe33eb7c7b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:38.493302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084629bd-df7b-430f-b4c4-495ee786f57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:38.494324 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084629bd-df7b-430f-b4c4-495ee786f57a admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:38.494608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084629bd-df7b-430f-b4c4-495ee786f57a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:38.494885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084629bd-df7b-430f-b4c4-495ee786f57a admin admin] PATH_INFO: `/v3/projects/de1d9978bb62467e9cefc6281a05ca19/users/c960b64141ff4e6da8e80eaa63cf5e51/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:38.499307 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:38.513817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084629bd-df7b-430f-b4c4-495ee786f57a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1d9978bb62467e9cefc6281a05ca19, user_id=c960b64141ff4e6da8e80eaa63cf5e51, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:38.517140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084629bd-df7b-430f-b4c4-495ee786f57a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:38.534844 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 882/1762] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:38 2022] PUT /identity/v3/projects/de1d9978bb62467e9cefc6281a05ca19/users/c960b64141ff4e6da8e80eaa63cf5e51/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:09:38.538571 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b44b1-f6cd-4e5e-8cb1-7f395ebea36c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:38.549731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b44b1-f6cd-4e5e-8cb1-7f395ebea36c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:38.661284 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4adc92-2680-4eb2-9791-b3d5d091ae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:38.662339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4adc92-2680-4eb2-9791-b3d5d091ae4f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:38.662913 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4adc92-2680-4eb2-9791-b3d5d091ae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:38.663397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4adc92-2680-4eb2-9791-b3d5d091ae4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:38.664358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4adc92-2680-4eb2-9791-b3d5d091ae4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:38.666110 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4adc92-2680-4eb2-9791-b3d5d091ae4f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:38.678303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 881/1763] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:38.683012 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084629bd-df7b-430f-b4c4-495ee786f57a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:38.694662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084629bd-df7b-430f-b4c4-495ee786f57a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:38.705094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8815e71-ecb6-4f3c-8491-7c414a82e170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:38.705746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8815e71-ecb6-4f3c-8491-7c414a82e170 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:38.706132 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8815e71-ecb6-4f3c-8491-7c414a82e170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:38.706525 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8815e71-ecb6-4f3c-8491-7c414a82e170 admin admin] PATH_INFO: `/v3/projects/de1d9978bb62467e9cefc6281a05ca19/users/c960b64141ff4e6da8e80eaa63cf5e51/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:38.708879 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8815e71-ecb6-4f3c-8491-7c414a82e170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1d9978bb62467e9cefc6281a05ca19, user_id=c960b64141ff4e6da8e80eaa63cf5e51, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:38.712365 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8815e71-ecb6-4f3c-8491-7c414a82e170 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:38.724123 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 883/1764] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:38 2022] PUT /identity/v3/projects/de1d9978bb62467e9cefc6281a05ca19/users/c960b64141ff4e6da8e80eaa63cf5e51/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:38.735399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef263bd-5aae-4a9c-970d-dcf4f9317311 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:38.735690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef263bd-5aae-4a9c-970d-dcf4f9317311 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:38.736844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef263bd-5aae-4a9c-970d-dcf4f9317311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:38.799272 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8ef263bd-5aae-4a9c-970d-dcf4f9317311 None None] MFA Rules not processed for user `c960b64141ff4e6da8e80eaa63cf5e51`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:38.816527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8ef263bd-5aae-4a9c-970d-dcf4f9317311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:39.079779 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 882/1765] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:39.087347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8815e71-ecb6-4f3c-8491-7c414a82e170 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:39.090552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f8815e71-ecb6-4f3c-8491-7c414a82e170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:39.270408 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8815e71-ecb6-4f3c-8491-7c414a82e170 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:39.275501 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb931433-775a-4905-aece-1392f001d7ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:39.277025 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb931433-775a-4905-aece-1392f001d7ff service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:39.277025 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb931433-775a-4905-aece-1392f001d7ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:39.277025 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb931433-775a-4905-aece-1392f001d7ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:39.299386 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb931433-775a-4905-aece-1392f001d7ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:39.311969 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb931433-775a-4905-aece-1392f001d7ff service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:39.351706 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 884/1766] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:39.603434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef263bd-5aae-4a9c-970d-dcf4f9317311 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:39.718809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:39.735581 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef263bd-5aae-4a9c-970d-dcf4f9317311 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:39.741103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012329c-69d5-4e16-b5d4-22a64a00c238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:39.742189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012329c-69d5-4e16-b5d4-22a64a00c238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:39.742535 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012329c-69d5-4e16-b5d4-22a64a00c238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:39.742882 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012329c-69d5-4e16-b5d4-22a64a00c238 admin admin] PATH_INFO: `/v3/users/3b2be3ba7a76439c8425007df92f6bae` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:39.744879 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012329c-69d5-4e16-b5d4-22a64a00c238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b2be3ba7a76439c8425007df92f6bae)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:39.747255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012329c-69d5-4e16-b5d4-22a64a00c238 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:39.855832 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b012329c-69d5-4e16-b5d4-22a64a00c238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b2be3ba7a76439c8425007df92f6bae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:39.896915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b012329c-69d5-4e16-b5d4-22a64a00c238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b2be3ba7a76439c8425007df92f6bae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:39.899071 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b012329c-69d5-4e16-b5d4-22a64a00c238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b2be3ba7a76439c8425007df92f6bae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:39.900582 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b012329c-69d5-4e16-b5d4-22a64a00c238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b2be3ba7a76439c8425007df92f6bae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:39.912243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b012329c-69d5-4e16-b5d4-22a64a00c238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b2be3ba7a76439c8425007df92f6bae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:39.934231 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 883/1767] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:09:39 2022] DELETE /identity/v3/users/3b2be3ba7a76439c8425007df92f6bae => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:39.939884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1328970-ba97-48d3-b0ff-65f3d7d53920 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:39.940424 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1328970-ba97-48d3-b0ff-65f3d7d53920 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:39.940566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1328970-ba97-48d3-b0ff-65f3d7d53920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:39.978779 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61844e4-9ff0-436b-b256-b50ad646ea91 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:39.979080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61844e4-9ff0-436b-b256-b50ad646ea91 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:39.979372 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61844e4-9ff0-436b-b256-b50ad646ea91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:39.999534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c1328970-ba97-48d3-b0ff-65f3d7d53920 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:40.000774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c1328970-ba97-48d3-b0ff-65f3d7d53920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:40.033399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f61844e4-9ff0-436b-b256-b50ad646ea91 None None] MFA Rules not processed for user `0fed5b130ba543d896ac3a3db61f0c34`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:40.038113 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f61844e4-9ff0-436b-b256-b50ad646ea91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:40.138872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 885/1768] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:40.146548 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1328970-ba97-48d3-b0ff-65f3d7d53920 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:40.148047 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c1328970-ba97-48d3-b0ff-65f3d7d53920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:40.179907 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 884/1769] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:09:40.229322 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1328970-ba97-48d3-b0ff-65f3d7d53920 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:40.233228 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f536e-a836-43a0-83e1-960f433db3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:40.233959 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f536e-a836-43a0-83e1-960f433db3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:40.234238 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f536e-a836-43a0-83e1-960f433db3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:40.234509 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f536e-a836-43a0-83e1-960f433db3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:40.248602 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f536e-a836-43a0-83e1-960f433db3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:40.250282 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f536e-a836-43a0-83e1-960f433db3c4 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:40.261419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 886/1770] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:40.754393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61844e4-9ff0-436b-b256-b50ad646ea91 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:40.755843 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f61844e4-9ff0-436b-b256-b50ad646ea91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:40.780511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61844e4-9ff0-436b-b256-b50ad646ea91 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:40.790728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7ae13-56df-4f10-a97f-c37fa6649c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:40.791684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7ae13-56df-4f10-a97f-c37fa6649c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:40.791872 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7ae13-56df-4f10-a97f-c37fa6649c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:40.793331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7ae13-56df-4f10-a97f-c37fa6649c96 admin admin] PATH_INFO: `/v3/projects/9a18858346164106960ecf3aac8b46ef` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:40.793516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7ae13-56df-4f10-a97f-c37fa6649c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a18858346164106960ecf3aac8b46ef)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:40.810538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7ae13-56df-4f10-a97f-c37fa6649c96 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:40.908961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-02c7ae13-56df-4f10-a97f-c37fa6649c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a18858346164106960ecf3aac8b46ef', 'request_id': 'req-02c7ae13-56df-4f10-a97f-c37fa6649c96'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:40.914242 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:40.926658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-02c7ae13-56df-4f10-a97f-c37fa6649c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a18858346164106960ecf3aac8b46ef', 'request_id': 'req-02c7ae13-56df-4f10-a97f-c37fa6649c96'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:40.933608 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-02c7ae13-56df-4f10-a97f-c37fa6649c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a18858346164106960ecf3aac8b46ef', 'request_id': 'req-02c7ae13-56df-4f10-a97f-c37fa6649c96'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:40.947751 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-02c7ae13-56df-4f10-a97f-c37fa6649c96 admin admin] The token cache is being invalidate because project 9a18858346164106960ecf3aac8b46ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:09:40.948118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-02c7ae13-56df-4f10-a97f-c37fa6649c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:40.948698 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-02c7ae13-56df-4f10-a97f-c37fa6649c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:40.950758 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 885/1771] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:09:40 2022] DELETE /identity/v3/projects/9a18858346164106960ecf3aac8b46ef => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:40.955419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f536e-a836-43a0-83e1-960f433db3c4 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:40.966983 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f536e-a836-43a0-83e1-960f433db3c4 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:40.982258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:41.050389 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7e67d-d13f-49e2-8a46-6669a21017f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:41.052363 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7e67d-d13f-49e2-8a46-6669a21017f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:41.052866 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7e67d-d13f-49e2-8a46-6669a21017f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:41.053389 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7e67d-d13f-49e2-8a46-6669a21017f0 admin admin] PATH_INFO: `/v3/users/c960b64141ff4e6da8e80eaa63cf5e51` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:41.063359 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7e67d-d13f-49e2-8a46-6669a21017f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c960b64141ff4e6da8e80eaa63cf5e51)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:41.070036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7e67d-d13f-49e2-8a46-6669a21017f0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:41.132877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f0e7e67d-d13f-49e2-8a46-6669a21017f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c960b64141ff4e6da8e80eaa63cf5e51'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:41.151522 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f0e7e67d-d13f-49e2-8a46-6669a21017f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c960b64141ff4e6da8e80eaa63cf5e51'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:41.152512 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f0e7e67d-d13f-49e2-8a46-6669a21017f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c960b64141ff4e6da8e80eaa63cf5e51'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:41.153131 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f0e7e67d-d13f-49e2-8a46-6669a21017f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c960b64141ff4e6da8e80eaa63cf5e51'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:41.162737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f0e7e67d-d13f-49e2-8a46-6669a21017f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c960b64141ff4e6da8e80eaa63cf5e51'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:41.181452 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 887/1772] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:09:40 2022] DELETE /identity/v3/users/c960b64141ff4e6da8e80eaa63cf5e51 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:41.367975 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece5836-98c7-4df3-a62c-84dadc8a3dd9 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:41.368626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece5836-98c7-4df3-a62c-84dadc8a3dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:41.369055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece5836-98c7-4df3-a62c-84dadc8a3dd9 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:41.371196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 886/1773] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jun 27 11:09:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:09:41.382294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f10677-2638-41ee-a501-6a2861467c46 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:41.382294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f10677-2638-41ee-a501-6a2861467c46 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:41.382587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f10677-2638-41ee-a501-6a2861467c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:41.435224 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d1f10677-2638-41ee-a501-6a2861467c46 None None] MFA Rules not processed for user `d8673c91abf14c0b9a237f0499fdf20e`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:41.436463 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d1f10677-2638-41ee-a501-6a2861467c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:41.596502 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 888/1774] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jun 27 11:09:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:41.605940 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece5836-98c7-4df3-a62c-84dadc8a3dd9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:41.607941 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2ece5836-98c7-4df3-a62c-84dadc8a3dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:41.627911 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece5836-98c7-4df3-a62c-84dadc8a3dd9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:41.633215 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2c00c-4952-4414-bbbe-50d10113ad97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8673c91abf14c0b9a237f0499fdf20e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:41.633918 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2c00c-4952-4414-bbbe-50d10113ad97 service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:41.634208 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2c00c-4952-4414-bbbe-50d10113ad97 service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:41.634481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2c00c-4952-4414-bbbe-50d10113ad97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:41.644172 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2c00c-4952-4414-bbbe-50d10113ad97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:41.645800 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2c00c-4952-4414-bbbe-50d10113ad97 service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:41.658126 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 887/1775] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:41.898556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f10677-2638-41ee-a501-6a2861467c46 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:41.900462 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d1f10677-2638-41ee-a501-6a2861467c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:41.960924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:42.018083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f10677-2638-41ee-a501-6a2861467c46 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:42.025285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ae508-7270-4727-a131-cb29c050630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:42.026539 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ae508-7270-4727-a131-cb29c050630d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:42.026898 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ae508-7270-4727-a131-cb29c050630d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:42.027161 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ae508-7270-4727-a131-cb29c050630d admin admin] PATH_INFO: `/v3/projects/de1d9978bb62467e9cefc6281a05ca19` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:42.029040 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ae508-7270-4727-a131-cb29c050630d admin admin] RBAC: Authorizing `identity:delete_project(project_id=de1d9978bb62467e9cefc6281a05ca19)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:42.031651 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ae508-7270-4727-a131-cb29c050630d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:42.114836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a02ae508-7270-4727-a131-cb29c050630d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de1d9978bb62467e9cefc6281a05ca19', 'request_id': 'req-a02ae508-7270-4727-a131-cb29c050630d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:42.122820 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a02ae508-7270-4727-a131-cb29c050630d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de1d9978bb62467e9cefc6281a05ca19', 'request_id': 'req-a02ae508-7270-4727-a131-cb29c050630d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:42.135699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a02ae508-7270-4727-a131-cb29c050630d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de1d9978bb62467e9cefc6281a05ca19', 'request_id': 'req-a02ae508-7270-4727-a131-cb29c050630d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:42.154772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a02ae508-7270-4727-a131-cb29c050630d admin admin] The token cache is being invalidate because project de1d9978bb62467e9cefc6281a05ca19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:09:42.155067 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a02ae508-7270-4727-a131-cb29c050630d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:42.161845 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a02ae508-7270-4727-a131-cb29c050630d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:42.164354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 889/1776] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:09:41 2022] DELETE /identity/v3/projects/de1d9978bb62467e9cefc6281a05ca19 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:42.169021 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af999e-c0e2-4e8e-a736-2687b115033d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:42.169588 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af999e-c0e2-4e8e-a736-2687b115033d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:42.169588 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af999e-c0e2-4e8e-a736-2687b115033d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:42.190049 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-24af999e-c0e2-4e8e-a736-2687b115033d None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:42.191325 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-24af999e-c0e2-4e8e-a736-2687b115033d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:42.261311 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 888/1777] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:42.269906 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a871a-32aa-4599-8465-36e92d369d65 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:42.270210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a871a-32aa-4599-8465-36e92d369d65 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:42.270495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a871a-32aa-4599-8465-36e92d369d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:42.291779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cd9a871a-32aa-4599-8465-36e92d369d65 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:42.293100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cd9a871a-32aa-4599-8465-36e92d369d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:42.304129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 890/1778] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:42.307673 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af999e-c0e2-4e8e-a736-2687b115033d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:42.317321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af999e-c0e2-4e8e-a736-2687b115033d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:42.330795 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bf859-2863-423c-8547-1d56aefb12c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:42.331502 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bf859-2863-423c-8547-1d56aefb12c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:42.331788 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bf859-2863-423c-8547-1d56aefb12c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:42.332067 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bf859-2863-423c-8547-1d56aefb12c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:42.333265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64bf859-2863-423c-8547-1d56aefb12c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:09:42.333609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64bf859-2863-423c-8547-1d56aefb12c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:42.335259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64bf859-2863-423c-8547-1d56aefb12c8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:42.347990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 889/1779] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:09:42.352242 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a871a-32aa-4599-8465-36e92d369d65 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:42.362078 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a871a-32aa-4599-8465-36e92d369d65 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:42.366932 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f7ef8-4edc-48b1-ac29-b378ff3a84af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:42.367677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f7ef8-4edc-48b1-ac29-b378ff3a84af admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:42.367963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f7ef8-4edc-48b1-ac29-b378ff3a84af admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:42.368297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f7ef8-4edc-48b1-ac29-b378ff3a84af admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:42.369024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f7ef8-4edc-48b1-ac29-b378ff3a84af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:42.371503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f7ef8-4edc-48b1-ac29-b378ff3a84af admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:42.383127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bf859-2863-423c-8547-1d56aefb12c8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:42.384998 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b64bf859-2863-423c-8547-1d56aefb12c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:42.401608 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bf859-2863-423c-8547-1d56aefb12c8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:42.407759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 891/1780] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:42 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:42.408949 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f7ef8-4edc-48b1-ac29-b378ff3a84af admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:42.409389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8363f-86f6-48f1-a3f7-7e0e821444ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:42.410314 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8363f-86f6-48f1-a3f7-7e0e821444ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:42.410600 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8363f-86f6-48f1-a3f7-7e0e821444ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:42.410882 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8363f-86f6-48f1-a3f7-7e0e821444ea admin admin] PATH_INFO: `/v3/users/db31652ef12f494d8c9574c0261b8daf` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:42.412083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8363f-86f6-48f1-a3f7-7e0e821444ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=db31652ef12f494d8c9574c0261b8daf)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:42.414350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8363f-86f6-48f1-a3f7-7e0e821444ea admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:42.476787 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4cf8363f-86f6-48f1-a3f7-7e0e821444ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db31652ef12f494d8c9574c0261b8daf'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:42.492742 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4cf8363f-86f6-48f1-a3f7-7e0e821444ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db31652ef12f494d8c9574c0261b8daf'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:42.493516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4cf8363f-86f6-48f1-a3f7-7e0e821444ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db31652ef12f494d8c9574c0261b8daf'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:42.494200 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4cf8363f-86f6-48f1-a3f7-7e0e821444ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db31652ef12f494d8c9574c0261b8daf'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:42.505083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4cf8363f-86f6-48f1-a3f7-7e0e821444ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db31652ef12f494d8c9574c0261b8daf'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:42.510265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f7ef8-4edc-48b1-ac29-b378ff3a84af admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:42.520287 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e014105-cb5c-4722-a7a5-9eed9a3c5874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:42.521037 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e014105-cb5c-4722-a7a5-9eed9a3c5874 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:42.521436 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e014105-cb5c-4722-a7a5-9eed9a3c5874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:42.521778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e014105-cb5c-4722-a7a5-9eed9a3c5874 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:42.522526 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e014105-cb5c-4722-a7a5-9eed9a3c5874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:42.523685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 890/1781] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:09:42 2022] DELETE /identity/v3/users/db31652ef12f494d8c9574c0261b8daf => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:09:42.524658 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e014105-cb5c-4722-a7a5-9eed9a3c5874 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:42.553883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 892/1782] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:42 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:09:42.557711 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8363f-86f6-48f1-a3f7-7e0e821444ea admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:42.563127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4cf8363f-86f6-48f1-a3f7-7e0e821444ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:42.608025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:42.634022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8363f-86f6-48f1-a3f7-7e0e821444ea admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:42.640421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea14c7-b510-4259-a4a4-e85ecdac45c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:42.641088 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea14c7-b510-4259-a4a4-e85ecdac45c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:42.641655 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea14c7-b510-4259-a4a4-e85ecdac45c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:42.641933 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea14c7-b510-4259-a4a4-e85ecdac45c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:42.643210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea14c7-b510-4259-a4a4-e85ecdac45c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:42.644811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea14c7-b510-4259-a4a4-e85ecdac45c1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:42.654997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 891/1783] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:42.659500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e014105-cb5c-4722-a7a5-9eed9a3c5874 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:42.670021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e014105-cb5c-4722-a7a5-9eed9a3c5874 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:42.674921 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3593a-a7f3-4449-ab42-0d861ed66c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:42.675654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3593a-a7f3-4449-ab42-0d861ed66c01 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:42.676000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3593a-a7f3-4449-ab42-0d861ed66c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:42.676335 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3593a-a7f3-4449-ab42-0d861ed66c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:42.677115 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3593a-a7f3-4449-ab42-0d861ed66c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:42.678894 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3593a-a7f3-4449-ab42-0d861ed66c01 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:42.689248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 893/1784] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:42.693888 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea14c7-b510-4259-a4a4-e85ecdac45c1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:42.706267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea14c7-b510-4259-a4a4-e85ecdac45c1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:42.710978 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0b142-c758-4a6e-b4f7-67f2bc09cef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:42.711861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0b142-c758-4a6e-b4f7-67f2bc09cef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:42.712144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0b142-c758-4a6e-b4f7-67f2bc09cef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:42.712422 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0b142-c758-4a6e-b4f7-67f2bc09cef6 admin admin] PATH_INFO: `/v3/projects/f32a021336bb409f81d54f1c54c5eded/users/1eac88bcc21e4bd9a38be066dd2720da/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:42.713838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3593a-a7f3-4449-ab42-0d861ed66c01 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:42.715599 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b7b3593a-a7f3-4449-ab42-0d861ed66c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:42.729913 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0b142-c758-4a6e-b4f7-67f2bc09cef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32a021336bb409f81d54f1c54c5eded, user_id=1eac88bcc21e4bd9a38be066dd2720da, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:42.731728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3593a-a7f3-4449-ab42-0d861ed66c01 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:42.732815 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0b142-c758-4a6e-b4f7-67f2bc09cef6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:42.737145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668a104-8ad5-4a88-80e6-84629702e880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:42.738053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668a104-8ad5-4a88-80e6-84629702e880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:42.738342 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668a104-8ad5-4a88-80e6-84629702e880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:42.738630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668a104-8ad5-4a88-80e6-84629702e880 admin admin] PATH_INFO: `/v3/projects/c8fbcd1013884f25920b1322d3785e06` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:42.740081 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668a104-8ad5-4a88-80e6-84629702e880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8fbcd1013884f25920b1322d3785e06)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:42.742500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668a104-8ad5-4a88-80e6-84629702e880 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:42.751873 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:42.754155 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 892/1785] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:42 2022] PUT /identity/v3/projects/f32a021336bb409f81d54f1c54c5eded/users/1eac88bcc21e4bd9a38be066dd2720da/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:42.759319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f626d4-ca41-4a69-af49-6193c1b51aae None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:42.759609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f626d4-ca41-4a69-af49-6193c1b51aae None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:42.760016 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f626d4-ca41-4a69-af49-6193c1b51aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:42.780036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-27f626d4-ca41-4a69-af49-6193c1b51aae None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:42.781226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-27f626d4-ca41-4a69-af49-6193c1b51aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:42.802180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c668a104-8ad5-4a88-80e6-84629702e880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8fbcd1013884f25920b1322d3785e06', 'request_id': 'req-c668a104-8ad5-4a88-80e6-84629702e880'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:42.821687 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c668a104-8ad5-4a88-80e6-84629702e880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8fbcd1013884f25920b1322d3785e06', 'request_id': 'req-c668a104-8ad5-4a88-80e6-84629702e880'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:42.832021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c668a104-8ad5-4a88-80e6-84629702e880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8fbcd1013884f25920b1322d3785e06', 'request_id': 'req-c668a104-8ad5-4a88-80e6-84629702e880'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:42.850123 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c668a104-8ad5-4a88-80e6-84629702e880 admin admin] The token cache is being invalidate because project c8fbcd1013884f25920b1322d3785e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:09:42.850585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c668a104-8ad5-4a88-80e6-84629702e880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:42.851239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c668a104-8ad5-4a88-80e6-84629702e880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:42.853015 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 894/1786] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:09:42 2022] DELETE /identity/v3/projects/c8fbcd1013884f25920b1322d3785e06 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:42.856802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668a104-8ad5-4a88-80e6-84629702e880 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:42.857194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 893/1787] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:09:42.861316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c668a104-8ad5-4a88-80e6-84629702e880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:42.873503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f626d4-ca41-4a69-af49-6193c1b51aae None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:42.876010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-27f626d4-ca41-4a69-af49-6193c1b51aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:42.877781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668a104-8ad5-4a88-80e6-84629702e880 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:42.883118 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50965cc5-3201-40b0-bbf4-2d5ac3f9d230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:42.884548 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965cc5-3201-40b0-bbf4-2d5ac3f9d230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:42.884548 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965cc5-3201-40b0-bbf4-2d5ac3f9d230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:42.884748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965cc5-3201-40b0-bbf4-2d5ac3f9d230 admin admin] PATH_INFO: `/v3/users/0fed5b130ba543d896ac3a3db61f0c34` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:42.886163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50965cc5-3201-40b0-bbf4-2d5ac3f9d230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fed5b130ba543d896ac3a3db61f0c34)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:42.889746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50965cc5-3201-40b0-bbf4-2d5ac3f9d230 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:42.959090 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f626d4-ca41-4a69-af49-6193c1b51aae None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:42.965339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657db28-3913-459b-bade-1a9c6f1cb977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:42.966156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657db28-3913-459b-bade-1a9c6f1cb977 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:42.966441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657db28-3913-459b-bade-1a9c6f1cb977 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:42.966726 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657db28-3913-459b-bade-1a9c6f1cb977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:42.977158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657db28-3913-459b-bade-1a9c6f1cb977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:42.978637 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657db28-3913-459b-bade-1a9c6f1cb977 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:42.985848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-50965cc5-3201-40b0-bbf4-2d5ac3f9d230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fed5b130ba543d896ac3a3db61f0c34'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:42.988843 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 894/1788] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:42.999391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-50965cc5-3201-40b0-bbf4-2d5ac3f9d230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fed5b130ba543d896ac3a3db61f0c34'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:43.000145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-50965cc5-3201-40b0-bbf4-2d5ac3f9d230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fed5b130ba543d896ac3a3db61f0c34'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:43.000800 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-50965cc5-3201-40b0-bbf4-2d5ac3f9d230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fed5b130ba543d896ac3a3db61f0c34'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:43.011307 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-50965cc5-3201-40b0-bbf4-2d5ac3f9d230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fed5b130ba543d896ac3a3db61f0c34'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:43.027459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 895/1789] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:09:42 2022] DELETE /identity/v3/users/0fed5b130ba543d896ac3a3db61f0c34 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:09:43.286405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657db28-3913-459b-bade-1a9c6f1cb977 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:43.303010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657db28-3913-459b-bade-1a9c6f1cb977 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:43.430225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:43.457021 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd35473-dba6-48db-8cce-336190d7fdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:43.457945 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd35473-dba6-48db-8cce-336190d7fdf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:43.458805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd35473-dba6-48db-8cce-336190d7fdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:43.459093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd35473-dba6-48db-8cce-336190d7fdf8 admin admin] PATH_INFO: `/v3/projects/f06a096a489641f9bb8b4b034eab63b1` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:43.460364 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd35473-dba6-48db-8cce-336190d7fdf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06a096a489641f9bb8b4b034eab63b1)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:43.462915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd35473-dba6-48db-8cce-336190d7fdf8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:43.579968 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-efd35473-dba6-48db-8cce-336190d7fdf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06a096a489641f9bb8b4b034eab63b1', 'request_id': 'req-efd35473-dba6-48db-8cce-336190d7fdf8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:43.619470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-efd35473-dba6-48db-8cce-336190d7fdf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06a096a489641f9bb8b4b034eab63b1', 'request_id': 'req-efd35473-dba6-48db-8cce-336190d7fdf8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:43.639848 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-efd35473-dba6-48db-8cce-336190d7fdf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06a096a489641f9bb8b4b034eab63b1', 'request_id': 'req-efd35473-dba6-48db-8cce-336190d7fdf8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:43.654720 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-efd35473-dba6-48db-8cce-336190d7fdf8 admin admin] The token cache is being invalidate because project f06a096a489641f9bb8b4b034eab63b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:09:43.655270 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-efd35473-dba6-48db-8cce-336190d7fdf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:43.656393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-efd35473-dba6-48db-8cce-336190d7fdf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:09:43.664438 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 895/1790] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:09:43 2022] DELETE /identity/v3/projects/f06a096a489641f9bb8b4b034eab63b1 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:43.666410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80bef-4d7e-4071-b533-84a4921dff47 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:43.666702 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80bef-4d7e-4071-b533-84a4921dff47 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:43.668228 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80bef-4d7e-4071-b533-84a4921dff47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:43.706770 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3fd80bef-4d7e-4071-b533-84a4921dff47 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:43.707836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3fd80bef-4d7e-4071-b533-84a4921dff47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:43.789952 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 896/1791] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:43.799467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4feb0-021f-40fb-8d84-80f4f4d00c5e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:43.800042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4feb0-021f-40fb-8d84-80f4f4d00c5e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:43.800546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4feb0-021f-40fb-8d84-80f4f4d00c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:43.828502 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-78a4feb0-021f-40fb-8d84-80f4f4d00c5e None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:43.830055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-78a4feb0-021f-40fb-8d84-80f4f4d00c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:43.840254 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 896/1792] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:09:43.844531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd80bef-4d7e-4071-b533-84a4921dff47 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:43.855691 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd80bef-4d7e-4071-b533-84a4921dff47 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:43.860418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e62d1-b0f3-462e-9e21-0653b5cb6c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:43.861713 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e62d1-b0f3-462e-9e21-0653b5cb6c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:43.862416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e62d1-b0f3-462e-9e21-0653b5cb6c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:43.862416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e62d1-b0f3-462e-9e21-0653b5cb6c24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:43.863310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e62d1-b0f3-462e-9e21-0653b5cb6c24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:09:43.863555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e62d1-b0f3-462e-9e21-0653b5cb6c24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:43.865168 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e62d1-b0f3-462e-9e21-0653b5cb6c24 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:43.867877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:43.889738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 897/1793] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:09:43.894645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4feb0-021f-40fb-8d84-80f4f4d00c5e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:43.904293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4feb0-021f-40fb-8d84-80f4f4d00c5e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:43.911659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e07544-8c47-457b-bf32-24389d0d773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:43.912314 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e07544-8c47-457b-bf32-24389d0d773a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:43.912591 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e07544-8c47-457b-bf32-24389d0d773a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:43.912861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e07544-8c47-457b-bf32-24389d0d773a admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:43.913648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e07544-8c47-457b-bf32-24389d0d773a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:43.915490 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e07544-8c47-457b-bf32-24389d0d773a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:43.967632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 897/1794] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:43 2022] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:09:43.969432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e62d1-b0f3-462e-9e21-0653b5cb6c24 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:43.982634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e62d1-b0f3-462e-9e21-0653b5cb6c24 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:44.038760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa132a-d9bc-42b3-aba4-98f8b184d89e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:44.039303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa132a-d9bc-42b3-aba4-98f8b184d89e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:44.039932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa132a-d9bc-42b3-aba4-98f8b184d89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:44.075163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-08fa132a-d9bc-42b3-aba4-98f8b184d89e None None] MFA Rules not processed for user `1eac88bcc21e4bd9a38be066dd2720da`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:44.076461 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-08fa132a-d9bc-42b3-aba4-98f8b184d89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:44.144273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac6b60-64a2-4542-8f9f-f79c5170508a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:44.144972 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac6b60-64a2-4542-8f9f-f79c5170508a admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:44.145256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac6b60-64a2-4542-8f9f-f79c5170508a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:44.145558 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac6b60-64a2-4542-8f9f-f79c5170508a admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:44.146261 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac6b60-64a2-4542-8f9f-f79c5170508a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:44.153228 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac6b60-64a2-4542-8f9f-f79c5170508a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:44.195784 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 898/1795] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:44.202617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa132a-d9bc-42b3-aba4-98f8b184d89e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:44.207069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-08fa132a-d9bc-42b3-aba4-98f8b184d89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:44.222670 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 898/1796] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:43 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:09:44.223644 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac6b60-64a2-4542-8f9f-f79c5170508a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:44.236641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac6b60-64a2-4542-8f9f-f79c5170508a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:44.240192 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa132a-d9bc-42b3-aba4-98f8b184d89e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:44.242829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e11bf-34d6-4f19-96ec-a4f59dbf3d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:44.243504 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e11bf-34d6-4f19-96ec-a4f59dbf3d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:44.243787 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e11bf-34d6-4f19-96ec-a4f59dbf3d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:44.244053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e11bf-34d6-4f19-96ec-a4f59dbf3d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:44.244842 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e11bf-34d6-4f19-96ec-a4f59dbf3d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:44.246861 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e11bf-34d6-4f19-96ec-a4f59dbf3d86 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:44.247497 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce6409-3e50-41ea-8a7f-d85b20889115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:44.248344 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce6409-3e50-41ea-8a7f-d85b20889115 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:44.248822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce6409-3e50-41ea-8a7f-d85b20889115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:44.249250 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce6409-3e50-41ea-8a7f-d85b20889115 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:44.250109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce6409-3e50-41ea-8a7f-d85b20889115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:44.253021 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce6409-3e50-41ea-8a7f-d85b20889115 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:44.270539 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 899/1797] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:44.274164 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e11bf-34d6-4f19-96ec-a4f59dbf3d86 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:44.288642 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e11bf-34d6-4f19-96ec-a4f59dbf3d86 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:44.295778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34987c37-afa9-4fa8-a594-7584851c7d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:44.297279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987c37-afa9-4fa8-a594-7584851c7d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:44.297749 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987c37-afa9-4fa8-a594-7584851c7d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:44.299233 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987c37-afa9-4fa8-a594-7584851c7d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:44.300483 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34987c37-afa9-4fa8-a594-7584851c7d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:44.303344 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34987c37-afa9-4fa8-a594-7584851c7d52 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:44.309068 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 899/1798] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:09:44 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:44.312829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce6409-3e50-41ea-8a7f-d85b20889115 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:44.318541 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 900/1799] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:09:44.322547 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34987c37-afa9-4fa8-a594-7584851c7d52 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:44.331602 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:44.340144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34987c37-afa9-4fa8-a594-7584851c7d52 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:44.397868 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce6409-3e50-41ea-8a7f-d85b20889115 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:44.402893 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ce42e-efc1-4966-ae22-6b1e63fe3085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:44.403627 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ce42e-efc1-4966-ae22-6b1e63fe3085 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:44.404113 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ce42e-efc1-4966-ae22-6b1e63fe3085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:44.404465 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ce42e-efc1-4966-ae22-6b1e63fe3085 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:44.405220 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ce42e-efc1-4966-ae22-6b1e63fe3085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:44.407289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ce42e-efc1-4966-ae22-6b1e63fe3085 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:44.409089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af23d75-18bf-4f15-afcd-cd77f060fbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:44.410074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af23d75-18bf-4f15-afcd-cd77f060fbdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:44.410412 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af23d75-18bf-4f15-afcd-cd77f060fbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:44.410687 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af23d75-18bf-4f15-afcd-cd77f060fbdd admin admin] PATH_INFO: `/v3/projects/180bf167b6714b0ca1112d3432f35300/users/ee312fc0138d4a959a546a49a466913f/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:44.426412 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af23d75-18bf-4f15-afcd-cd77f060fbdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=180bf167b6714b0ca1112d3432f35300, user_id=ee312fc0138d4a959a546a49a466913f, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:44.429181 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af23d75-18bf-4f15-afcd-cd77f060fbdd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:44.430922 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 900/1800] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:09:44 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:09:44.435507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ce42e-efc1-4966-ae22-6b1e63fe3085 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:44.446086 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ce42e-efc1-4966-ae22-6b1e63fe3085 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:44.449826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 901/1801] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:44 2022] PUT /identity/v3/projects/180bf167b6714b0ca1112d3432f35300/users/ee312fc0138d4a959a546a49a466913f/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:09:44.460580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d3a2d-469e-4977-bad3-8f681604100f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:44.460868 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d3a2d-469e-4977-bad3-8f681604100f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:44.461142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d3a2d-469e-4977-bad3-8f681604100f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:44.494622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7d8d3a2d-469e-4977-bad3-8f681604100f None None] MFA Rules not processed for user `ee312fc0138d4a959a546a49a466913f`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:44.496117 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7d8d3a2d-469e-4977-bad3-8f681604100f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:44.512271 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f324094-ca98-4b41-9152-8bc4c14de95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:44.513025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f324094-ca98-4b41-9152-8bc4c14de95f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:44.513416 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f324094-ca98-4b41-9152-8bc4c14de95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:44.513766 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f324094-ca98-4b41-9152-8bc4c14de95f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:44.514558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f324094-ca98-4b41-9152-8bc4c14de95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:44.516466 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f324094-ca98-4b41-9152-8bc4c14de95f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:44.529103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 901/1802] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:09:44.533456 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f324094-ca98-4b41-9152-8bc4c14de95f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:44.534736 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:44.543475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f324094-ca98-4b41-9152-8bc4c14de95f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:44.549269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38371478-1478-44b0-b758-28879cceed74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:44.550153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38371478-1478-44b0-b758-28879cceed74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:44.550432 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38371478-1478-44b0-b758-28879cceed74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:44.550708 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38371478-1478-44b0-b758-28879cceed74 admin admin] PATH_INFO: `/v3/projects/94955ca48cd24e9caa749f0ef08cbed8/users/157e693e6fa043ffaa385348de2c7993/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:44.565048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38371478-1478-44b0-b758-28879cceed74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94955ca48cd24e9caa749f0ef08cbed8, user_id=157e693e6fa043ffaa385348de2c7993, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:44.567104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 902/1803] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:44.568053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38371478-1478-44b0-b758-28879cceed74 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:44.584260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d3a2d-469e-4977-bad3-8f681604100f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:44.586374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7d8d3a2d-469e-4977-bad3-8f681604100f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:44.600145 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 902/1804] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:44 2022] PUT /identity/v3/projects/94955ca48cd24e9caa749f0ef08cbed8/users/157e693e6fa043ffaa385348de2c7993/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:09:44.603908 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38371478-1478-44b0-b758-28879cceed74 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:44.645924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d3a2d-469e-4977-bad3-8f681604100f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:44.666517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38371478-1478-44b0-b758-28879cceed74 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:44.671456 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864022f6-2d78-4c00-ba45-1a57bbc02720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:44.672127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864022f6-2d78-4c00-ba45-1a57bbc02720 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:44.672461 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864022f6-2d78-4c00-ba45-1a57bbc02720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:44.672702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864022f6-2d78-4c00-ba45-1a57bbc02720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:44.674035 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864022f6-2d78-4c00-ba45-1a57bbc02720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:44.675636 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864022f6-2d78-4c00-ba45-1a57bbc02720 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:44.685470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 903/1805] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:09:44.689559 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864022f6-2d78-4c00-ba45-1a57bbc02720 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:44.693765 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea856f46-286c-42ce-b8f9-9f0c62955367 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b6436fdd7a4977a2e02c0e1b8be2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:44.694466 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea856f46-286c-42ce-b8f9-9f0c62955367 service glance] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:44.694747 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea856f46-286c-42ce-b8f9-9f0c62955367 service glance] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:44.695037 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea856f46-286c-42ce-b8f9-9f0c62955367 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:44.700219 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864022f6-2d78-4c00-ba45-1a57bbc02720 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:44.707388 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4973c-2180-4f03-852a-fe281efc4789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:44.708339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4973c-2180-4f03-852a-fe281efc4789 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:44.708620 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4973c-2180-4f03-852a-fe281efc4789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:44.708900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4973c-2180-4f03-852a-fe281efc4789 admin admin] PATH_INFO: `/v3/projects/94955ca48cd24e9caa749f0ef08cbed8/users/157e693e6fa043ffaa385348de2c7993/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:44.711304 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4973c-2180-4f03-852a-fe281efc4789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94955ca48cd24e9caa749f0ef08cbed8, user_id=157e693e6fa043ffaa385348de2c7993, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:44.714731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4973c-2180-4f03-852a-fe281efc4789 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:44.719073 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:44.734314 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 904/1806] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:09:44 2022] PUT /identity/v3/projects/94955ca48cd24e9caa749f0ef08cbed8/users/157e693e6fa043ffaa385348de2c7993/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:09:44.780464 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea856f46-286c-42ce-b8f9-9f0c62955367 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:44.781977 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea856f46-286c-42ce-b8f9-9f0c62955367 service glance] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:44.791978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 903/1807] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:09:45.500999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1741b-787e-4849-a34a-4a5d5d24091c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:45.500999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1741b-787e-4849-a34a-4a5d5d24091c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:45.500999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1741b-787e-4849-a34a-4a5d5d24091c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:45.556523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-07a1741b-787e-4849-a34a-4a5d5d24091c None None] MFA Rules not processed for user `157e693e6fa043ffaa385348de2c7993`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:45.557460 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-07a1741b-787e-4849-a34a-4a5d5d24091c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:45.645700 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 905/1808] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:09:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:45.657307 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea856f46-286c-42ce-b8f9-9f0c62955367 service glance] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:45.658817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ea856f46-286c-42ce-b8f9-9f0c62955367 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:45.712805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:45.718803 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea856f46-286c-42ce-b8f9-9f0c62955367 service glance] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:45.767139 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8368ae0-861c-4ff6-b872-653e8e71b26b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:45.767797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8368ae0-861c-4ff6-b872-653e8e71b26b service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:45.768083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8368ae0-861c-4ff6-b872-653e8e71b26b service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:45.770800 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8368ae0-861c-4ff6-b872-653e8e71b26b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:45.823043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8368ae0-861c-4ff6-b872-653e8e71b26b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:45.824477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8368ae0-861c-4ff6-b872-653e8e71b26b service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:45.833524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 904/1809] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:47.708339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1741b-787e-4849-a34a-4a5d5d24091c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:47.730735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1741b-787e-4849-a34a-4a5d5d24091c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:47.739252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059eae12-818a-4ca9-b466-d4375fa2ac8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:47.739252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eae12-818a-4ca9-b466-d4375fa2ac8c service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:47.739252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eae12-818a-4ca9-b466-d4375fa2ac8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:47.740149 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eae12-818a-4ca9-b466-d4375fa2ac8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:47.748294 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-059eae12-818a-4ca9-b466-d4375fa2ac8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:47.857797 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059eae12-818a-4ca9-b466-d4375fa2ac8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:47.859915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059eae12-818a-4ca9-b466-d4375fa2ac8c service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:47.887738 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 906/1810] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:48.263858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8368ae0-861c-4ff6-b872-653e8e71b26b service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:48.265355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f8368ae0-861c-4ff6-b872-653e8e71b26b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:48.279197 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8368ae0-861c-4ff6-b872-653e8e71b26b service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:48.285600 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f44691-f378-4415-9052-a7d3e108f0d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:48.286635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f44691-f378-4415-9052-a7d3e108f0d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:48.287193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f44691-f378-4415-9052-a7d3e108f0d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:48.287652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f44691-f378-4415-9052-a7d3e108f0d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:48.303180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f44691-f378-4415-9052-a7d3e108f0d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:48.305001 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f44691-f378-4415-9052-a7d3e108f0d4 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:48.330361 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 905/1811] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:48.548928 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b71197-fec3-4701-a3fb-ffc83c4b2593 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:48.549637 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b71197-fec3-4701-a3fb-ffc83c4b2593 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:48.550219 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b71197-fec3-4701-a3fb-ffc83c4b2593 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:48.551836 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 907/1812] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jun 27 11:09:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:09:48.579202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca51c6a-5a80-4a47-9770-349bc7dd86eb None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:48.580517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca51c6a-5a80-4a47-9770-349bc7dd86eb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:48.580980 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca51c6a-5a80-4a47-9770-349bc7dd86eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:48.656081 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3ca51c6a-5a80-4a47-9770-349bc7dd86eb None None] MFA Rules not processed for user `ed08c367a3d34207a51914ff77a93898`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:09:48.660277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3ca51c6a-5a80-4a47-9770-349bc7dd86eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:48.874860 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 906/1813] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jun 27 11:09:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:09:48.901860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b71197-fec3-4701-a3fb-ffc83c4b2593 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:09:48.904693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-56b71197-fec3-4701-a3fb-ffc83c4b2593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:09:48.936528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b71197-fec3-4701-a3fb-ffc83c4b2593 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:09:48.943214 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9272e-f202-4177-b0e4-4aeeb4741abc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:09:48.943690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9272e-f202-4177-b0e4-4aeeb4741abc service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:09:48.943980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9272e-f202-4177-b0e4-4aeeb4741abc service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:09:48.944345 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9272e-f202-4177-b0e4-4aeeb4741abc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:09:48.956109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9272e-f202-4177-b0e4-4aeeb4741abc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:09:48.957778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9272e-f202-4177-b0e4-4aeeb4741abc service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:09:48.973874 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 908/1814] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:09:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:09:58.860288 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=84 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:09:58.969412 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=72 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:05.559501 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb783d-81b0-43f4-89d4-5ba6f344fbd3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:05.559999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb783d-81b0-43f4-89d4-5ba6f344fbd3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:05.559999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb783d-81b0-43f4-89d4-5ba6f344fbd3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:05.561769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 907/1815] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jun 27 11:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:10:05.654802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2c655-d15f-4bda-8399-a6baaebceac5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:05.655891 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2c655-d15f-4bda-8399-a6baaebceac5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:05.655891 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2c655-d15f-4bda-8399-a6baaebceac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:05.710037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f5f2c655-d15f-4bda-8399-a6baaebceac5 None None] MFA Rules not processed for user `ed08c367a3d34207a51914ff77a93898`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:05.711282 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f5f2c655-d15f-4bda-8399-a6baaebceac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:05.737070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 909/1816] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jun 27 11:10:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:05.746060 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb783d-81b0-43f4-89d4-5ba6f344fbd3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:05.747787 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6abb783d-81b0-43f4-89d4-5ba6f344fbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:05.784337 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb783d-81b0-43f4-89d4-5ba6f344fbd3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:05.818323 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c3e5e-f879-4227-874d-b9aeb6e54d18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:05.818902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c3e5e-f879-4227-874d-b9aeb6e54d18 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:05.819179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c3e5e-f879-4227-874d-b9aeb6e54d18 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:05.819614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c3e5e-f879-4227-874d-b9aeb6e54d18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:05.837320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c3e5e-f879-4227-874d-b9aeb6e54d18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:05.838968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c3e5e-f879-4227-874d-b9aeb6e54d18 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:05.858200 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 908/1817] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:06.025782 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2c655-d15f-4bda-8399-a6baaebceac5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:06.027926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f5f2c655-d15f-4bda-8399-a6baaebceac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:06.155989 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2c655-d15f-4bda-8399-a6baaebceac5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:06.161623 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cc1e9-8911-40e7-91ec-936e34a8e41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:06.162455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cc1e9-8911-40e7-91ec-936e34a8e41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:06.162792 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cc1e9-8911-40e7-91ec-936e34a8e41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:06.163082 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cc1e9-8911-40e7-91ec-936e34a8e41a admin admin] PATH_INFO: `/v3/users/a9200287e5ca494ebdf97a7d6a43730c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:06.164334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cc1e9-8911-40e7-91ec-936e34a8e41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9200287e5ca494ebdf97a7d6a43730c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:06.166861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cc1e9-8911-40e7-91ec-936e34a8e41a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:06.267556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e55cc1e9-8911-40e7-91ec-936e34a8e41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9200287e5ca494ebdf97a7d6a43730c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:06.282877 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e55cc1e9-8911-40e7-91ec-936e34a8e41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9200287e5ca494ebdf97a7d6a43730c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:06.283964 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e55cc1e9-8911-40e7-91ec-936e34a8e41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9200287e5ca494ebdf97a7d6a43730c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:06.284871 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e55cc1e9-8911-40e7-91ec-936e34a8e41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9200287e5ca494ebdf97a7d6a43730c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:06.307324 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e55cc1e9-8911-40e7-91ec-936e34a8e41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9200287e5ca494ebdf97a7d6a43730c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:06.329101 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 910/1818] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:06 2022] DELETE /identity/v3/users/a9200287e5ca494ebdf97a7d6a43730c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:06.334007 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee049d-3dbe-4cf2-959c-7dc4702ef953 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:06.334515 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee049d-3dbe-4cf2-959c-7dc4702ef953 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:06.335000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee049d-3dbe-4cf2-959c-7dc4702ef953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:06.355716 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e2ee049d-3dbe-4cf2-959c-7dc4702ef953 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:06.357566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e2ee049d-3dbe-4cf2-959c-7dc4702ef953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:06.476864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 909/1819] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:10:06.500440 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cc1e9-8911-40e7-91ec-936e34a8e41a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:06.502632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e55cc1e9-8911-40e7-91ec-936e34a8e41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:06.588633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cc1e9-8911-40e7-91ec-936e34a8e41a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:06.599395 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a27ab0-552e-4447-9b87-7ad7aa287211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:06.599991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a27ab0-552e-4447-9b87-7ad7aa287211 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:06.600426 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a27ab0-552e-4447-9b87-7ad7aa287211 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:06.600633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a27ab0-552e-4447-9b87-7ad7aa287211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:06.613018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a27ab0-552e-4447-9b87-7ad7aa287211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:06.615251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a27ab0-552e-4447-9b87-7ad7aa287211 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:06.627223 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 911/1820] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:07.328337 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee049d-3dbe-4cf2-959c-7dc4702ef953 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:07.331060 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e2ee049d-3dbe-4cf2-959c-7dc4702ef953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:07.352041 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee049d-3dbe-4cf2-959c-7dc4702ef953 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:07.357455 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444fc2e-8db7-498f-82f3-36f2d213dd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:07.358539 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444fc2e-8db7-498f-82f3-36f2d213dd26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:07.358886 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444fc2e-8db7-498f-82f3-36f2d213dd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:07.359217 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444fc2e-8db7-498f-82f3-36f2d213dd26 admin admin] PATH_INFO: `/v3/projects/160d8d69f84446b4a2bc8e980ed7466d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:07.360517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444fc2e-8db7-498f-82f3-36f2d213dd26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=160d8d69f84446b4a2bc8e980ed7466d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:07.362509 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444fc2e-8db7-498f-82f3-36f2d213dd26 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:07.415219 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3444fc2e-8db7-498f-82f3-36f2d213dd26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '160d8d69f84446b4a2bc8e980ed7466d', 'request_id': 'req-3444fc2e-8db7-498f-82f3-36f2d213dd26'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:07.421617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3444fc2e-8db7-498f-82f3-36f2d213dd26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '160d8d69f84446b4a2bc8e980ed7466d', 'request_id': 'req-3444fc2e-8db7-498f-82f3-36f2d213dd26'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:07.427143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3444fc2e-8db7-498f-82f3-36f2d213dd26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '160d8d69f84446b4a2bc8e980ed7466d', 'request_id': 'req-3444fc2e-8db7-498f-82f3-36f2d213dd26'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:07.442869 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3444fc2e-8db7-498f-82f3-36f2d213dd26 admin admin] The token cache is being invalidate because project 160d8d69f84446b4a2bc8e980ed7466d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:07.443168 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3444fc2e-8db7-498f-82f3-36f2d213dd26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:07.443795 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3444fc2e-8db7-498f-82f3-36f2d213dd26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:07.445340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 910/1821] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:07 2022] DELETE /identity/v3/projects/160d8d69f84446b4a2bc8e980ed7466d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:07.449433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a27ab0-552e-4447-9b87-7ad7aa287211 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:07.459727 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a27ab0-552e-4447-9b87-7ad7aa287211 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:07.470955 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:07.516564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1326892-d71d-4cc7-b7a0-90a20e9759d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:07.517463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1326892-d71d-4cc7-b7a0-90a20e9759d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:07.517753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1326892-d71d-4cc7-b7a0-90a20e9759d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:07.518035 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1326892-d71d-4cc7-b7a0-90a20e9759d6 admin admin] PATH_INFO: `/v3/users/02b5abcc52ca484c832cba5c54e576fc` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:07.519223 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1326892-d71d-4cc7-b7a0-90a20e9759d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b5abcc52ca484c832cba5c54e576fc)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:07.521833 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1326892-d71d-4cc7-b7a0-90a20e9759d6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:07.565746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c1326892-d71d-4cc7-b7a0-90a20e9759d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b5abcc52ca484c832cba5c54e576fc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:07.577755 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c1326892-d71d-4cc7-b7a0-90a20e9759d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b5abcc52ca484c832cba5c54e576fc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:07.578408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c1326892-d71d-4cc7-b7a0-90a20e9759d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b5abcc52ca484c832cba5c54e576fc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:07.579004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c1326892-d71d-4cc7-b7a0-90a20e9759d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b5abcc52ca484c832cba5c54e576fc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:07.586061 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c1326892-d71d-4cc7-b7a0-90a20e9759d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b5abcc52ca484c832cba5c54e576fc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:07.598266 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 912/1822] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:07 2022] DELETE /identity/v3/users/02b5abcc52ca484c832cba5c54e576fc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:07.888655 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444fc2e-8db7-498f-82f3-36f2d213dd26 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:07.890182 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3444fc2e-8db7-498f-82f3-36f2d213dd26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:07.904146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444fc2e-8db7-498f-82f3-36f2d213dd26 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:07.974292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bdf2a-d584-4b7e-9e37-4900a062715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:07.975272 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bdf2a-d584-4b7e-9e37-4900a062715a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:07.975657 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bdf2a-d584-4b7e-9e37-4900a062715a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:07.976037 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bdf2a-d584-4b7e-9e37-4900a062715a admin admin] PATH_INFO: `/v3/projects/fc1f4056971644b79634563634b174c0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:07.977347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bdf2a-d584-4b7e-9e37-4900a062715a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc1f4056971644b79634563634b174c0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:07.979941 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bdf2a-d584-4b7e-9e37-4900a062715a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:07.993516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:08.031998 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-344bdf2a-d584-4b7e-9e37-4900a062715a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1f4056971644b79634563634b174c0', 'request_id': 'req-344bdf2a-d584-4b7e-9e37-4900a062715a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:08.038810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-344bdf2a-d584-4b7e-9e37-4900a062715a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1f4056971644b79634563634b174c0', 'request_id': 'req-344bdf2a-d584-4b7e-9e37-4900a062715a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:08.044201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-344bdf2a-d584-4b7e-9e37-4900a062715a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1f4056971644b79634563634b174c0', 'request_id': 'req-344bdf2a-d584-4b7e-9e37-4900a062715a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:08.057119 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-344bdf2a-d584-4b7e-9e37-4900a062715a admin admin] The token cache is being invalidate because project fc1f4056971644b79634563634b174c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:08.057440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-344bdf2a-d584-4b7e-9e37-4900a062715a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:08.058065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-344bdf2a-d584-4b7e-9e37-4900a062715a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:08.059611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 911/1823] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:07 2022] DELETE /identity/v3/projects/fc1f4056971644b79634563634b174c0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:08.064580 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f057de1-173d-4983-a7fc-b544019f02dc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:08.064867 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f057de1-173d-4983-a7fc-b544019f02dc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:08.065144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f057de1-173d-4983-a7fc-b544019f02dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:08.083746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0f057de1-173d-4983-a7fc-b544019f02dc None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:08.084961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0f057de1-173d-4983-a7fc-b544019f02dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:08.153631 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 913/1824] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:08.162142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c114c-3d99-4014-afd2-3ba82b237f76 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:08.162508 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c114c-3d99-4014-afd2-3ba82b237f76 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:08.162848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c114c-3d99-4014-afd2-3ba82b237f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:08.182396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f90c114c-3d99-4014-afd2-3ba82b237f76 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:08.183668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f90c114c-3d99-4014-afd2-3ba82b237f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:08.191689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 912/1825] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:10:08.195895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f057de1-173d-4983-a7fc-b544019f02dc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:08.206368 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f057de1-173d-4983-a7fc-b544019f02dc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:08.211087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94837ce-17cb-496e-bc61-664457fbf4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:08.211741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94837ce-17cb-496e-bc61-664457fbf4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:08.212024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94837ce-17cb-496e-bc61-664457fbf4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:08.212297 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94837ce-17cb-496e-bc61-664457fbf4c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:08.213024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94837ce-17cb-496e-bc61-664457fbf4c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:10:08.213330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94837ce-17cb-496e-bc61-664457fbf4c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:08.215047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94837ce-17cb-496e-bc61-664457fbf4c4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:08.227162 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 914/1826] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:10:08.231506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c114c-3d99-4014-afd2-3ba82b237f76 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:08.241230 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c114c-3d99-4014-afd2-3ba82b237f76 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:08.245805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9abdf-66a2-4689-8cc7-2dccf307a974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:08.246442 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9abdf-66a2-4689-8cc7-2dccf307a974 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:08.246720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9abdf-66a2-4689-8cc7-2dccf307a974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:08.246989 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9abdf-66a2-4689-8cc7-2dccf307a974 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:08.247664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9abdf-66a2-4689-8cc7-2dccf307a974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:08.249549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9abdf-66a2-4689-8cc7-2dccf307a974 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:08.274378 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 913/1827] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:08 2022] POST /identity/v3/projects => generated 409 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:08.278587 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94837ce-17cb-496e-bc61-664457fbf4c4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:08.288947 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94837ce-17cb-496e-bc61-664457fbf4c4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:08.307694 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:08.349988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df29df4-2a1f-4ee4-9062-e8b44e7a0a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:08.350660 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29df4-2a1f-4ee4-9062-e8b44e7a0a54 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:08.350948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29df4-2a1f-4ee4-9062-e8b44e7a0a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:08.351226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29df4-2a1f-4ee4-9062-e8b44e7a0a54 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:08.351924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df29df4-2a1f-4ee4-9062-e8b44e7a0a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:08.353925 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df29df4-2a1f-4ee4-9062-e8b44e7a0a54 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:08.376848 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 915/1828] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:08 2022] POST /identity/v3/users => generated 305 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:08.378184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9abdf-66a2-4689-8cc7-2dccf307a974 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:08.389013 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9abdf-66a2-4689-8cc7-2dccf307a974 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:08.393925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520923c5-9d75-4969-86d8-e331aa3ce492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:08.394588 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520923c5-9d75-4969-86d8-e331aa3ce492 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:08.394870 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520923c5-9d75-4969-86d8-e331aa3ce492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:08.395146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520923c5-9d75-4969-86d8-e331aa3ce492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:08.396611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520923c5-9d75-4969-86d8-e331aa3ce492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:08.398232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520923c5-9d75-4969-86d8-e331aa3ce492 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:08.409224 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 914/1829] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:08.413725 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df29df4-2a1f-4ee4-9062-e8b44e7a0a54 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:08.424193 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df29df4-2a1f-4ee4-9062-e8b44e7a0a54 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:08.429461 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9156f11-25d6-430f-b288-b46fb80ec539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:08.430157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9156f11-25d6-430f-b288-b46fb80ec539 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:08.430441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9156f11-25d6-430f-b288-b46fb80ec539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:08.430715 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9156f11-25d6-430f-b288-b46fb80ec539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:08.431471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9156f11-25d6-430f-b288-b46fb80ec539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:08.433060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9156f11-25d6-430f-b288-b46fb80ec539 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:08.446751 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 916/1830] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:08.447859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520923c5-9d75-4969-86d8-e331aa3ce492 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:08.457920 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520923c5-9d75-4969-86d8-e331aa3ce492 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:08.463735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7941f-6ca6-460f-b336-ffd54a99fb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:08.464623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7941f-6ca6-460f-b336-ffd54a99fb00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:08.465647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7941f-6ca6-460f-b336-ffd54a99fb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:08.466033 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7941f-6ca6-460f-b336-ffd54a99fb00 admin admin] PATH_INFO: `/v3/projects/f2226ca3143d45a18be52e49354cc82b/users/ed9a6a7865394aa1be0e2099009abd55/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:08.483533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7941f-6ca6-460f-b336-ffd54a99fb00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2226ca3143d45a18be52e49354cc82b, user_id=ed9a6a7865394aa1be0e2099009abd55, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:08.486313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7941f-6ca6-460f-b336-ffd54a99fb00 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:08.502768 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 915/1831] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:08 2022] PUT /identity/v3/projects/f2226ca3143d45a18be52e49354cc82b/users/ed9a6a7865394aa1be0e2099009abd55/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:08.512779 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d6002-509a-41fe-9eeb-0052333d0d7c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:08.513259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d6002-509a-41fe-9eeb-0052333d0d7c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:08.513342 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d6002-509a-41fe-9eeb-0052333d0d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:08.541114 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-be2d6002-509a-41fe-9eeb-0052333d0d7c None None] MFA Rules not processed for user `ed9a6a7865394aa1be0e2099009abd55`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:08.542355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-be2d6002-509a-41fe-9eeb-0052333d0d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:08.607767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 917/1832] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:08.612120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7941f-6ca6-460f-b336-ffd54a99fb00 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:08.674715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7941f-6ca6-460f-b336-ffd54a99fb00 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:08.679321 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba25296-98bb-445f-8a95-9f0fb4ccae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:08.679977 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba25296-98bb-445f-8a95-9f0fb4ccae05 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:08.680262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba25296-98bb-445f-8a95-9f0fb4ccae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:08.680543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba25296-98bb-445f-8a95-9f0fb4ccae05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:08.681238 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba25296-98bb-445f-8a95-9f0fb4ccae05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:08.683157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba25296-98bb-445f-8a95-9f0fb4ccae05 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:08.709043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 916/1833] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:08 2022] POST /identity/v3/projects => generated 409 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:08.713127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d6002-509a-41fe-9eeb-0052333d0d7c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:08.723579 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d6002-509a-41fe-9eeb-0052333d0d7c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:08.778902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70308e-22e2-4a41-b27b-74a6f3b1f783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:08.779568 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70308e-22e2-4a41-b27b-74a6f3b1f783 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:08.779852 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70308e-22e2-4a41-b27b-74a6f3b1f783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:08.780129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70308e-22e2-4a41-b27b-74a6f3b1f783 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:08.780804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70308e-22e2-4a41-b27b-74a6f3b1f783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:08.782757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70308e-22e2-4a41-b27b-74a6f3b1f783 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:08.805969 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 918/1834] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:08 2022] POST /identity/v3/users => generated 311 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:08.807127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba25296-98bb-445f-8a95-9f0fb4ccae05 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:08.818168 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba25296-98bb-445f-8a95-9f0fb4ccae05 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:08.822880 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04897f8f-22da-46f8-8e9c-1c3f83b11cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:08.823535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04897f8f-22da-46f8-8e9c-1c3f83b11cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:08.823823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04897f8f-22da-46f8-8e9c-1c3f83b11cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:08.824100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04897f8f-22da-46f8-8e9c-1c3f83b11cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:08.824821 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04897f8f-22da-46f8-8e9c-1c3f83b11cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:08.826427 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04897f8f-22da-46f8-8e9c-1c3f83b11cb2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:08.837782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 917/1835] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:08.841793 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70308e-22e2-4a41-b27b-74a6f3b1f783 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:08.851998 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70308e-22e2-4a41-b27b-74a6f3b1f783 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:08.856708 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afb2ef-6900-4759-bf07-368e6e968a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:08.857634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb2ef-6900-4759-bf07-368e6e968a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:08.857921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb2ef-6900-4759-bf07-368e6e968a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:08.858200 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb2ef-6900-4759-bf07-368e6e968a66 admin admin] PATH_INFO: `/v3/projects/9b775d388aca43a08551a5517d7a67bc/users/2de05dfc3e9f4b82bb8c0464ca7add7c/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:08.872830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afb2ef-6900-4759-bf07-368e6e968a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b775d388aca43a08551a5517d7a67bc, user_id=2de05dfc3e9f4b82bb8c0464ca7add7c, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:08.875532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afb2ef-6900-4759-bf07-368e6e968a66 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:08.878671 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:08.890295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 919/1836] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:08 2022] PUT /identity/v3/projects/9b775d388aca43a08551a5517d7a67bc/users/2de05dfc3e9f4b82bb8c0464ca7add7c/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:08.894459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04897f8f-22da-46f8-8e9c-1c3f83b11cb2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:08.905286 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04897f8f-22da-46f8-8e9c-1c3f83b11cb2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:08.913024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:08.963051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a045f-a2ef-43c0-b0cb-8c08144bdf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:08.963637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a045f-a2ef-43c0-b0cb-8c08144bdf9d admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:08.963917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a045f-a2ef-43c0-b0cb-8c08144bdf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:08.964194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a045f-a2ef-43c0-b0cb-8c08144bdf9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:08.964900 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a045f-a2ef-43c0-b0cb-8c08144bdf9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:08.966520 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a045f-a2ef-43c0-b0cb-8c08144bdf9d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:08.976095 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 918/1837] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:10:08.980324 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afb2ef-6900-4759-bf07-368e6e968a66 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:08.991098 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afb2ef-6900-4759-bf07-368e6e968a66 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:08.996116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf86561-a751-4b5f-9f6a-688595fa4992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:08.998296 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf86561-a751-4b5f-9f6a-688595fa4992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:08.998296 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf86561-a751-4b5f-9f6a-688595fa4992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:08.998296 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf86561-a751-4b5f-9f6a-688595fa4992 admin admin] PATH_INFO: `/v3/projects/9b775d388aca43a08551a5517d7a67bc/users/2de05dfc3e9f4b82bb8c0464ca7add7c/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:08.999781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf86561-a751-4b5f-9f6a-688595fa4992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b775d388aca43a08551a5517d7a67bc, user_id=2de05dfc3e9f4b82bb8c0464ca7add7c, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:09.002527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf86561-a751-4b5f-9f6a-688595fa4992 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:09.014163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 920/1838] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:08 2022] PUT /identity/v3/projects/9b775d388aca43a08551a5517d7a67bc/users/2de05dfc3e9f4b82bb8c0464ca7add7c/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:09.026847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db85e84-3a44-477f-8678-ba4f4fefad26 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:09.027214 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db85e84-3a44-477f-8678-ba4f4fefad26 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:09.027499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db85e84-3a44-477f-8678-ba4f4fefad26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:09.056834 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4db85e84-3a44-477f-8678-ba4f4fefad26 None None] MFA Rules not processed for user `2de05dfc3e9f4b82bb8c0464ca7add7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:09.058055 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4db85e84-3a44-477f-8678-ba4f4fefad26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:09.129578 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 919/1839] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:09 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:09.138146 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf86561-a751-4b5f-9f6a-688595fa4992 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:09.139866 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dcf86561-a751-4b5f-9f6a-688595fa4992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:09.199764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf86561-a751-4b5f-9f6a-688595fa4992 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:09.204043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2d8e8-1a97-4fc7-ae78-cbe6b194ff8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:09.204848 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2d8e8-1a97-4fc7-ae78-cbe6b194ff8b service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:09.205334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2d8e8-1a97-4fc7-ae78-cbe6b194ff8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:09.205698 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2d8e8-1a97-4fc7-ae78-cbe6b194ff8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:09.215911 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2d8e8-1a97-4fc7-ae78-cbe6b194ff8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:09.217278 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2d8e8-1a97-4fc7-ae78-cbe6b194ff8b service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:09.227655 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 921/1840] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:09 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:09.385011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db85e84-3a44-477f-8678-ba4f4fefad26 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:09.394441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db85e84-3a44-477f-8678-ba4f4fefad26 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:09.397974 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1304f9-f86d-4a2f-91fa-18935050b78a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:09.398598 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1304f9-f86d-4a2f-91fa-18935050b78a service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:09.398875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1304f9-f86d-4a2f-91fa-18935050b78a service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:09.399146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1304f9-f86d-4a2f-91fa-18935050b78a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:09.455267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1304f9-f86d-4a2f-91fa-18935050b78a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:09.456701 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1304f9-f86d-4a2f-91fa-18935050b78a service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:09.466129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 920/1841] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:19.222579 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:19.462106 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=86 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:30.264181 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2d8e8-1a97-4fc7-ae78-cbe6b194ff8b service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:30.353171 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2d8e8-1a97-4fc7-ae78-cbe6b194ff8b service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:30.359513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a332fe0-601b-420a-8580-041b93f28a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:30.360576 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a332fe0-601b-420a-8580-041b93f28a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:30.360700 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a332fe0-601b-420a-8580-041b93f28a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:30.360977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a332fe0-601b-420a-8580-041b93f28a4e admin admin] PATH_INFO: `/v3/users/ed9a6a7865394aa1be0e2099009abd55` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:30.364746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a332fe0-601b-420a-8580-041b93f28a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed9a6a7865394aa1be0e2099009abd55)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:30.364746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a332fe0-601b-420a-8580-041b93f28a4e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:30.423756 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a332fe0-601b-420a-8580-041b93f28a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed9a6a7865394aa1be0e2099009abd55'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:30.436010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a332fe0-601b-420a-8580-041b93f28a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed9a6a7865394aa1be0e2099009abd55'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:30.436684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a332fe0-601b-420a-8580-041b93f28a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed9a6a7865394aa1be0e2099009abd55'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:30.437290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a332fe0-601b-420a-8580-041b93f28a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed9a6a7865394aa1be0e2099009abd55'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:30.445761 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a332fe0-601b-420a-8580-041b93f28a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed9a6a7865394aa1be0e2099009abd55'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:30.461032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 922/1842] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:30 2022] DELETE /identity/v3/users/ed9a6a7865394aa1be0e2099009abd55 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:30.463466 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5012ef-2922-4229-8e25-1bcac28a9692 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:30.463938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5012ef-2922-4229-8e25-1bcac28a9692 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:30.464029 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5012ef-2922-4229-8e25-1bcac28a9692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:30.481264 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cd5012ef-2922-4229-8e25-1bcac28a9692 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:30.482538 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cd5012ef-2922-4229-8e25-1bcac28a9692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:30.554000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 921/1843] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:30.563934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a332fe0-601b-420a-8580-041b93f28a4e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:30.565636 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0a332fe0-601b-420a-8580-041b93f28a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:30.631462 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a332fe0-601b-420a-8580-041b93f28a4e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:30.635659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd362cf-a32f-4a2e-b190-8dc8ba4a22ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:30.636319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd362cf-a32f-4a2e-b190-8dc8ba4a22ef service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:30.636609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd362cf-a32f-4a2e-b190-8dc8ba4a22ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:30.636887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd362cf-a32f-4a2e-b190-8dc8ba4a22ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:30.646803 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd362cf-a32f-4a2e-b190-8dc8ba4a22ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:30.648247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd362cf-a32f-4a2e-b190-8dc8ba4a22ef service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:30.659790 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 923/1844] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:10:31.151599 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5012ef-2922-4229-8e25-1bcac28a9692 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:31.153096 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cd5012ef-2922-4229-8e25-1bcac28a9692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:31.167684 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5012ef-2922-4229-8e25-1bcac28a9692 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:31.173190 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec14190-f559-46fb-b89b-0231919233de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:31.174392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec14190-f559-46fb-b89b-0231919233de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:31.174815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec14190-f559-46fb-b89b-0231919233de admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:31.175329 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec14190-f559-46fb-b89b-0231919233de admin admin] PATH_INFO: `/v3/projects/f2226ca3143d45a18be52e49354cc82b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:31.176669 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec14190-f559-46fb-b89b-0231919233de admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2226ca3143d45a18be52e49354cc82b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:31.179167 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec14190-f559-46fb-b89b-0231919233de admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:31.234127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-eec14190-f559-46fb-b89b-0231919233de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2226ca3143d45a18be52e49354cc82b', 'request_id': 'req-eec14190-f559-46fb-b89b-0231919233de'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:31.241117 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-eec14190-f559-46fb-b89b-0231919233de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2226ca3143d45a18be52e49354cc82b', 'request_id': 'req-eec14190-f559-46fb-b89b-0231919233de'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:31.246800 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-eec14190-f559-46fb-b89b-0231919233de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2226ca3143d45a18be52e49354cc82b', 'request_id': 'req-eec14190-f559-46fb-b89b-0231919233de'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:31.261903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-eec14190-f559-46fb-b89b-0231919233de admin admin] The token cache is being invalidate because project f2226ca3143d45a18be52e49354cc82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:31.262196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-eec14190-f559-46fb-b89b-0231919233de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:31.262818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-eec14190-f559-46fb-b89b-0231919233de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:31.264394 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 922/1845] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:31 2022] DELETE /identity/v3/projects/f2226ca3143d45a18be52e49354cc82b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:31.268571 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd362cf-a32f-4a2e-b190-8dc8ba4a22ef service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:31.278375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd362cf-a32f-4a2e-b190-8dc8ba4a22ef service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:31.297307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:31.342798 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f2cad-ec10-46f0-8fb3-e5020d2b6d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:31.345321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f2cad-ec10-46f0-8fb3-e5020d2b6d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:31.345653 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f2cad-ec10-46f0-8fb3-e5020d2b6d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:31.345937 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f2cad-ec10-46f0-8fb3-e5020d2b6d2b admin admin] PATH_INFO: `/v3/users/2de05dfc3e9f4b82bb8c0464ca7add7c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:31.347679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f2cad-ec10-46f0-8fb3-e5020d2b6d2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de05dfc3e9f4b82bb8c0464ca7add7c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:31.350747 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f2cad-ec10-46f0-8fb3-e5020d2b6d2b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:31.423349 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ec7f2cad-ec10-46f0-8fb3-e5020d2b6d2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de05dfc3e9f4b82bb8c0464ca7add7c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:31.441110 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ec7f2cad-ec10-46f0-8fb3-e5020d2b6d2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de05dfc3e9f4b82bb8c0464ca7add7c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:31.442246 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ec7f2cad-ec10-46f0-8fb3-e5020d2b6d2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de05dfc3e9f4b82bb8c0464ca7add7c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:31.442946 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ec7f2cad-ec10-46f0-8fb3-e5020d2b6d2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de05dfc3e9f4b82bb8c0464ca7add7c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:31.455160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ec7f2cad-ec10-46f0-8fb3-e5020d2b6d2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de05dfc3e9f4b82bb8c0464ca7add7c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:31.473048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 924/1846] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:31 2022] DELETE /identity/v3/users/2de05dfc3e9f4b82bb8c0464ca7add7c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:31.947786 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec14190-f559-46fb-b89b-0231919233de admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:31.949838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-eec14190-f559-46fb-b89b-0231919233de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:31.976278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec14190-f559-46fb-b89b-0231919233de admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:32.008513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f2cad-ec10-46f0-8fb3-e5020d2b6d2b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:32.015372 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ec7f2cad-ec10-46f0-8fb3-e5020d2b6d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:32.050354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a8655-b82d-41df-b8cd-e2b4f20086d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:32.051313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a8655-b82d-41df-b8cd-e2b4f20086d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:32.051925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a8655-b82d-41df-b8cd-e2b4f20086d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:32.052404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a8655-b82d-41df-b8cd-e2b4f20086d1 admin admin] PATH_INFO: `/v3/projects/9b775d388aca43a08551a5517d7a67bc` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:32.054127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a8655-b82d-41df-b8cd-e2b4f20086d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b775d388aca43a08551a5517d7a67bc)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:32.056576 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a8655-b82d-41df-b8cd-e2b4f20086d1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:32.100723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f2cad-ec10-46f0-8fb3-e5020d2b6d2b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:32.109384 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038efc56-2e32-497b-a039-cababec15685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:32.110176 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038efc56-2e32-497b-a039-cababec15685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:32.110458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038efc56-2e32-497b-a039-cababec15685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:32.110736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038efc56-2e32-497b-a039-cababec15685 admin admin] PATH_INFO: `/v3/users/6338ad7870224e649de91bbe05122a28` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:32.112209 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038efc56-2e32-497b-a039-cababec15685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6338ad7870224e649de91bbe05122a28)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:32.114453 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038efc56-2e32-497b-a039-cababec15685 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:32.122333 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:32.157009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-324a8655-b82d-41df-b8cd-e2b4f20086d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b775d388aca43a08551a5517d7a67bc', 'request_id': 'req-324a8655-b82d-41df-b8cd-e2b4f20086d1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:32.164107 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-324a8655-b82d-41df-b8cd-e2b4f20086d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b775d388aca43a08551a5517d7a67bc', 'request_id': 'req-324a8655-b82d-41df-b8cd-e2b4f20086d1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:32.171512 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-324a8655-b82d-41df-b8cd-e2b4f20086d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b775d388aca43a08551a5517d7a67bc', 'request_id': 'req-324a8655-b82d-41df-b8cd-e2b4f20086d1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:32.188436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:32.189285 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-038efc56-2e32-497b-a039-cababec15685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6338ad7870224e649de91bbe05122a28'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:32.205781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-324a8655-b82d-41df-b8cd-e2b4f20086d1 admin admin] The token cache is being invalidate because project 9b775d388aca43a08551a5517d7a67bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:32.206118 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-324a8655-b82d-41df-b8cd-e2b4f20086d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:32.207041 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-038efc56-2e32-497b-a039-cababec15685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6338ad7870224e649de91bbe05122a28'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:32.207659 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-324a8655-b82d-41df-b8cd-e2b4f20086d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:32.208395 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-038efc56-2e32-497b-a039-cababec15685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6338ad7870224e649de91bbe05122a28'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:32.209882 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-038efc56-2e32-497b-a039-cababec15685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6338ad7870224e649de91bbe05122a28'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:32.211229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 923/1847] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:31 2022] DELETE /identity/v3/projects/9b775d388aca43a08551a5517d7a67bc => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:32.215869 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df03e76-5242-4acd-814d-37ff4209bbb5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:32.216155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df03e76-5242-4acd-814d-37ff4209bbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:32.216760 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df03e76-5242-4acd-814d-37ff4209bbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:32.227161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-038efc56-2e32-497b-a039-cababec15685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6338ad7870224e649de91bbe05122a28'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:32.237919 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2df03e76-5242-4acd-814d-37ff4209bbb5 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:32.239129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2df03e76-5242-4acd-814d-37ff4209bbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:32.248832 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 925/1848] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:32 2022] DELETE /identity/v3/users/6338ad7870224e649de91bbe05122a28 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:32.253389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd90fd5-f20d-4b8c-a6a5-b5091b611299 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:32.253810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd90fd5-f20d-4b8c-a6a5-b5091b611299 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:32.254137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd90fd5-f20d-4b8c-a6a5-b5091b611299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:32.296911 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cfd90fd5-f20d-4b8c-a6a5-b5091b611299 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:32.298151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cfd90fd5-f20d-4b8c-a6a5-b5091b611299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:32.326578 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 924/1849] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:10:32.335211 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6b289-7a79-4fb2-90b2-e05df520d5c4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:32.335566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6b289-7a79-4fb2-90b2-e05df520d5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:32.335911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6b289-7a79-4fb2-90b2-e05df520d5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:32.361249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-29f6b289-7a79-4fb2-90b2-e05df520d5c4 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:32.363667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-29f6b289-7a79-4fb2-90b2-e05df520d5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:32.414093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 926/1850] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:32.423806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd90fd5-f20d-4b8c-a6a5-b5091b611299 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:32.425739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cfd90fd5-f20d-4b8c-a6a5-b5091b611299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:32.458116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 925/1851] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:32.477609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6b289-7a79-4fb2-90b2-e05df520d5c4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:32.488431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6b289-7a79-4fb2-90b2-e05df520d5c4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:32.494186 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf86085-584f-419c-b41b-e128521d94c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:32.494862 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf86085-584f-419c-b41b-e128521d94c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:32.495143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf86085-584f-419c-b41b-e128521d94c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:32.495414 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf86085-584f-419c-b41b-e128521d94c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:32.496407 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf86085-584f-419c-b41b-e128521d94c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:10:32.496860 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf86085-584f-419c-b41b-e128521d94c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:32.498667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf86085-584f-419c-b41b-e128521d94c6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:32.501094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd90fd5-f20d-4b8c-a6a5-b5091b611299 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:32.504987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f77fa4-6bc2-4678-8d14-622dddc2eb77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:32.506298 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f77fa4-6bc2-4678-8d14-622dddc2eb77 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:32.506655 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f77fa4-6bc2-4678-8d14-622dddc2eb77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:32.507004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f77fa4-6bc2-4678-8d14-622dddc2eb77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:32.513325 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 926/1852] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:10:32.518409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f77fa4-6bc2-4678-8d14-622dddc2eb77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:32.518550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf86085-584f-419c-b41b-e128521d94c6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:32.520076 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f77fa4-6bc2-4678-8d14-622dddc2eb77 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:32.528785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf86085-584f-419c-b41b-e128521d94c6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:32.531047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 927/1853] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:10:32.537225 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879031f-c852-46f1-a861-fc15aa385f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:32.537225 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879031f-c852-46f1-a861-fc15aa385f6d admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:32.537225 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879031f-c852-46f1-a861-fc15aa385f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:32.537225 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879031f-c852-46f1-a861-fc15aa385f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:32.537591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879031f-c852-46f1-a861-fc15aa385f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:32.538893 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879031f-c852-46f1-a861-fc15aa385f6d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:32.569285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 927/1854] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:32 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:32.573300 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f77fa4-6bc2-4678-8d14-622dddc2eb77 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:32.587245 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f77fa4-6bc2-4678-8d14-622dddc2eb77 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:32.650827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494992e-dc24-4844-ae05-bb2c03eb1376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:32.651609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494992e-dc24-4844-ae05-bb2c03eb1376 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:32.651890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494992e-dc24-4844-ae05-bb2c03eb1376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:32.652249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494992e-dc24-4844-ae05-bb2c03eb1376 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:32.652946 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494992e-dc24-4844-ae05-bb2c03eb1376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:32.655219 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494992e-dc24-4844-ae05-bb2c03eb1376 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:32.664640 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:32.684031 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 928/1855] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:32 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:32.687375 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879031f-c852-46f1-a861-fc15aa385f6d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:32.709189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879031f-c852-46f1-a861-fc15aa385f6d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:32.714302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ac250-da53-44f5-a66c-b27b976461b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:32.715004 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ac250-da53-44f5-a66c-b27b976461b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:32.715416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ac250-da53-44f5-a66c-b27b976461b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:32.715701 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ac250-da53-44f5-a66c-b27b976461b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:32.716433 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ac250-da53-44f5-a66c-b27b976461b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:32.718133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ac250-da53-44f5-a66c-b27b976461b5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:32.730444 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 928/1856] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:32.734321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494992e-dc24-4844-ae05-bb2c03eb1376 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:32.747582 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494992e-dc24-4844-ae05-bb2c03eb1376 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:32.752923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527dde6-ce43-43ed-9f48-578e909a4e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:32.753633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527dde6-ce43-43ed-9f48-578e909a4e62 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:32.753919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527dde6-ce43-43ed-9f48-578e909a4e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:32.754195 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527dde6-ce43-43ed-9f48-578e909a4e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:32.754928 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527dde6-ce43-43ed-9f48-578e909a4e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:32.756605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527dde6-ce43-43ed-9f48-578e909a4e62 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:32.772350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 929/1857] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:32.774145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ac250-da53-44f5-a66c-b27b976461b5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:32.785596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ac250-da53-44f5-a66c-b27b976461b5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:32.791709 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7f410-84b5-42be-848e-a8c483268929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:32.792633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7f410-84b5-42be-848e-a8c483268929 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:32.792914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7f410-84b5-42be-848e-a8c483268929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:32.793190 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7f410-84b5-42be-848e-a8c483268929 admin admin] PATH_INFO: `/v3/projects/8d1321327d054e57a1320753aca0e7f6/users/23add73f92ae4c4986bc7b4255438bb3/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:32.797294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:32.811459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7f410-84b5-42be-848e-a8c483268929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1321327d054e57a1320753aca0e7f6, user_id=23add73f92ae4c4986bc7b4255438bb3, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:32.814575 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7f410-84b5-42be-848e-a8c483268929 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:32.842066 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527dde6-ce43-43ed-9f48-578e909a4e62 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:32.844645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 929/1858] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:32 2022] PUT /identity/v3/projects/8d1321327d054e57a1320753aca0e7f6/users/23add73f92ae4c4986bc7b4255438bb3/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:32.849856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8527dde6-ce43-43ed-9f48-578e909a4e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:32.857248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0d37-d667-45a6-9c38-86822b881bc6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:32.857837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0d37-d667-45a6-9c38-86822b881bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:32.858122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0d37-d667-45a6-9c38-86822b881bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:32.876714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527dde6-ce43-43ed-9f48-578e909a4e62 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:32.906365 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5abf0d37-d667-45a6-9c38-86822b881bc6 None None] MFA Rules not processed for user `23add73f92ae4c4986bc7b4255438bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:32.907477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5abf0d37-d667-45a6-9c38-86822b881bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:32.948822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:32.949720 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:32.950010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:32.950293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8 admin admin] PATH_INFO: `/v3/projects/956623cc467b4b78bdae893ef4dec5df` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:32.951550 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=956623cc467b4b78bdae893ef4dec5df)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:32.953896 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:32.996978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 930/1859] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:32.998099 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf0d37-d667-45a6-9c38-86822b881bc6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:33.011410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf0d37-d667-45a6-9c38-86822b881bc6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:33.012157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956623cc467b4b78bdae893ef4dec5df', 'request_id': 'req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:33.019945 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956623cc467b4b78bdae893ef4dec5df', 'request_id': 'req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:33.028925 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956623cc467b4b78bdae893ef4dec5df', 'request_id': 'req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:33.041879 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8 admin admin] The token cache is being invalidate because project 956623cc467b4b78bdae893ef4dec5df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:33.042169 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:33.042838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:33.044379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 930/1860] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:32 2022] DELETE /identity/v3/projects/956623cc467b4b78bdae893ef4dec5df => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:33.048048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:33.049346 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:33.081563 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eb248-f9db-4e5e-85a7-6924fd55c521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:33.082218 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb248-f9db-4e5e-85a7-6924fd55c521 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:33.082497 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb248-f9db-4e5e-85a7-6924fd55c521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:33.082796 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb248-f9db-4e5e-85a7-6924fd55c521 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:33.084634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328eb248-f9db-4e5e-85a7-6924fd55c521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:33.085876 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328eb248-f9db-4e5e-85a7-6924fd55c521 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:33.113832 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 931/1861] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:32 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:33.114005 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08f91d-787d-4d30-b3eb-ae179bb2a3e8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:33.115232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eb248-f9db-4e5e-85a7-6924fd55c521 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:33.116892 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-328eb248-f9db-4e5e-85a7-6924fd55c521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:33.129854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:33.173976 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff54815-839a-42b5-a081-4ed15cd69df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:33.174763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff54815-839a-42b5-a081-4ed15cd69df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:33.175046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff54815-839a-42b5-a081-4ed15cd69df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:33.175872 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff54815-839a-42b5-a081-4ed15cd69df3 admin admin] PATH_INFO: `/v3/users/8a4d431e58e14d22bad7ecbd70d5b09c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:33.177067 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff54815-839a-42b5-a081-4ed15cd69df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a4d431e58e14d22bad7ecbd70d5b09c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:33.179056 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff54815-839a-42b5-a081-4ed15cd69df3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:33.184441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eb248-f9db-4e5e-85a7-6924fd55c521 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:33.186498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a4fab-45af-4fe5-887c-b3f657422e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:33.187170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a4fab-45af-4fe5-887c-b3f657422e81 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:33.187451 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a4fab-45af-4fe5-887c-b3f657422e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:33.187726 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a4fab-45af-4fe5-887c-b3f657422e81 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:33.188416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a4fab-45af-4fe5-887c-b3f657422e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:33.190358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a4fab-45af-4fe5-887c-b3f657422e81 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:33.198955 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:33.214614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 932/1862] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:33 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:10:33.218362 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a4fab-45af-4fe5-887c-b3f657422e81 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:33.228760 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a4fab-45af-4fe5-887c-b3f657422e81 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:33.228905 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dff54815-839a-42b5-a081-4ed15cd69df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a4d431e58e14d22bad7ecbd70d5b09c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:33.233512 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d8b61-3267-4817-9af7-52877fa8afe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:33.234160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d8b61-3267-4817-9af7-52877fa8afe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:33.234448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d8b61-3267-4817-9af7-52877fa8afe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:33.234728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d8b61-3267-4817-9af7-52877fa8afe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:33.235466 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d8b61-3267-4817-9af7-52877fa8afe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:33.237054 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d8b61-3267-4817-9af7-52877fa8afe1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:33.241284 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dff54815-839a-42b5-a081-4ed15cd69df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a4d431e58e14d22bad7ecbd70d5b09c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:33.241985 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dff54815-839a-42b5-a081-4ed15cd69df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a4d431e58e14d22bad7ecbd70d5b09c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:33.242609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dff54815-839a-42b5-a081-4ed15cd69df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a4d431e58e14d22bad7ecbd70d5b09c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:33.251148 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 933/1863] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:10:33.251291 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dff54815-839a-42b5-a081-4ed15cd69df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a4d431e58e14d22bad7ecbd70d5b09c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:33.252150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d8b61-3267-4817-9af7-52877fa8afe1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:33.253994 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b18d8b61-3267-4817-9af7-52877fa8afe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:33.263690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 931/1864] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:33 2022] DELETE /identity/v3/users/8a4d431e58e14d22bad7ecbd70d5b09c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:33.266852 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d8b61-3267-4817-9af7-52877fa8afe1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:33.327510 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0923c70-8222-464c-a71b-bc5b0f903993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:33.328786 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0923c70-8222-464c-a71b-bc5b0f903993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:33.328786 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0923c70-8222-464c-a71b-bc5b0f903993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:33.329021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0923c70-8222-464c-a71b-bc5b0f903993 admin admin] PATH_INFO: `/v3/projects/eb98e6e772c940c796e1006c08a13c62/users/5105679312b940dd802d4a6c6ea5525a/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:33.345657 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0923c70-8222-464c-a71b-bc5b0f903993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb98e6e772c940c796e1006c08a13c62, user_id=5105679312b940dd802d4a6c6ea5525a, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:33.348555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0923c70-8222-464c-a71b-bc5b0f903993 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:33.363482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 934/1865] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:33 2022] PUT /identity/v3/projects/eb98e6e772c940c796e1006c08a13c62/users/5105679312b940dd802d4a6c6ea5525a/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:33.370059 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff54815-839a-42b5-a081-4ed15cd69df3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:33.383670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff54815-839a-42b5-a081-4ed15cd69df3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:33.460048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d177c6-f773-4f34-958d-a22ee3c6ee27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:33.460873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d177c6-f773-4f34-958d-a22ee3c6ee27 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:33.461169 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d177c6-f773-4f34-958d-a22ee3c6ee27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:33.461530 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d177c6-f773-4f34-958d-a22ee3c6ee27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:33.462331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d177c6-f773-4f34-958d-a22ee3c6ee27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:33.464038 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d177c6-f773-4f34-958d-a22ee3c6ee27 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:33.475325 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 932/1866] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:33.479551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0923c70-8222-464c-a71b-bc5b0f903993 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:33.493036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0923c70-8222-464c-a71b-bc5b0f903993 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:33.500253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c71ec-db69-40cc-a96d-d17284824526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:33.501531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c71ec-db69-40cc-a96d-d17284824526 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:33.501916 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c71ec-db69-40cc-a96d-d17284824526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:33.502295 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c71ec-db69-40cc-a96d-d17284824526 admin admin] PATH_INFO: `/v3/projects/eb98e6e772c940c796e1006c08a13c62/users/5105679312b940dd802d4a6c6ea5525a/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:33.506089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c71ec-db69-40cc-a96d-d17284824526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb98e6e772c940c796e1006c08a13c62, user_id=5105679312b940dd802d4a6c6ea5525a, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:33.510408 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c71ec-db69-40cc-a96d-d17284824526 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:33.535490 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 935/1867] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:33 2022] PUT /identity/v3/projects/eb98e6e772c940c796e1006c08a13c62/users/5105679312b940dd802d4a6c6ea5525a/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:33.537430 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a8021-451d-48d0-864d-7d69d572be43 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:33.537735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a8021-451d-48d0-864d-7d69d572be43 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:33.538052 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a8021-451d-48d0-864d-7d69d572be43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:33.569803 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-de9a8021-451d-48d0-864d-7d69d572be43 None None] MFA Rules not processed for user `5105679312b940dd802d4a6c6ea5525a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:33.571017 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-de9a8021-451d-48d0-864d-7d69d572be43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:33.583686 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c71ec-db69-40cc-a96d-d17284824526 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:33.585516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cf2c71ec-db69-40cc-a96d-d17284824526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:33.600211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:33.662692 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 933/1868] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:33.675321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a8021-451d-48d0-864d-7d69d572be43 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:33.676742 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-de9a8021-451d-48d0-864d-7d69d572be43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:33.690377 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c71ec-db69-40cc-a96d-d17284824526 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:33.695644 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54310c33-7a1b-4957-af9f-853ee5203de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:33.696641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54310c33-7a1b-4957-af9f-853ee5203de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:33.696928 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54310c33-7a1b-4957-af9f-853ee5203de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:33.697208 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54310c33-7a1b-4957-af9f-853ee5203de6 admin admin] PATH_INFO: `/v3/projects/f1ba7cf6b03c490e87bc0fe569b4fe27` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:33.698520 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54310c33-7a1b-4957-af9f-853ee5203de6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1ba7cf6b03c490e87bc0fe569b4fe27)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:33.700597 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54310c33-7a1b-4957-af9f-853ee5203de6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:33.741683 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a8021-451d-48d0-864d-7d69d572be43 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:33.749725 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-54310c33-7a1b-4957-af9f-853ee5203de6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1ba7cf6b03c490e87bc0fe569b4fe27', 'request_id': 'req-54310c33-7a1b-4957-af9f-853ee5203de6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:33.751347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:33.757839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-54310c33-7a1b-4957-af9f-853ee5203de6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1ba7cf6b03c490e87bc0fe569b4fe27', 'request_id': 'req-54310c33-7a1b-4957-af9f-853ee5203de6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:33.769272 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-54310c33-7a1b-4957-af9f-853ee5203de6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1ba7cf6b03c490e87bc0fe569b4fe27', 'request_id': 'req-54310c33-7a1b-4957-af9f-853ee5203de6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:33.787291 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-54310c33-7a1b-4957-af9f-853ee5203de6 admin admin] The token cache is being invalidate because project f1ba7cf6b03c490e87bc0fe569b4fe27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:33.787658 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-54310c33-7a1b-4957-af9f-853ee5203de6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:33.788392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-54310c33-7a1b-4957-af9f-853ee5203de6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:33.790098 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 936/1869] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:33 2022] DELETE /identity/v3/projects/f1ba7cf6b03c490e87bc0fe569b4fe27 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:33.794702 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bf623-dd8b-4496-bd9c-a3247ad7b174 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:33.795048 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bf623-dd8b-4496-bd9c-a3247ad7b174 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:33.795329 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bf623-dd8b-4496-bd9c-a3247ad7b174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:33.796924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7d7c7-9503-4a7c-b2d5-4b0c612d4834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:33.797608 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7d7c7-9503-4a7c-b2d5-4b0c612d4834 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:33.797890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7d7c7-9503-4a7c-b2d5-4b0c612d4834 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:33.798165 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7d7c7-9503-4a7c-b2d5-4b0c612d4834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:33.799948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5ac7d7c7-9503-4a7c-b2d5-4b0c612d4834 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:33.813244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-097bf623-dd8b-4496-bd9c-a3247ad7b174 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:33.814441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-097bf623-dd8b-4496-bd9c-a3247ad7b174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:33.862005 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7d7c7-9503-4a7c-b2d5-4b0c612d4834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:33.863451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7d7c7-9503-4a7c-b2d5-4b0c612d4834 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:33.872903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 934/1870] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:33.873027 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 937/1871] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:10:33.880527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f24b0-b1f4-4deb-bb5c-977cc0fd06d3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:33.880815 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f24b0-b1f4-4deb-bb5c-977cc0fd06d3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:33.881094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f24b0-b1f4-4deb-bb5c-977cc0fd06d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:33.900980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bf3f24b0-b1f4-4deb-bb5c-977cc0fd06d3 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:33.902369 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bf3f24b0-b1f4-4deb-bb5c-977cc0fd06d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:33.913821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 935/1872] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:33.920301 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bf623-dd8b-4496-bd9c-a3247ad7b174 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:33.930763 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bf623-dd8b-4496-bd9c-a3247ad7b174 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:33.935731 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a9893-9787-4f27-b5fd-b89f9190d23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:33.936403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a9893-9787-4f27-b5fd-b89f9190d23d admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:33.936721 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a9893-9787-4f27-b5fd-b89f9190d23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:33.937097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a9893-9787-4f27-b5fd-b89f9190d23d admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:33.937860 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a9893-9787-4f27-b5fd-b89f9190d23d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:10:33.938169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a9893-9787-4f27-b5fd-b89f9190d23d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:33.939761 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a9893-9787-4f27-b5fd-b89f9190d23d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:33.957557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 938/1873] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:10:33.958817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f24b0-b1f4-4deb-bb5c-977cc0fd06d3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:33.968277 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f24b0-b1f4-4deb-bb5c-977cc0fd06d3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:33.977687 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a9893-9787-4f27-b5fd-b89f9190d23d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:33.977833 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed756c41-b523-491f-b577-29ec698aa382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:33.978379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed756c41-b523-491f-b577-29ec698aa382 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:33.978686 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed756c41-b523-491f-b577-29ec698aa382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:33.978920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed756c41-b523-491f-b577-29ec698aa382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:33.979608 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed756c41-b523-491f-b577-29ec698aa382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:33.979785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-595a9893-9787-4f27-b5fd-b89f9190d23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:33.981528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed756c41-b523-491f-b577-29ec698aa382 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:33.994412 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a9893-9787-4f27-b5fd-b89f9190d23d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:33.998391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867db9dc-eefe-43e9-8950-cf5622b2bb93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:33.998948 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867db9dc-eefe-43e9-8950-cf5622b2bb93 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:33.999118 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867db9dc-eefe-43e9-8950-cf5622b2bb93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:33.999420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867db9dc-eefe-43e9-8950-cf5622b2bb93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:34.001574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-867db9dc-eefe-43e9-8950-cf5622b2bb93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:34.006014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:34.017340 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 936/1874] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:33 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:34.018442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed756c41-b523-491f-b577-29ec698aa382 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:34.089482 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed756c41-b523-491f-b577-29ec698aa382 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:34.094151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84844ad-67c4-444b-bc8c-af8e19f604ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:34.094819 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84844ad-67c4-444b-bc8c-af8e19f604ae admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:34.095099 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84844ad-67c4-444b-bc8c-af8e19f604ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:34.095371 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84844ad-67c4-444b-bc8c-af8e19f604ae admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:34.096050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84844ad-67c4-444b-bc8c-af8e19f604ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:34.097997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84844ad-67c4-444b-bc8c-af8e19f604ae admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:34.101766 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867db9dc-eefe-43e9-8950-cf5622b2bb93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:34.102775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867db9dc-eefe-43e9-8950-cf5622b2bb93 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:34.119974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 937/1875] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:34 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:34.121525 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 939/1876] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:10:34.123883 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84844ad-67c4-444b-bc8c-af8e19f604ae admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:34.141137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84844ad-67c4-444b-bc8c-af8e19f604ae admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:34.146475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b192714-9bb0-48c0-9bc4-3a14b1c28dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:34.147153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b192714-9bb0-48c0-9bc4-3a14b1c28dea admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:34.147621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b192714-9bb0-48c0-9bc4-3a14b1c28dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:34.147902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b192714-9bb0-48c0-9bc4-3a14b1c28dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:34.148641 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b192714-9bb0-48c0-9bc4-3a14b1c28dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:34.150364 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b192714-9bb0-48c0-9bc4-3a14b1c28dea admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:34.164581 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 938/1877] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:34.165983 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867db9dc-eefe-43e9-8950-cf5622b2bb93 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:34.186546 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867db9dc-eefe-43e9-8950-cf5622b2bb93 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:34.194106 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297578a-eb9c-4ce3-aa72-91219c267b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:34.194784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297578a-eb9c-4ce3-aa72-91219c267b8b admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:34.195066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297578a-eb9c-4ce3-aa72-91219c267b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:34.195341 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297578a-eb9c-4ce3-aa72-91219c267b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:34.198246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297578a-eb9c-4ce3-aa72-91219c267b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:34.199849 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297578a-eb9c-4ce3-aa72-91219c267b8b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:34.211103 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 940/1878] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:34.215313 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b192714-9bb0-48c0-9bc4-3a14b1c28dea admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:34.237500 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b192714-9bb0-48c0-9bc4-3a14b1c28dea admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:34.243486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d42f85-eca4-4f98-b2dd-b27e53159841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:34.244371 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d42f85-eca4-4f98-b2dd-b27e53159841 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:34.244652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d42f85-eca4-4f98-b2dd-b27e53159841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:34.244928 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d42f85-eca4-4f98-b2dd-b27e53159841 admin admin] PATH_INFO: `/v3/projects/a19d4a9022f84010a73d2f26e1600d70/users/99c1b845b191441a8bb36035d86971c2/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:34.380708 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d42f85-eca4-4f98-b2dd-b27e53159841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19d4a9022f84010a73d2f26e1600d70, user_id=99c1b845b191441a8bb36035d86971c2, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:34.383366 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d42f85-eca4-4f98-b2dd-b27e53159841 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:34.398263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 939/1879] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:34 2022] PUT /identity/v3/projects/a19d4a9022f84010a73d2f26e1600d70/users/99c1b845b191441a8bb36035d86971c2/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:34.408877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05fde0-4d84-411b-8ea4-6b88bf7cea75 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:34.409292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05fde0-4d84-411b-8ea4-6b88bf7cea75 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:34.409535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05fde0-4d84-411b-8ea4-6b88bf7cea75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:34.421999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d42f85-eca4-4f98-b2dd-b27e53159841 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:34.423703 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-64d42f85-eca4-4f98-b2dd-b27e53159841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:34.437348 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ea05fde0-4d84-411b-8ea4-6b88bf7cea75 None None] MFA Rules not processed for user `99c1b845b191441a8bb36035d86971c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:34.438566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ea05fde0-4d84-411b-8ea4-6b88bf7cea75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:34.481053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:34.488101 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d42f85-eca4-4f98-b2dd-b27e53159841 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:34.493956 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ac294-122a-4086-a24c-cbab40dfae40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:34.494819 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ac294-122a-4086-a24c-cbab40dfae40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:34.495099 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ac294-122a-4086-a24c-cbab40dfae40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:34.495379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ac294-122a-4086-a24c-cbab40dfae40 admin admin] PATH_INFO: `/v3/users/23add73f92ae4c4986bc7b4255438bb3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:34.496576 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ac294-122a-4086-a24c-cbab40dfae40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23add73f92ae4c4986bc7b4255438bb3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:34.498546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ac294-122a-4086-a24c-cbab40dfae40 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:34.507291 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 941/1880] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:34.511580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05fde0-4d84-411b-8ea4-6b88bf7cea75 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:34.522606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05fde0-4d84-411b-8ea4-6b88bf7cea75 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:34.528445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4661c2-ebb7-41c0-a352-b3f87966e5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:34.529275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4661c2-ebb7-41c0-a352-b3f87966e5ab admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:34.529581 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4661c2-ebb7-41c0-a352-b3f87966e5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:34.529846 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4661c2-ebb7-41c0-a352-b3f87966e5ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:34.530527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4661c2-ebb7-41c0-a352-b3f87966e5ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:34.532588 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4661c2-ebb7-41c0-a352-b3f87966e5ab admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:34.552489 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8f5ac294-122a-4086-a24c-cbab40dfae40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23add73f92ae4c4986bc7b4255438bb3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:34.558666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:34.563685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 942/1881] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:34 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:10:34.567879 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4661c2-ebb7-41c0-a352-b3f87966e5ab admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:34.569667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8f5ac294-122a-4086-a24c-cbab40dfae40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23add73f92ae4c4986bc7b4255438bb3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:34.571299 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8f5ac294-122a-4086-a24c-cbab40dfae40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23add73f92ae4c4986bc7b4255438bb3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:34.572313 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8f5ac294-122a-4086-a24c-cbab40dfae40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23add73f92ae4c4986bc7b4255438bb3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:34.581916 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8f5ac294-122a-4086-a24c-cbab40dfae40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23add73f92ae4c4986bc7b4255438bb3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:34.597248 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 940/1882] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:34 2022] DELETE /identity/v3/users/23add73f92ae4c4986bc7b4255438bb3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:34.601955 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85555b9-17f2-4b12-a44c-0f341c12f269 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:34.602326 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85555b9-17f2-4b12-a44c-0f341c12f269 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:34.602672 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85555b9-17f2-4b12-a44c-0f341c12f269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:34.621279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d85555b9-17f2-4b12-a44c-0f341c12f269 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:34.622926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d85555b9-17f2-4b12-a44c-0f341c12f269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:34.645402 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4661c2-ebb7-41c0-a352-b3f87966e5ab admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:34.698802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 941/1883] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:10:34.706647 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85555b9-17f2-4b12-a44c-0f341c12f269 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:34.708172 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d85555b9-17f2-4b12-a44c-0f341c12f269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:34.711387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c7b2d-fa40-4723-9c22-13f317a9fde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:34.712246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c7b2d-fa40-4723-9c22-13f317a9fde9 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:34.712526 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c7b2d-fa40-4723-9c22-13f317a9fde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:34.712797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c7b2d-fa40-4723-9c22-13f317a9fde9 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:34.713604 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c7b2d-fa40-4723-9c22-13f317a9fde9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:34.716839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c7b2d-fa40-4723-9c22-13f317a9fde9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:34.745406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 943/1884] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:34 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:34.749552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c7b2d-fa40-4723-9c22-13f317a9fde9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:34.751707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-482c7b2d-fa40-4723-9c22-13f317a9fde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:34.766112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c7b2d-fa40-4723-9c22-13f317a9fde9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:34.771913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72078e5a-2a2b-42f3-8353-ebb0871947f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:34.772572 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72078e5a-2a2b-42f3-8353-ebb0871947f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:34.772851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72078e5a-2a2b-42f3-8353-ebb0871947f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:34.773122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72078e5a-2a2b-42f3-8353-ebb0871947f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:34.773877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72078e5a-2a2b-42f3-8353-ebb0871947f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:34.775544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72078e5a-2a2b-42f3-8353-ebb0871947f1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:34.776765 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85555b9-17f2-4b12-a44c-0f341c12f269 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:34.780517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07369bb3-d0e4-498e-8c3e-8fc96afeec05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:34.781395 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07369bb3-d0e4-498e-8c3e-8fc96afeec05 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:34.781524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07369bb3-d0e4-498e-8c3e-8fc96afeec05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:34.781737 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07369bb3-d0e4-498e-8c3e-8fc96afeec05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:34.792617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07369bb3-d0e4-498e-8c3e-8fc96afeec05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:34.794114 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07369bb3-d0e4-498e-8c3e-8fc96afeec05 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:34.797346 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 944/1885] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:10:34.798540 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72078e5a-2a2b-42f3-8353-ebb0871947f1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:34.805336 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 942/1886] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:10:34.816082 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72078e5a-2a2b-42f3-8353-ebb0871947f1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:34.821957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168ccb6-dd3a-4e76-9574-1508984c9149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:34.823081 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168ccb6-dd3a-4e76-9574-1508984c9149 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:34.823519 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168ccb6-dd3a-4e76-9574-1508984c9149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:34.824300 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168ccb6-dd3a-4e76-9574-1508984c9149 admin admin] PATH_INFO: `/v3/projects/a1d173d2980b454e84fd8f2a87fe5a5d/users/ecc9935d0b174e41ac522739d8a4e945/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:34.845079 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168ccb6-dd3a-4e76-9574-1508984c9149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d173d2980b454e84fd8f2a87fe5a5d, user_id=ecc9935d0b174e41ac522739d8a4e945, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:34.848846 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168ccb6-dd3a-4e76-9574-1508984c9149 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:34.867643 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 945/1887] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:34 2022] PUT /identity/v3/projects/a1d173d2980b454e84fd8f2a87fe5a5d/users/ecc9935d0b174e41ac522739d8a4e945/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:34.872869 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07369bb3-d0e4-498e-8c3e-8fc96afeec05 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:34.884475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07369bb3-d0e4-498e-8c3e-8fc96afeec05 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:34.959788 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c53deb-8b21-4cdb-a69a-24233f577238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:34.960535 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c53deb-8b21-4cdb-a69a-24233f577238 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:34.961269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c53deb-8b21-4cdb-a69a-24233f577238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:34.961593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c53deb-8b21-4cdb-a69a-24233f577238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:34.962824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c53deb-8b21-4cdb-a69a-24233f577238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:34.966973 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c53deb-8b21-4cdb-a69a-24233f577238 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:34.982564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 943/1888] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:34.983176 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168ccb6-dd3a-4e76-9574-1508984c9149 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:34.994348 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168ccb6-dd3a-4e76-9574-1508984c9149 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:34.999427 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44d1d6-1957-4caa-b2c5-b65db645a39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:35.000248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44d1d6-1957-4caa-b2c5-b65db645a39e admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:35.000622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44d1d6-1957-4caa-b2c5-b65db645a39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:35.000973 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44d1d6-1957-4caa-b2c5-b65db645a39e admin admin] PATH_INFO: `/v3/projects/a1d173d2980b454e84fd8f2a87fe5a5d/users/ecc9935d0b174e41ac522739d8a4e945/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:35.003161 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44d1d6-1957-4caa-b2c5-b65db645a39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d173d2980b454e84fd8f2a87fe5a5d, user_id=ecc9935d0b174e41ac522739d8a4e945, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:35.006498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44d1d6-1957-4caa-b2c5-b65db645a39e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:35.028510 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 946/1889] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:34 2022] PUT /identity/v3/projects/a1d173d2980b454e84fd8f2a87fe5a5d/users/ecc9935d0b174e41ac522739d8a4e945/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:35.031222 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561d4ac-ec8a-4d42-a736-64865a46e903 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:35.031672 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561d4ac-ec8a-4d42-a736-64865a46e903 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:35.032166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561d4ac-ec8a-4d42-a736-64865a46e903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:35.053200 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:35.065210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d561d4ac-ec8a-4d42-a736-64865a46e903 None None] MFA Rules not processed for user `ecc9935d0b174e41ac522739d8a4e945`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:35.067519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d561d4ac-ec8a-4d42-a736-64865a46e903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:35.135007 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44d1d6-1957-4caa-b2c5-b65db645a39e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:35.136906 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1f44d1d6-1957-4caa-b2c5-b65db645a39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:35.144356 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 944/1890] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:35.158450 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561d4ac-ec8a-4d42-a736-64865a46e903 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:35.159793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:35.159918 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d561d4ac-ec8a-4d42-a736-64865a46e903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:35.231765 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561d4ac-ec8a-4d42-a736-64865a46e903 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:35.235594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe414611-8e0a-4a47-97a1-9ca33cffeb44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:35.236283 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe414611-8e0a-4a47-97a1-9ca33cffeb44 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:35.236678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe414611-8e0a-4a47-97a1-9ca33cffeb44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:35.237128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe414611-8e0a-4a47-97a1-9ca33cffeb44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:35.246773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44d1d6-1957-4caa-b2c5-b65db645a39e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:35.248120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe414611-8e0a-4a47-97a1-9ca33cffeb44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:35.249591 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe414611-8e0a-4a47-97a1-9ca33cffeb44 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:35.258576 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926369b-a58c-47b3-b1fa-8dac58852271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:35.259457 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926369b-a58c-47b3-b1fa-8dac58852271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:35.259752 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926369b-a58c-47b3-b1fa-8dac58852271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:35.259864 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 945/1891] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:35.260013 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926369b-a58c-47b3-b1fa-8dac58852271 admin admin] PATH_INFO: `/v3/projects/8d1321327d054e57a1320753aca0e7f6` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:35.266193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926369b-a58c-47b3-b1fa-8dac58852271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d1321327d054e57a1320753aca0e7f6)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:35.268405 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926369b-a58c-47b3-b1fa-8dac58852271 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:35.332738 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe414611-8e0a-4a47-97a1-9ca33cffeb44 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:35.344791 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe414611-8e0a-4a47-97a1-9ca33cffeb44 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:35.350765 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c926369b-a58c-47b3-b1fa-8dac58852271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d1321327d054e57a1320753aca0e7f6', 'request_id': 'req-c926369b-a58c-47b3-b1fa-8dac58852271'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:35.357590 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c926369b-a58c-47b3-b1fa-8dac58852271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d1321327d054e57a1320753aca0e7f6', 'request_id': 'req-c926369b-a58c-47b3-b1fa-8dac58852271'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:35.363841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c926369b-a58c-47b3-b1fa-8dac58852271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d1321327d054e57a1320753aca0e7f6', 'request_id': 'req-c926369b-a58c-47b3-b1fa-8dac58852271'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:35.379628 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c926369b-a58c-47b3-b1fa-8dac58852271 admin admin] The token cache is being invalidate because project 8d1321327d054e57a1320753aca0e7f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:35.379628 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c926369b-a58c-47b3-b1fa-8dac58852271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:35.381008 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c926369b-a58c-47b3-b1fa-8dac58852271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:35.382884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 947/1892] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:35 2022] DELETE /identity/v3/projects/8d1321327d054e57a1320753aca0e7f6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:35.386538 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926369b-a58c-47b3-b1fa-8dac58852271 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:35.388173 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c926369b-a58c-47b3-b1fa-8dac58852271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:35.410039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a7d64-b704-4f33-99b5-a379d75261c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:35.411346 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a7d64-b704-4f33-99b5-a379d75261c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:35.412210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a7d64-b704-4f33-99b5-a379d75261c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:35.412494 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a7d64-b704-4f33-99b5-a379d75261c1 admin admin] PATH_INFO: `/v3/users/99c1b845b191441a8bb36035d86971c2` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:35.414117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a7d64-b704-4f33-99b5-a379d75261c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c1b845b191441a8bb36035d86971c2)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:35.416045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a7d64-b704-4f33-99b5-a379d75261c1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:35.460283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926369b-a58c-47b3-b1fa-8dac58852271 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:35.465159 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c68a7-d2d6-4532-84a1-bf872d2bacba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:35.466064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c68a7-d2d6-4532-84a1-bf872d2bacba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:35.466536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c68a7-d2d6-4532-84a1-bf872d2bacba admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:35.466647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c68a7-d2d6-4532-84a1-bf872d2bacba admin admin] PATH_INFO: `/v3/users/5105679312b940dd802d4a6c6ea5525a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:35.467822 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c68a7-d2d6-4532-84a1-bf872d2bacba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5105679312b940dd802d4a6c6ea5525a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:35.469744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:35.469877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c68a7-d2d6-4532-84a1-bf872d2bacba admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:35.482634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6b1a7d64-b704-4f33-99b5-a379d75261c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c1b845b191441a8bb36035d86971c2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:35.500484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6b1a7d64-b704-4f33-99b5-a379d75261c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c1b845b191441a8bb36035d86971c2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:35.501203 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6b1a7d64-b704-4f33-99b5-a379d75261c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c1b845b191441a8bb36035d86971c2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:35.501906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6b1a7d64-b704-4f33-99b5-a379d75261c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c1b845b191441a8bb36035d86971c2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:35.510092 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6b1a7d64-b704-4f33-99b5-a379d75261c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c1b845b191441a8bb36035d86971c2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:35.514324 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:35.521207 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-477c68a7-d2d6-4532-84a1-bf872d2bacba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5105679312b940dd802d4a6c6ea5525a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:35.523890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 946/1893] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:35 2022] DELETE /identity/v3/users/99c1b845b191441a8bb36035d86971c2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:35.528390 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaca63-09cc-4a2e-8356-32e32aa63612 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:35.528680 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaca63-09cc-4a2e-8356-32e32aa63612 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:35.528959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaca63-09cc-4a2e-8356-32e32aa63612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:35.536675 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-477c68a7-d2d6-4532-84a1-bf872d2bacba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5105679312b940dd802d4a6c6ea5525a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:35.537615 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-477c68a7-d2d6-4532-84a1-bf872d2bacba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5105679312b940dd802d4a6c6ea5525a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:35.538267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-477c68a7-d2d6-4532-84a1-bf872d2bacba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5105679312b940dd802d4a6c6ea5525a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:35.545728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-477c68a7-d2d6-4532-84a1-bf872d2bacba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5105679312b940dd802d4a6c6ea5525a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:35.546453 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0dbaca63-09cc-4a2e-8356-32e32aa63612 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:35.547661 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0dbaca63-09cc-4a2e-8356-32e32aa63612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:35.562899 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 948/1894] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:35 2022] DELETE /identity/v3/users/5105679312b940dd802d4a6c6ea5525a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:35.609599 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 947/1895] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:10:35.619692 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c68a7-d2d6-4532-84a1-bf872d2bacba admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:35.621088 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-477c68a7-d2d6-4532-84a1-bf872d2bacba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:35.681072 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c68a7-d2d6-4532-84a1-bf872d2bacba admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:35.685056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78b06f-a84c-4eb3-b332-516281f119fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:35.685749 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78b06f-a84c-4eb3-b332-516281f119fa service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:35.686032 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78b06f-a84c-4eb3-b332-516281f119fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:35.686311 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78b06f-a84c-4eb3-b332-516281f119fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:35.752538 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78b06f-a84c-4eb3-b332-516281f119fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:35.753949 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78b06f-a84c-4eb3-b332-516281f119fa service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:35.768133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 949/1896] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:10:35.980099 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbaca63-09cc-4a2e-8356-32e32aa63612 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:35.982059 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0dbaca63-09cc-4a2e-8356-32e32aa63612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:35.996056 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbaca63-09cc-4a2e-8356-32e32aa63612 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:36.001309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da8d14-a136-4f55-96bd-8a34dd648b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:36.002293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da8d14-a136-4f55-96bd-8a34dd648b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:36.002475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da8d14-a136-4f55-96bd-8a34dd648b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:36.002818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da8d14-a136-4f55-96bd-8a34dd648b92 admin admin] PATH_INFO: `/v3/projects/eb98e6e772c940c796e1006c08a13c62` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:36.003948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da8d14-a136-4f55-96bd-8a34dd648b92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb98e6e772c940c796e1006c08a13c62)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:36.006767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da8d14-a136-4f55-96bd-8a34dd648b92 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:36.058021 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-54da8d14-a136-4f55-96bd-8a34dd648b92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb98e6e772c940c796e1006c08a13c62', 'request_id': 'req-54da8d14-a136-4f55-96bd-8a34dd648b92'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:36.067459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-54da8d14-a136-4f55-96bd-8a34dd648b92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb98e6e772c940c796e1006c08a13c62', 'request_id': 'req-54da8d14-a136-4f55-96bd-8a34dd648b92'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:36.076294 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-54da8d14-a136-4f55-96bd-8a34dd648b92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb98e6e772c940c796e1006c08a13c62', 'request_id': 'req-54da8d14-a136-4f55-96bd-8a34dd648b92'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:36.088568 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-54da8d14-a136-4f55-96bd-8a34dd648b92 admin admin] The token cache is being invalidate because project eb98e6e772c940c796e1006c08a13c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:36.089356 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-54da8d14-a136-4f55-96bd-8a34dd648b92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:36.090110 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-54da8d14-a136-4f55-96bd-8a34dd648b92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:36.091949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 948/1897] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:35 2022] DELETE /identity/v3/projects/eb98e6e772c940c796e1006c08a13c62 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:36.097251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb38711-b1f6-4c30-96f4-4895ab99e906 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:36.097772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb38711-b1f6-4c30-96f4-4895ab99e906 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:36.097879 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb38711-b1f6-4c30-96f4-4895ab99e906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:36.116120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6cb38711-b1f6-4c30-96f4-4895ab99e906 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:36.117442 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6cb38711-b1f6-4c30-96f4-4895ab99e906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:36.187415 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 950/1898] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:36.189331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6b801-6f15-4985-9baa-24cad114ce92 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:36.189706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6b801-6f15-4985-9baa-24cad114ce92 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:36.190059 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6b801-6f15-4985-9baa-24cad114ce92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:36.225418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3ea6b801-6f15-4985-9baa-24cad114ce92 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:36.226890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3ea6b801-6f15-4985-9baa-24cad114ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:36.234249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb38711-b1f6-4c30-96f4-4895ab99e906 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:36.235780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6cb38711-b1f6-4c30-96f4-4895ab99e906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:36.240695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 949/1899] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:36.241851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6b801-6f15-4985-9baa-24cad114ce92 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:36.255718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb38711-b1f6-4c30-96f4-4895ab99e906 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:36.257300 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6b801-6f15-4985-9baa-24cad114ce92 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:36.262506 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e8951-9a77-452a-8c5e-4adbd2eb7e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:36.263210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e8951-9a77-452a-8c5e-4adbd2eb7e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:36.263673 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e8951-9a77-452a-8c5e-4adbd2eb7e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:36.263954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e8951-9a77-452a-8c5e-4adbd2eb7e0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:36.264695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e8951-9a77-452a-8c5e-4adbd2eb7e0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:10:36.265001 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e8951-9a77-452a-8c5e-4adbd2eb7e0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:36.266906 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e8951-9a77-452a-8c5e-4adbd2eb7e0f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:36.277279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44305ce4-4480-4bc5-9393-316735b78df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:36.279166 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44305ce4-4480-4bc5-9393-316735b78df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:36.279452 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44305ce4-4480-4bc5-9393-316735b78df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:36.279727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44305ce4-4480-4bc5-9393-316735b78df9 admin admin] PATH_INFO: `/v3/projects/a19d4a9022f84010a73d2f26e1600d70` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:36.280991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44305ce4-4480-4bc5-9393-316735b78df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19d4a9022f84010a73d2f26e1600d70)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:36.283410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 950/1900] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:10:36.284532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44305ce4-4480-4bc5-9393-316735b78df9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:36.289772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:36.290387 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e8951-9a77-452a-8c5e-4adbd2eb7e0f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:36.327239 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e8951-9a77-452a-8c5e-4adbd2eb7e0f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:36.336987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b50ea-f91d-4818-8a52-49c5e2236a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:36.338519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b50ea-f91d-4818-8a52-49c5e2236a1a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:36.338519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b50ea-f91d-4818-8a52-49c5e2236a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:36.338519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b50ea-f91d-4818-8a52-49c5e2236a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:36.339301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b50ea-f91d-4818-8a52-49c5e2236a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:36.345497 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b50ea-f91d-4818-8a52-49c5e2236a1a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:36.367619 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-44305ce4-4480-4bc5-9393-316735b78df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19d4a9022f84010a73d2f26e1600d70', 'request_id': 'req-44305ce4-4480-4bc5-9393-316735b78df9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:36.374655 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-44305ce4-4480-4bc5-9393-316735b78df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19d4a9022f84010a73d2f26e1600d70', 'request_id': 'req-44305ce4-4480-4bc5-9393-316735b78df9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:36.376228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:36.381406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-44305ce4-4480-4bc5-9393-316735b78df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19d4a9022f84010a73d2f26e1600d70', 'request_id': 'req-44305ce4-4480-4bc5-9393-316735b78df9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:36.393679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 951/1901] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:36 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:36.394845 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b50ea-f91d-4818-8a52-49c5e2236a1a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:36.408954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-44305ce4-4480-4bc5-9393-316735b78df9 admin admin] The token cache is being invalidate because project a19d4a9022f84010a73d2f26e1600d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:36.408954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-44305ce4-4480-4bc5-9393-316735b78df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:36.408954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-44305ce4-4480-4bc5-9393-316735b78df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:36.408954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 951/1902] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:36 2022] DELETE /identity/v3/projects/a19d4a9022f84010a73d2f26e1600d70 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:36.412624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44305ce4-4480-4bc5-9393-316735b78df9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:36.415390 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-44305ce4-4480-4bc5-9393-316735b78df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:36.490742 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b50ea-f91d-4818-8a52-49c5e2236a1a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:36.496543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20e02b-7d68-4cb9-9f72-7af535f289d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:36.497238 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e02b-7d68-4cb9-9f72-7af535f289d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:36.497557 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e02b-7d68-4cb9-9f72-7af535f289d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:36.497838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e02b-7d68-4cb9-9f72-7af535f289d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:36.498542 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20e02b-7d68-4cb9-9f72-7af535f289d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:36.500495 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20e02b-7d68-4cb9-9f72-7af535f289d5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:36.504139 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44305ce4-4480-4bc5-9393-316735b78df9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:36.510152 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8dcca-e40b-4883-88fa-af5c784e0cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:36.512137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8dcca-e40b-4883-88fa-af5c784e0cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:36.512542 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8dcca-e40b-4883-88fa-af5c784e0cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:36.513414 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8dcca-e40b-4883-88fa-af5c784e0cd1 admin admin] PATH_INFO: `/v3/users/ecc9935d0b174e41ac522739d8a4e945` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:36.515238 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8dcca-e40b-4883-88fa-af5c784e0cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc9935d0b174e41ac522739d8a4e945)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:36.518057 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8dcca-e40b-4883-88fa-af5c784e0cd1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:36.531807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 952/1903] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:36 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:36.536357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20e02b-7d68-4cb9-9f72-7af535f289d5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:36.538899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4f20e02b-7d68-4cb9-9f72-7af535f289d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:36.555515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20e02b-7d68-4cb9-9f72-7af535f289d5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:36.561062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebfe53-36d2-4111-a968-21e27fac1677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:36.561972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebfe53-36d2-4111-a968-21e27fac1677 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:36.562258 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebfe53-36d2-4111-a968-21e27fac1677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:36.562524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebfe53-36d2-4111-a968-21e27fac1677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:36.564114 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebfe53-36d2-4111-a968-21e27fac1677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:36.566229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebfe53-36d2-4111-a968-21e27fac1677 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:36.579123 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 953/1904] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:36.582501 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebfe53-36d2-4111-a968-21e27fac1677 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:36.594760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebfe53-36d2-4111-a968-21e27fac1677 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:36.600633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1fa8dcca-e40b-4883-88fa-af5c784e0cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc9935d0b174e41ac522739d8a4e945'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:36.600834 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e501d-a566-4e28-bcc6-eadbf86a2929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:36.601847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e501d-a566-4e28-bcc6-eadbf86a2929 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:36.602400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e501d-a566-4e28-bcc6-eadbf86a2929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:36.602854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e501d-a566-4e28-bcc6-eadbf86a2929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:36.603900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e501d-a566-4e28-bcc6-eadbf86a2929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:36.606836 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e501d-a566-4e28-bcc6-eadbf86a2929 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:36.623532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1fa8dcca-e40b-4883-88fa-af5c784e0cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc9935d0b174e41ac522739d8a4e945'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:36.624297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1fa8dcca-e40b-4883-88fa-af5c784e0cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc9935d0b174e41ac522739d8a4e945'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:36.628011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1fa8dcca-e40b-4883-88fa-af5c784e0cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc9935d0b174e41ac522739d8a4e945'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:36.628175 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 954/1905] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:10:36.629068 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e501d-a566-4e28-bcc6-eadbf86a2929 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:36.631251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1f6e501d-a566-4e28-bcc6-eadbf86a2929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:36.635077 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1fa8dcca-e40b-4883-88fa-af5c784e0cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc9935d0b174e41ac522739d8a4e945'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:36.646216 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e501d-a566-4e28-bcc6-eadbf86a2929 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:36.650565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 952/1906] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:36 2022] DELETE /identity/v3/users/ecc9935d0b174e41ac522739d8a4e945 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:36.651480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30b12c-de70-43e4-8f3b-5a4a68b858c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:36.652923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30b12c-de70-43e4-8f3b-5a4a68b858c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:36.652923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30b12c-de70-43e4-8f3b-5a4a68b858c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:36.653163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30b12c-de70-43e4-8f3b-5a4a68b858c2 admin admin] PATH_INFO: `/v3/projects/8de700954fb344a09d0685466ea18df3/users/531242b2286544c9a4f4e52bc0254662/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:36.674311 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30b12c-de70-43e4-8f3b-5a4a68b858c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de700954fb344a09d0685466ea18df3, user_id=531242b2286544c9a4f4e52bc0254662, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:36.677787 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30b12c-de70-43e4-8f3b-5a4a68b858c2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:36.702957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 955/1907] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:36 2022] PUT /identity/v3/projects/8de700954fb344a09d0685466ea18df3/users/531242b2286544c9a4f4e52bc0254662/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:36.714344 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95ffdc-cc6d-473e-99c6-de4f70934c64 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:36.714646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95ffdc-cc6d-473e-99c6-de4f70934c64 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:36.714927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95ffdc-cc6d-473e-99c6-de4f70934c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:36.734096 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:36.745470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2e95ffdc-cc6d-473e-99c6-de4f70934c64 None None] MFA Rules not processed for user `531242b2286544c9a4f4e52bc0254662`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:36.747386 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2e95ffdc-cc6d-473e-99c6-de4f70934c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:36.827367 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 953/1908] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:36.837799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30b12c-de70-43e4-8f3b-5a4a68b858c2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:36.842044 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-db30b12c-de70-43e4-8f3b-5a4a68b858c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:36.915756 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30b12c-de70-43e4-8f3b-5a4a68b858c2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:36.920101 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00d2e3-0c7c-4ae3-a25f-6fea8f7cd291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:36.920758 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00d2e3-0c7c-4ae3-a25f-6fea8f7cd291 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:36.921086 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00d2e3-0c7c-4ae3-a25f-6fea8f7cd291 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:36.921392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00d2e3-0c7c-4ae3-a25f-6fea8f7cd291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:36.937522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00d2e3-0c7c-4ae3-a25f-6fea8f7cd291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:36.938968 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00d2e3-0c7c-4ae3-a25f-6fea8f7cd291 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:36.950603 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 956/1909] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:36.960259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95ffdc-cc6d-473e-99c6-de4f70934c64 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:36.962199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2e95ffdc-cc6d-473e-99c6-de4f70934c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:37.067535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95ffdc-cc6d-473e-99c6-de4f70934c64 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:37.073884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afb326-7538-4233-9db9-9f8d053f338a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:37.075223 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afb326-7538-4233-9db9-9f8d053f338a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:37.075504 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afb326-7538-4233-9db9-9f8d053f338a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:37.076083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afb326-7538-4233-9db9-9f8d053f338a admin admin] PATH_INFO: `/v3/projects/a1d173d2980b454e84fd8f2a87fe5a5d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:37.077700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afb326-7538-4233-9db9-9f8d053f338a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d173d2980b454e84fd8f2a87fe5a5d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:37.080261 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afb326-7538-4233-9db9-9f8d053f338a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:37.133610 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c7afb326-7538-4233-9db9-9f8d053f338a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d173d2980b454e84fd8f2a87fe5a5d', 'request_id': 'req-c7afb326-7538-4233-9db9-9f8d053f338a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:37.140413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c7afb326-7538-4233-9db9-9f8d053f338a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d173d2980b454e84fd8f2a87fe5a5d', 'request_id': 'req-c7afb326-7538-4233-9db9-9f8d053f338a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:37.146620 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c7afb326-7538-4233-9db9-9f8d053f338a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d173d2980b454e84fd8f2a87fe5a5d', 'request_id': 'req-c7afb326-7538-4233-9db9-9f8d053f338a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:37.169196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c7afb326-7538-4233-9db9-9f8d053f338a admin admin] The token cache is being invalidate because project a1d173d2980b454e84fd8f2a87fe5a5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:37.169746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c7afb326-7538-4233-9db9-9f8d053f338a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:37.170940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c7afb326-7538-4233-9db9-9f8d053f338a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:37.172857 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 954/1910] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:36 2022] DELETE /identity/v3/projects/a1d173d2980b454e84fd8f2a87fe5a5d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:37.178325 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f4b3a-086a-4a13-9055-7901d04a8c21 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:37.178866 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f4b3a-086a-4a13-9055-7901d04a8c21 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:37.179845 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f4b3a-086a-4a13-9055-7901d04a8c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:37.206125 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-234f4b3a-086a-4a13-9055-7901d04a8c21 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:37.208112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-234f4b3a-086a-4a13-9055-7901d04a8c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:37.264752 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:37.304839 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 957/1911] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:10:37.313004 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456e56a-ea25-43c9-a169-b40a6ec925d0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:37.313640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456e56a-ea25-43c9-a169-b40a6ec925d0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:37.314103 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456e56a-ea25-43c9-a169-b40a6ec925d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:37.344935 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5456e56a-ea25-43c9-a169-b40a6ec925d0 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:37.346310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5456e56a-ea25-43c9-a169-b40a6ec925d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:37.364345 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 955/1912] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:10:37.365922 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f4b3a-086a-4a13-9055-7901d04a8c21 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:37.377557 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f4b3a-086a-4a13-9055-7901d04a8c21 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:37.382618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0306-2ee0-4d53-9435-b175dfaa467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:37.384080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0306-2ee0-4d53-9435-b175dfaa467f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:37.384240 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0306-2ee0-4d53-9435-b175dfaa467f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:37.384591 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0306-2ee0-4d53-9435-b175dfaa467f admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:37.385243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda0306-2ee0-4d53-9435-b175dfaa467f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:10:37.385614 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda0306-2ee0-4d53-9435-b175dfaa467f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:37.387234 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda0306-2ee0-4d53-9435-b175dfaa467f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:37.406092 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 958/1913] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:10:37.410551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456e56a-ea25-43c9-a169-b40a6ec925d0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:37.421738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456e56a-ea25-43c9-a169-b40a6ec925d0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:37.429157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc42cbd-00b7-4675-afc2-3fea79d48d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:37.429917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc42cbd-00b7-4675-afc2-3fea79d48d1a admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:37.433139 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc42cbd-00b7-4675-afc2-3fea79d48d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:37.433511 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc42cbd-00b7-4675-afc2-3fea79d48d1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:37.434238 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc42cbd-00b7-4675-afc2-3fea79d48d1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:37.436205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc42cbd-00b7-4675-afc2-3fea79d48d1a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:37.467470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 956/1914] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:37 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:37.471645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0306-2ee0-4d53-9435-b175dfaa467f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:37.482270 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0306-2ee0-4d53-9435-b175dfaa467f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:37.542025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a3f8c-de6e-495f-bbb0-384c39c0127e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:37.542711 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a3f8c-de6e-495f-bbb0-384c39c0127e admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:37.542997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a3f8c-de6e-495f-bbb0-384c39c0127e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:37.543278 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a3f8c-de6e-495f-bbb0-384c39c0127e admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:37.543988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a3f8c-de6e-495f-bbb0-384c39c0127e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:37.545949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a3f8c-de6e-495f-bbb0-384c39c0127e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:37.567786 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 959/1915] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:37 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:10:37.571717 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc42cbd-00b7-4675-afc2-3fea79d48d1a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:37.577624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:37.584494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc42cbd-00b7-4675-afc2-3fea79d48d1a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:37.590742 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bc464-7889-4ba7-82d5-aedfcf312934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:37.591514 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bc464-7889-4ba7-82d5-aedfcf312934 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:37.591889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bc464-7889-4ba7-82d5-aedfcf312934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:37.592178 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bc464-7889-4ba7-82d5-aedfcf312934 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:37.592903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bc464-7889-4ba7-82d5-aedfcf312934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:37.594619 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bc464-7889-4ba7-82d5-aedfcf312934 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:37.606258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 957/1916] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:37.609840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a3f8c-de6e-495f-bbb0-384c39c0127e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:37.620370 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a3f8c-de6e-495f-bbb0-384c39c0127e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:37.626741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1486f-9607-4d51-901b-be52fb6e84ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:37.627416 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1486f-9607-4d51-901b-be52fb6e84ab admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:37.627699 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1486f-9607-4d51-901b-be52fb6e84ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:37.627972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1486f-9607-4d51-901b-be52fb6e84ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:37.628704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1486f-9607-4d51-901b-be52fb6e84ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:37.630459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1486f-9607-4d51-901b-be52fb6e84ab admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:37.641896 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 960/1917] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:37.646554 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bc464-7889-4ba7-82d5-aedfcf312934 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:37.656781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bc464-7889-4ba7-82d5-aedfcf312934 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:37.662331 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fb988-32bf-4bd1-ae7f-836da35427c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:37.663217 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fb988-32bf-4bd1-ae7f-836da35427c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:37.663498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fb988-32bf-4bd1-ae7f-836da35427c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:37.663769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fb988-32bf-4bd1-ae7f-836da35427c2 admin admin] PATH_INFO: `/v3/projects/6e4d3eae20f14680923622e20d8ca16b/users/2ead7647612e44aca805f9ae0859cc00/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:37.679738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fb988-32bf-4bd1-ae7f-836da35427c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4d3eae20f14680923622e20d8ca16b, user_id=2ead7647612e44aca805f9ae0859cc00, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:37.682434 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fb988-32bf-4bd1-ae7f-836da35427c2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:37.697686 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 958/1918] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:37 2022] PUT /identity/v3/projects/6e4d3eae20f14680923622e20d8ca16b/users/2ead7647612e44aca805f9ae0859cc00/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:37.709899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d150-81d8-44f1-ba54-e678039e93bc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:37.710274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d150-81d8-44f1-ba54-e678039e93bc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:37.710645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d150-81d8-44f1-ba54-e678039e93bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:37.751811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7916d150-81d8-44f1-ba54-e678039e93bc None None] MFA Rules not processed for user `2ead7647612e44aca805f9ae0859cc00`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:37.753058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7916d150-81d8-44f1-ba54-e678039e93bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:37.832452 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 961/1919] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:37.837073 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fb988-32bf-4bd1-ae7f-836da35427c2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:37.856892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58501905-ee11-49f9-8f0a-0d5609e4aab2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:37.857183 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58501905-ee11-49f9-8f0a-0d5609e4aab2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:37.857499 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58501905-ee11-49f9-8f0a-0d5609e4aab2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:37.858956 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 962/1920] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jun 27 11:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 11:10:37.877755 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57953a39-a694-4b32-841e-470c126ad19f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:37.878072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57953a39-a694-4b32-841e-470c126ad19f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:37.878342 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57953a39-a694-4b32-841e-470c126ad19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:37.901008 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-57953a39-a694-4b32-841e-470c126ad19f None None] MFA Rules not processed for user `d8673c91abf14c0b9a237f0499fdf20e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:37.903449 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-57953a39-a694-4b32-841e-470c126ad19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:37.905433 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fb988-32bf-4bd1-ae7f-836da35427c2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:37.910167 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce53084-2cf4-4aa5-997f-7db0c427a5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:37.910829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53084-2cf4-4aa5-997f-7db0c427a5ee admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:37.911108 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53084-2cf4-4aa5-997f-7db0c427a5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:37.911432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53084-2cf4-4aa5-997f-7db0c427a5ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:37.912134 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce53084-2cf4-4aa5-997f-7db0c427a5ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:37.914083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce53084-2cf4-4aa5-997f-7db0c427a5ee admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:37.946522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:37.949880 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 959/1921] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:37 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:10:37.950882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce53084-2cf4-4aa5-997f-7db0c427a5ee admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:37.994055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 963/1922] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jun 27 11:10:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:38.007659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57953a39-a694-4b32-841e-470c126ad19f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:38.009066 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-57953a39-a694-4b32-841e-470c126ad19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:38.022827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57953a39-a694-4b32-841e-470c126ad19f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:38.039710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce53084-2cf4-4aa5-997f-7db0c427a5ee admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:38.045477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545910b-9030-488c-972f-206fd52fcfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:38.046302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545910b-9030-488c-972f-206fd52fcfc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:38.046722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545910b-9030-488c-972f-206fd52fcfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:38.047005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545910b-9030-488c-972f-206fd52fcfc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:38.047998 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545910b-9030-488c-972f-206fd52fcfc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:38.049751 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545910b-9030-488c-972f-206fd52fcfc7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:38.077059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 960/1923] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:37 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:38.078131 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545910b-9030-488c-972f-206fd52fcfc7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:38.089005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545910b-9030-488c-972f-206fd52fcfc7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:38.089968 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d9207-28a4-415e-8f4d-6b2f8cde5167 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8673c91abf14c0b9a237f0499fdf20e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:38.091197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d9207-28a4-415e-8f4d-6b2f8cde5167 service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:38.091197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d9207-28a4-415e-8f4d-6b2f8cde5167 service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:38.091394 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d9207-28a4-415e-8f4d-6b2f8cde5167 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:38.095896 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884bb9a-4fdf-425a-8366-87b31f8aff57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:38.096867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884bb9a-4fdf-425a-8366-87b31f8aff57 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:38.096867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884bb9a-4fdf-425a-8366-87b31f8aff57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:38.097092 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884bb9a-4fdf-425a-8366-87b31f8aff57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:38.097920 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884bb9a-4fdf-425a-8366-87b31f8aff57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:38.099597 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884bb9a-4fdf-425a-8366-87b31f8aff57 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:38.101108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d9207-28a4-415e-8f4d-6b2f8cde5167 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:38.102860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d9207-28a4-415e-8f4d-6b2f8cde5167 service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:38.115480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 964/1924] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:38.119978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 961/1925] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:10:38.121378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d9207-28a4-415e-8f4d-6b2f8cde5167 service placement] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:38.140358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d9207-28a4-415e-8f4d-6b2f8cde5167 service placement] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:38.150166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fbede-f433-4dbc-9944-38c082628e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:38.151146 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fbede-f433-4dbc-9944-38c082628e87 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:38.151434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fbede-f433-4dbc-9944-38c082628e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:38.151729 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fbede-f433-4dbc-9944-38c082628e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:38.152450 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fbede-f433-4dbc-9944-38c082628e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:38.154083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fbede-f433-4dbc-9944-38c082628e87 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:38.170007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 965/1926] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:10:38.170299 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884bb9a-4fdf-425a-8366-87b31f8aff57 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:38.185964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884bb9a-4fdf-425a-8366-87b31f8aff57 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:38.202630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e29c2-b2c9-4722-a61c-40df387fc370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:38.202630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e29c2-b2c9-4722-a61c-40df387fc370 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:38.202630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e29c2-b2c9-4722-a61c-40df387fc370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:38.202630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e29c2-b2c9-4722-a61c-40df387fc370 admin admin] PATH_INFO: `/v3/projects/7455011e81454bcaa87818e232fd3c06/users/efb52185c47d4a0baa1247f1fbd0e8d4/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:38.235607 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e29c2-b2c9-4722-a61c-40df387fc370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7455011e81454bcaa87818e232fd3c06, user_id=efb52185c47d4a0baa1247f1fbd0e8d4, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:38.239279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e29c2-b2c9-4722-a61c-40df387fc370 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:38.268843 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 962/1927] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:38 2022] PUT /identity/v3/projects/7455011e81454bcaa87818e232fd3c06/users/efb52185c47d4a0baa1247f1fbd0e8d4/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:38.280074 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1843-15da-4e62-8898-23793368a57b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:38.280398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1843-15da-4e62-8898-23793368a57b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:38.280637 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1843-15da-4e62-8898-23793368a57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:38.337041 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ca8a1843-15da-4e62-8898-23793368a57b None None] MFA Rules not processed for user `efb52185c47d4a0baa1247f1fbd0e8d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:38.338297 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ca8a1843-15da-4e62-8898-23793368a57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:38.442506 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 966/1928] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:38.442676 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e29c2-b2c9-4722-a61c-40df387fc370 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:38.456069 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:38.556631 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e29c2-b2c9-4722-a61c-40df387fc370 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:38.562940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa6195-57b4-4237-9baa-7be28a94f355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:38.564799 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa6195-57b4-4237-9baa-7be28a94f355 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:38.566138 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa6195-57b4-4237-9baa-7be28a94f355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:38.566138 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa6195-57b4-4237-9baa-7be28a94f355 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:38.567033 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa6195-57b4-4237-9baa-7be28a94f355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:38.571310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa6195-57b4-4237-9baa-7be28a94f355 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:38.572459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a1843-15da-4e62-8898-23793368a57b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:38.574026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ca8a1843-15da-4e62-8898-23793368a57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:38.598688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a1843-15da-4e62-8898-23793368a57b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:38.608078 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956de93-25b0-48fb-95df-1d2fdedc817f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:38.609120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956de93-25b0-48fb-95df-1d2fdedc817f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:38.609516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956de93-25b0-48fb-95df-1d2fdedc817f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:38.609851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956de93-25b0-48fb-95df-1d2fdedc817f admin admin] PATH_INFO: `/v3/users/1eac88bcc21e4bd9a38be066dd2720da` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:38.611657 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956de93-25b0-48fb-95df-1d2fdedc817f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eac88bcc21e4bd9a38be066dd2720da)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:38.613326 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956de93-25b0-48fb-95df-1d2fdedc817f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:38.622870 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 963/1929] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:38 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:10:38.628086 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa6195-57b4-4237-9baa-7be28a94f355 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:38.693307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:38.707235 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6956de93-25b0-48fb-95df-1d2fdedc817f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eac88bcc21e4bd9a38be066dd2720da'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:38.727356 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6956de93-25b0-48fb-95df-1d2fdedc817f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eac88bcc21e4bd9a38be066dd2720da'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:38.728274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6956de93-25b0-48fb-95df-1d2fdedc817f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eac88bcc21e4bd9a38be066dd2720da'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:38.728942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6956de93-25b0-48fb-95df-1d2fdedc817f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eac88bcc21e4bd9a38be066dd2720da'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:38.743765 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa6195-57b4-4237-9baa-7be28a94f355 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:38.750185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fe826-5875-4911-a042-8c580876d090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:38.751170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fe826-5875-4911-a042-8c580876d090 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:38.751455 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fe826-5875-4911-a042-8c580876d090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:38.751735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fe826-5875-4911-a042-8c580876d090 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:38.752457 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fe826-5875-4911-a042-8c580876d090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:38.752805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6956de93-25b0-48fb-95df-1d2fdedc817f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eac88bcc21e4bd9a38be066dd2720da'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:38.754505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fe826-5875-4911-a042-8c580876d090 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:38.772843 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 967/1930] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:38 2022] DELETE /identity/v3/users/1eac88bcc21e4bd9a38be066dd2720da => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:38.790554 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 964/1931] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:38 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:38.795446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956de93-25b0-48fb-95df-1d2fdedc817f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:38.797944 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6956de93-25b0-48fb-95df-1d2fdedc817f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:38.895464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956de93-25b0-48fb-95df-1d2fdedc817f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:38.900888 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588b76f-c33f-404a-a20e-87aa67a42106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:38.901745 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588b76f-c33f-404a-a20e-87aa67a42106 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:38.902078 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588b76f-c33f-404a-a20e-87aa67a42106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:38.902362 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588b76f-c33f-404a-a20e-87aa67a42106 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:38.903270 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588b76f-c33f-404a-a20e-87aa67a42106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:38.904688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588b76f-c33f-404a-a20e-87aa67a42106 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:38.917406 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 968/1932] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:38.920649 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fe826-5875-4911-a042-8c580876d090 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:38.931094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fe826-5875-4911-a042-8c580876d090 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:38.937399 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d01fc-e412-45da-b8c3-89c02a0b91f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:38.938398 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d01fc-e412-45da-b8c3-89c02a0b91f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:38.938583 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d01fc-e412-45da-b8c3-89c02a0b91f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:38.938922 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d01fc-e412-45da-b8c3-89c02a0b91f3 admin admin] PATH_INFO: `/v3/projects/882609aced4b4deab1088e9d1b512325/users/e9d4ef5e9c4a46378d3e237a0b613027/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:38.958035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d01fc-e412-45da-b8c3-89c02a0b91f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882609aced4b4deab1088e9d1b512325, user_id=e9d4ef5e9c4a46378d3e237a0b613027, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:38.961440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d01fc-e412-45da-b8c3-89c02a0b91f3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:38.977747 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 965/1933] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:38 2022] PUT /identity/v3/projects/882609aced4b4deab1088e9d1b512325/users/e9d4ef5e9c4a46378d3e237a0b613027/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:38.981560 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588b76f-c33f-404a-a20e-87aa67a42106 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:38.992529 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588b76f-c33f-404a-a20e-87aa67a42106 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:39.078505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d01fc-e412-45da-b8c3-89c02a0b91f3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:39.084776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-171d01fc-e412-45da-b8c3-89c02a0b91f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:39.108404 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815251c-f19a-4cfb-8de7-12848bff4cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:39.109173 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815251c-f19a-4cfb-8de7-12848bff4cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:39.110350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815251c-f19a-4cfb-8de7-12848bff4cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:39.110789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815251c-f19a-4cfb-8de7-12848bff4cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:39.111615 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815251c-f19a-4cfb-8de7-12848bff4cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:39.113377 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815251c-f19a-4cfb-8de7-12848bff4cd7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:39.124832 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 969/1934] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:10:39.129062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815251c-f19a-4cfb-8de7-12848bff4cd7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:39.152289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815251c-f19a-4cfb-8de7-12848bff4cd7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:39.158466 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e245c-360a-43d8-bc3b-40b12d538273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:39.160156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e245c-360a-43d8-bc3b-40b12d538273 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:39.164494 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e245c-360a-43d8-bc3b-40b12d538273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:39.164897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e245c-360a-43d8-bc3b-40b12d538273 admin admin] PATH_INFO: `/v3/projects/882609aced4b4deab1088e9d1b512325/users/e9d4ef5e9c4a46378d3e237a0b613027/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:39.167793 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e245c-360a-43d8-bc3b-40b12d538273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882609aced4b4deab1088e9d1b512325, user_id=e9d4ef5e9c4a46378d3e237a0b613027, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:39.170744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e245c-360a-43d8-bc3b-40b12d538273 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:39.188070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 970/1935] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:39 2022] PUT /identity/v3/projects/882609aced4b4deab1088e9d1b512325/users/e9d4ef5e9c4a46378d3e237a0b613027/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:39.198893 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25282d57-1603-43c9-877c-c61c8e0553f6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:39.199187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25282d57-1603-43c9-877c-c61c8e0553f6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:39.199471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25282d57-1603-43c9-877c-c61c8e0553f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:39.211564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:39.216946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d01fc-e412-45da-b8c3-89c02a0b91f3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:39.261678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-25282d57-1603-43c9-877c-c61c8e0553f6 None None] MFA Rules not processed for user `e9d4ef5e9c4a46378d3e237a0b613027`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:39.262934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-25282d57-1603-43c9-877c-c61c8e0553f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:39.297890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:39.330964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac11d70-40ec-4be4-8295-9b130c8135cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:39.332244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac11d70-40ec-4be4-8295-9b130c8135cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:39.332817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac11d70-40ec-4be4-8295-9b130c8135cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:39.333107 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac11d70-40ec-4be4-8295-9b130c8135cc admin admin] PATH_INFO: `/v3/projects/f32a021336bb409f81d54f1c54c5eded` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:39.334812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac11d70-40ec-4be4-8295-9b130c8135cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f32a021336bb409f81d54f1c54c5eded)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:39.338438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac11d70-40ec-4be4-8295-9b130c8135cc admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:39.390827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 971/1936] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:10:39.404618 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cac11d70-40ec-4be4-8295-9b130c8135cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f32a021336bb409f81d54f1c54c5eded', 'request_id': 'req-cac11d70-40ec-4be4-8295-9b130c8135cc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:39.414087 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cac11d70-40ec-4be4-8295-9b130c8135cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f32a021336bb409f81d54f1c54c5eded', 'request_id': 'req-cac11d70-40ec-4be4-8295-9b130c8135cc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:39.424942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cac11d70-40ec-4be4-8295-9b130c8135cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f32a021336bb409f81d54f1c54c5eded', 'request_id': 'req-cac11d70-40ec-4be4-8295-9b130c8135cc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:39.425085 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25282d57-1603-43c9-877c-c61c8e0553f6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:39.426602 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-25282d57-1603-43c9-877c-c61c8e0553f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:39.445354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cac11d70-40ec-4be4-8295-9b130c8135cc admin admin] The token cache is being invalidate because project f32a021336bb409f81d54f1c54c5eded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:39.445778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cac11d70-40ec-4be4-8295-9b130c8135cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:39.446428 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cac11d70-40ec-4be4-8295-9b130c8135cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:39.448502 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 966/1937] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:39 2022] DELETE /identity/v3/projects/f32a021336bb409f81d54f1c54c5eded => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:39.452504 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac11d70-40ec-4be4-8295-9b130c8135cc admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:39.454146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cac11d70-40ec-4be4-8295-9b130c8135cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:39.491895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25282d57-1603-43c9-877c-c61c8e0553f6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:39.522092 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac11d70-40ec-4be4-8295-9b130c8135cc admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:39.526878 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deaa56c-2493-41dd-8933-959790467d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:39.527627 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaa56c-2493-41dd-8933-959790467d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:39.527907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaa56c-2493-41dd-8933-959790467d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:39.528175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaa56c-2493-41dd-8933-959790467d1d admin admin] PATH_INFO: `/v3/users/157e693e6fa043ffaa385348de2c7993` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:39.529387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deaa56c-2493-41dd-8933-959790467d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=157e693e6fa043ffaa385348de2c7993)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:39.531285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deaa56c-2493-41dd-8933-959790467d1d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:39.544219 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc59e21-e2c0-43d6-b66b-c914ac338875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:39.544867 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc59e21-e2c0-43d6-b66b-c914ac338875 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:39.545143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc59e21-e2c0-43d6-b66b-c914ac338875 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:39.545441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc59e21-e2c0-43d6-b66b-c914ac338875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:39.547237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bcc59e21-e2c0-43d6-b66b-c914ac338875 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:39.572477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:39.582573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7deaa56c-2493-41dd-8933-959790467d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '157e693e6fa043ffaa385348de2c7993'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:39.594609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7deaa56c-2493-41dd-8933-959790467d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '157e693e6fa043ffaa385348de2c7993'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:39.595422 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7deaa56c-2493-41dd-8933-959790467d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '157e693e6fa043ffaa385348de2c7993'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:39.596066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7deaa56c-2493-41dd-8933-959790467d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '157e693e6fa043ffaa385348de2c7993'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:39.605625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7deaa56c-2493-41dd-8933-959790467d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '157e693e6fa043ffaa385348de2c7993'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:39.614268 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc59e21-e2c0-43d6-b66b-c914ac338875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:39.616230 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc59e21-e2c0-43d6-b66b-c914ac338875 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:39.624007 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 967/1938] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:39 2022] DELETE /identity/v3/users/157e693e6fa043ffaa385348de2c7993 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:39.629168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 972/1939] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:10:39.843906 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deaa56c-2493-41dd-8933-959790467d1d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:39.848057 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7deaa56c-2493-41dd-8933-959790467d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:39.956429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deaa56c-2493-41dd-8933-959790467d1d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:39.961679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf97914-c5aa-4043-8748-dcd5bb52dda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:39.963247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf97914-c5aa-4043-8748-dcd5bb52dda9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:39.963621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf97914-c5aa-4043-8748-dcd5bb52dda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:39.963956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf97914-c5aa-4043-8748-dcd5bb52dda9 admin admin] PATH_INFO: `/v3/projects/94955ca48cd24e9caa749f0ef08cbed8` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:39.965956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf97914-c5aa-4043-8748-dcd5bb52dda9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94955ca48cd24e9caa749f0ef08cbed8)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:39.967855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf97914-c5aa-4043-8748-dcd5bb52dda9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:40.024960 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8bf97914-c5aa-4043-8748-dcd5bb52dda9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94955ca48cd24e9caa749f0ef08cbed8', 'request_id': 'req-8bf97914-c5aa-4043-8748-dcd5bb52dda9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:40.033661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8bf97914-c5aa-4043-8748-dcd5bb52dda9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94955ca48cd24e9caa749f0ef08cbed8', 'request_id': 'req-8bf97914-c5aa-4043-8748-dcd5bb52dda9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:40.040959 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8bf97914-c5aa-4043-8748-dcd5bb52dda9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94955ca48cd24e9caa749f0ef08cbed8', 'request_id': 'req-8bf97914-c5aa-4043-8748-dcd5bb52dda9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:40.058610 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8bf97914-c5aa-4043-8748-dcd5bb52dda9 admin admin] The token cache is being invalidate because project 94955ca48cd24e9caa749f0ef08cbed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:40.059074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8bf97914-c5aa-4043-8748-dcd5bb52dda9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:40.059876 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8bf97914-c5aa-4043-8748-dcd5bb52dda9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:40.061744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 968/1940] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:39 2022] DELETE /identity/v3/projects/94955ca48cd24e9caa749f0ef08cbed8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:40.066492 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bef923-1aa7-4efe-a621-77d1704a2547 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:40.066783 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bef923-1aa7-4efe-a621-77d1704a2547 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:40.067059 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bef923-1aa7-4efe-a621-77d1704a2547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:40.085570 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-37bef923-1aa7-4efe-a621-77d1704a2547 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:40.086899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-37bef923-1aa7-4efe-a621-77d1704a2547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:40.116522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:40.160353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 973/1941] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:10:40.168103 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297286ce-1249-4c97-aa46-ce82f3613afa None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:40.168403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297286ce-1249-4c97-aa46-ce82f3613afa None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:40.168674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297286ce-1249-4c97-aa46-ce82f3613afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:40.191565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-297286ce-1249-4c97-aa46-ce82f3613afa None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:40.193320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-297286ce-1249-4c97-aa46-ce82f3613afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:40.202812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 969/1942] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:40.207077 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bef923-1aa7-4efe-a621-77d1704a2547 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:40.218922 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bef923-1aa7-4efe-a621-77d1704a2547 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:40.224411 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2549f-e66e-4f09-b358-a76183699c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:40.225232 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2549f-e66e-4f09-b358-a76183699c1b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:40.225665 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2549f-e66e-4f09-b358-a76183699c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:40.226024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2549f-e66e-4f09-b358-a76183699c1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:40.226946 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2549f-e66e-4f09-b358-a76183699c1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:10:40.227310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2549f-e66e-4f09-b358-a76183699c1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:40.229102 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2549f-e66e-4f09-b358-a76183699c1b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:40.243196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297286ce-1249-4c97-aa46-ce82f3613afa None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:40.244965 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-297286ce-1249-4c97-aa46-ce82f3613afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:40.252928 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 974/1943] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:10:40.254735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2549f-e66e-4f09-b358-a76183699c1b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:40.267630 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2549f-e66e-4f09-b358-a76183699c1b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:40.273827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc2cc9-7acb-46f7-98b7-132f47f866ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:40.275350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc2cc9-7acb-46f7-98b7-132f47f866ec admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:40.275823 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc2cc9-7acb-46f7-98b7-132f47f866ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:40.276659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc2cc9-7acb-46f7-98b7-132f47f866ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:40.277625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc2cc9-7acb-46f7-98b7-132f47f866ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:40.279896 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc2cc9-7acb-46f7-98b7-132f47f866ec admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:40.307819 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:40.321886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 975/1944] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:40 2022] POST /identity/v3/projects => generated 361 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:40.326300 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc2cc9-7acb-46f7-98b7-132f47f866ec admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:40.332956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297286ce-1249-4c97-aa46-ce82f3613afa None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:40.401110 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc2cc9-7acb-46f7-98b7-132f47f866ec admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:40.402437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b31b22-8c0f-4f6d-aac4-229e20296e41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:40.403163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b31b22-8c0f-4f6d-aac4-229e20296e41 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:40.403625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b31b22-8c0f-4f6d-aac4-229e20296e41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:40.403994 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b31b22-8c0f-4f6d-aac4-229e20296e41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:40.406036 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-84b31b22-8c0f-4f6d-aac4-229e20296e41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:40.407510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c87df6-75cf-4002-a322-22ad2f4af3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:40.408292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c87df6-75cf-4002-a322-22ad2f4af3ca admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:40.408673 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c87df6-75cf-4002-a322-22ad2f4af3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:40.409187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c87df6-75cf-4002-a322-22ad2f4af3ca admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:40.410011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c87df6-75cf-4002-a322-22ad2f4af3ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:40.412402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c87df6-75cf-4002-a322-22ad2f4af3ca admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:40.439089 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 976/1945] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:40 2022] POST /identity/v3/users => generated 281 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:40.445643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c87df6-75cf-4002-a322-22ad2f4af3ca admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:40.460671 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c87df6-75cf-4002-a322-22ad2f4af3ca admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:40.472190 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f7ee2-27ef-4376-89f3-aab45f704a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:40.474124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f7ee2-27ef-4376-89f3-aab45f704a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:40.474674 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f7ee2-27ef-4376-89f3-aab45f704a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:40.475143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f7ee2-27ef-4376-89f3-aab45f704a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:40.476586 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f7ee2-27ef-4376-89f3-aab45f704a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:40.479909 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f7ee2-27ef-4376-89f3-aab45f704a79 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:40.494638 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 977/1946] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:10:40.495813 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f7ee2-27ef-4376-89f3-aab45f704a79 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:40.498481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f22f7ee2-27ef-4376-89f3-aab45f704a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:40.516327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b31b22-8c0f-4f6d-aac4-229e20296e41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:40.518061 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b31b22-8c0f-4f6d-aac4-229e20296e41 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:40.531281 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 970/1947] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:40.532129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b31b22-8c0f-4f6d-aac4-229e20296e41 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:40.532649 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f7ee2-27ef-4376-89f3-aab45f704a79 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:40.541619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b52f8-5f71-4c3c-b6f4-1b4b6d2da85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:40.542517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b52f8-5f71-4c3c-b6f4-1b4b6d2da85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:40.542803 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b52f8-5f71-4c3c-b6f4-1b4b6d2da85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:40.544986 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b52f8-5f71-4c3c-b6f4-1b4b6d2da85c admin admin] PATH_INFO: `/v3/users/531242b2286544c9a4f4e52bc0254662` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:40.545127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b31b22-8c0f-4f6d-aac4-229e20296e41 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:40.549735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b52f8-5f71-4c3c-b6f4-1b4b6d2da85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=531242b2286544c9a4f4e52bc0254662)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:40.553667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b52f8-5f71-4c3c-b6f4-1b4b6d2da85c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:40.554715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53111b-f26e-47b6-889b-9d30ed519a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:40.555323 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53111b-f26e-47b6-889b-9d30ed519a15 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:40.555798 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53111b-f26e-47b6-889b-9d30ed519a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:40.556083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53111b-f26e-47b6-889b-9d30ed519a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:40.556872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53111b-f26e-47b6-889b-9d30ed519a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:40.559074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53111b-f26e-47b6-889b-9d30ed519a15 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:40.575694 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 971/1948] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:40.576753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53111b-f26e-47b6-889b-9d30ed519a15 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:40.590228 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53111b-f26e-47b6-889b-9d30ed519a15 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:40.600420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b0b5f-b3ff-4ddd-82ab-627881607a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:40.601445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0b5f-b3ff-4ddd-82ab-627881607a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:40.601856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0b5f-b3ff-4ddd-82ab-627881607a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:40.602176 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0b5f-b3ff-4ddd-82ab-627881607a06 admin admin] PATH_INFO: `/v3/projects/046b5e891f9947af816520dc059c4398/users/d21a75546323455d804bdc2972ee5147/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:40.623272 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b0b5f-b3ff-4ddd-82ab-627881607a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=046b5e891f9947af816520dc059c4398, user_id=d21a75546323455d804bdc2972ee5147, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:40.628088 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b0b5f-b3ff-4ddd-82ab-627881607a06 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:40.648531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-864b52f8-5f71-4c3c-b6f4-1b4b6d2da85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '531242b2286544c9a4f4e52bc0254662'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:40.659091 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 972/1949] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:40 2022] PUT /identity/v3/projects/046b5e891f9947af816520dc059c4398/users/d21a75546323455d804bdc2972ee5147/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:40.660987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e8807-8878-46ad-8e80-ffc77b9188ce None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:40.661336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e8807-8878-46ad-8e80-ffc77b9188ce None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:40.662374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e8807-8878-46ad-8e80-ffc77b9188ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:40.688787 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-864b52f8-5f71-4c3c-b6f4-1b4b6d2da85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '531242b2286544c9a4f4e52bc0254662'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:40.690977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-864b52f8-5f71-4c3c-b6f4-1b4b6d2da85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '531242b2286544c9a4f4e52bc0254662'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:40.692665 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-864b52f8-5f71-4c3c-b6f4-1b4b6d2da85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '531242b2286544c9a4f4e52bc0254662'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:40.699602 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:40.711942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-864b52f8-5f71-4c3c-b6f4-1b4b6d2da85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '531242b2286544c9a4f4e52bc0254662'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:40.740162 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 978/1950] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:40 2022] DELETE /identity/v3/users/531242b2286544c9a4f4e52bc0254662 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:40.744724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791077ee-7d40-4062-835b-a5a2745b5886 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:40.745217 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791077ee-7d40-4062-835b-a5a2745b5886 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:40.745335 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d49e8807-8878-46ad-8e80-ffc77b9188ce None None] MFA Rules not processed for user `d21a75546323455d804bdc2972ee5147`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:40.745766 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791077ee-7d40-4062-835b-a5a2745b5886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:40.746725 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d49e8807-8878-46ad-8e80-ffc77b9188ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:40.780638 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-791077ee-7d40-4062-835b-a5a2745b5886 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:40.783337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-791077ee-7d40-4062-835b-a5a2745b5886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:40.888197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 979/1951] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:40.898066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 973/1952] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:10:40.906290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791077ee-7d40-4062-835b-a5a2745b5886 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:40.907982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-791077ee-7d40-4062-835b-a5a2745b5886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:40.935516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e8807-8878-46ad-8e80-ffc77b9188ce None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:40.939370 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d49e8807-8878-46ad-8e80-ffc77b9188ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:40.946867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:41.011718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791077ee-7d40-4062-835b-a5a2745b5886 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:41.023772 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405948bf-2fda-48ad-887b-66b5548bf429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:41.026262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405948bf-2fda-48ad-887b-66b5548bf429 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:41.026585 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405948bf-2fda-48ad-887b-66b5548bf429 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:41.027370 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405948bf-2fda-48ad-887b-66b5548bf429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:41.042466 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e8807-8878-46ad-8e80-ffc77b9188ce None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:41.049843 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87387b6a-1fe0-4cb2-9fe9-bd3c3402a5f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:41.050909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87387b6a-1fe0-4cb2-9fe9-bd3c3402a5f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:41.051344 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87387b6a-1fe0-4cb2-9fe9-bd3c3402a5f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:41.051805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87387b6a-1fe0-4cb2-9fe9-bd3c3402a5f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:41.054768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405948bf-2fda-48ad-887b-66b5548bf429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:41.059370 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405948bf-2fda-48ad-887b-66b5548bf429 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:41.064135 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87387b6a-1fe0-4cb2-9fe9-bd3c3402a5f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:41.066805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87387b6a-1fe0-4cb2-9fe9-bd3c3402a5f4 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:41.078236 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 974/1953] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:41.082569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 980/1954] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:41.094886 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87387b6a-1fe0-4cb2-9fe9-bd3c3402a5f4 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:41.097300 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-87387b6a-1fe0-4cb2-9fe9-bd3c3402a5f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:41.118290 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87387b6a-1fe0-4cb2-9fe9-bd3c3402a5f4 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:41.124401 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e35197-8a46-4744-b4a5-620d6e162f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:41.125827 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e35197-8a46-4744-b4a5-620d6e162f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:41.126182 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e35197-8a46-4744-b4a5-620d6e162f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:41.126809 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e35197-8a46-4744-b4a5-620d6e162f35 admin admin] PATH_INFO: `/v3/users/d21a75546323455d804bdc2972ee5147` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:41.129414 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e35197-8a46-4744-b4a5-620d6e162f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d21a75546323455d804bdc2972ee5147)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:41.130727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e35197-8a46-4744-b4a5-620d6e162f35 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:41.224898 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b6e35197-8a46-4744-b4a5-620d6e162f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd21a75546323455d804bdc2972ee5147'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:41.241796 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b6e35197-8a46-4744-b4a5-620d6e162f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd21a75546323455d804bdc2972ee5147'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:41.242968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b6e35197-8a46-4744-b4a5-620d6e162f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd21a75546323455d804bdc2972ee5147'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:41.243907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b6e35197-8a46-4744-b4a5-620d6e162f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd21a75546323455d804bdc2972ee5147'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:41.257657 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b6e35197-8a46-4744-b4a5-620d6e162f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd21a75546323455d804bdc2972ee5147'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:41.281238 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 975/1955] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:41 2022] DELETE /identity/v3/users/d21a75546323455d804bdc2972ee5147 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:41.281969 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf936781-2916-418a-aab1-921212948bd7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:41.282969 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf936781-2916-418a-aab1-921212948bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:41.283328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf936781-2916-418a-aab1-921212948bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:41.310425 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cf936781-2916-418a-aab1-921212948bd7 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:41.311730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cf936781-2916-418a-aab1-921212948bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:41.424044 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 981/1956] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:41.459665 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e35197-8a46-4744-b4a5-620d6e162f35 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:41.461852 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b6e35197-8a46-4744-b4a5-620d6e162f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:41.542991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e35197-8a46-4744-b4a5-620d6e162f35 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:41.548344 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c73791-df16-4bd2-9c80-6459e80d4710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:41.549278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73791-df16-4bd2-9c80-6459e80d4710 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:41.549663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73791-df16-4bd2-9c80-6459e80d4710 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:41.550009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73791-df16-4bd2-9c80-6459e80d4710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:41.567906 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c73791-df16-4bd2-9c80-6459e80d4710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:41.570031 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c73791-df16-4bd2-9c80-6459e80d4710 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:41.588141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 976/1957] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:41.610679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf936781-2916-418a-aab1-921212948bd7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:41.612114 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cf936781-2916-418a-aab1-921212948bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:41.624649 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf936781-2916-418a-aab1-921212948bd7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:41.629270 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:41.630729 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:41.631006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:41.631277 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af admin admin] PATH_INFO: `/v3/projects/8de700954fb344a09d0685466ea18df3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:41.632511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af admin admin] RBAC: Authorizing `identity:delete_project(project_id=8de700954fb344a09d0685466ea18df3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:41.634691 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:41.670238 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:41.708201 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8de700954fb344a09d0685466ea18df3', 'request_id': 'req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:41.719968 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8de700954fb344a09d0685466ea18df3', 'request_id': 'req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:41.734613 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8de700954fb344a09d0685466ea18df3', 'request_id': 'req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:41.758554 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af admin admin] The token cache is being invalidate because project 8de700954fb344a09d0685466ea18df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:41.759144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:41.759958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:41.768734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c0ced-9d8c-4388-8d00-ab4819a76242 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:41.769090 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c0ced-9d8c-4388-8d00-ab4819a76242 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:41.769538 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c0ced-9d8c-4388-8d00-ab4819a76242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:41.770007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 982/1958] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:41 2022] DELETE /identity/v3/projects/8de700954fb344a09d0685466ea18df3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:41.771499 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:41.773170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:41.797080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8f3c0ced-9d8c-4388-8d00-ab4819a76242 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:41.798521 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8f3c0ced-9d8c-4388-8d00-ab4819a76242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:41.818088 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:41.867890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde25f5-53f8-4cf1-8dcf-0d0e0689a3af admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:41.873890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742ca39-cde2-4170-b072-41d03ba1171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:41.874842 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742ca39-cde2-4170-b072-41d03ba1171e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:41.875372 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742ca39-cde2-4170-b072-41d03ba1171e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:41.875862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742ca39-cde2-4170-b072-41d03ba1171e admin admin] PATH_INFO: `/v3/users/ee312fc0138d4a959a546a49a466913f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:41.877158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742ca39-cde2-4170-b072-41d03ba1171e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee312fc0138d4a959a546a49a466913f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:41.879755 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742ca39-cde2-4170-b072-41d03ba1171e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:41.899659 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 977/1959] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:10:41.901903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bee1e-746b-4278-b55d-88f9f69a3ba9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:41.902196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bee1e-746b-4278-b55d-88f9f69a3ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:41.902477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bee1e-746b-4278-b55d-88f9f69a3ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:41.929479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-745bee1e-746b-4278-b55d-88f9f69a3ba9 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:41.930995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-745bee1e-746b-4278-b55d-88f9f69a3ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:41.941992 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 978/1960] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:41.946608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bee1e-746b-4278-b55d-88f9f69a3ba9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:41.948285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-745bee1e-746b-4278-b55d-88f9f69a3ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:41.961334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9742ca39-cde2-4170-b072-41d03ba1171e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee312fc0138d4a959a546a49a466913f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:41.962559 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bee1e-746b-4278-b55d-88f9f69a3ba9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:41.969035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08b2a0-6562-4dc0-a78b-efaffac213f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:41.970328 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08b2a0-6562-4dc0-a78b-efaffac213f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:41.970772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08b2a0-6562-4dc0-a78b-efaffac213f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:41.971197 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08b2a0-6562-4dc0-a78b-efaffac213f2 admin admin] PATH_INFO: `/v3/projects/046b5e891f9947af816520dc059c4398` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:41.972659 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08b2a0-6562-4dc0-a78b-efaffac213f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=046b5e891f9947af816520dc059c4398)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:41.975531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08b2a0-6562-4dc0-a78b-efaffac213f2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:41.976032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9742ca39-cde2-4170-b072-41d03ba1171e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee312fc0138d4a959a546a49a466913f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:41.976765 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9742ca39-cde2-4170-b072-41d03ba1171e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee312fc0138d4a959a546a49a466913f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:41.977399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9742ca39-cde2-4170-b072-41d03ba1171e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee312fc0138d4a959a546a49a466913f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:41.995505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9742ca39-cde2-4170-b072-41d03ba1171e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee312fc0138d4a959a546a49a466913f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:42.017317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 983/1961] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:41 2022] DELETE /identity/v3/users/ee312fc0138d4a959a546a49a466913f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:42.017317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742ca39-cde2-4170-b072-41d03ba1171e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:42.018068 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9742ca39-cde2-4170-b072-41d03ba1171e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:42.059786 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1f08b2a0-6562-4dc0-a78b-efaffac213f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046b5e891f9947af816520dc059c4398', 'request_id': 'req-1f08b2a0-6562-4dc0-a78b-efaffac213f2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:42.068840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1f08b2a0-6562-4dc0-a78b-efaffac213f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046b5e891f9947af816520dc059c4398', 'request_id': 'req-1f08b2a0-6562-4dc0-a78b-efaffac213f2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:42.073937 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:42.081585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1f08b2a0-6562-4dc0-a78b-efaffac213f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046b5e891f9947af816520dc059c4398', 'request_id': 'req-1f08b2a0-6562-4dc0-a78b-efaffac213f2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:42.105418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1f08b2a0-6562-4dc0-a78b-efaffac213f2 admin admin] The token cache is being invalidate because project 046b5e891f9947af816520dc059c4398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:42.105719 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1f08b2a0-6562-4dc0-a78b-efaffac213f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:42.106436 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1f08b2a0-6562-4dc0-a78b-efaffac213f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:42.108603 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 979/1962] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:41 2022] DELETE /identity/v3/projects/046b5e891f9947af816520dc059c4398 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:42.144994 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d76d8-c6ab-4413-ad91-9da7fdbdbf04 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:42.145315 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d76d8-c6ab-4413-ad91-9da7fdbdbf04 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:42.146342 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742ca39-cde2-4170-b072-41d03ba1171e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:42.149920 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d76d8-c6ab-4413-ad91-9da7fdbdbf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:42.196218 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-702d76d8-c6ab-4413-ad91-9da7fdbdbf04 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:42.198181 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-702d76d8-c6ab-4413-ad91-9da7fdbdbf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:42.232853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212ded4-d9a5-430c-96dc-cc7f0e3e5ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:42.233565 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212ded4-d9a5-430c-96dc-cc7f0e3e5ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:42.234167 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212ded4-d9a5-430c-96dc-cc7f0e3e5ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:42.234274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212ded4-d9a5-430c-96dc-cc7f0e3e5ef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:42.234946 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212ded4-d9a5-430c-96dc-cc7f0e3e5ef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:10:42.235255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212ded4-d9a5-430c-96dc-cc7f0e3e5ef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:42.236935 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212ded4-d9a5-430c-96dc-cc7f0e3e5ef8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:42.250595 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 984/1963] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:10:42.250595 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb873b-43e7-49d8-9a36-c204d666205e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:42.250595 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb873b-43e7-49d8-9a36-c204d666205e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:42.250595 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb873b-43e7-49d8-9a36-c204d666205e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:42.282076 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8fcb873b-43e7-49d8-9a36-c204d666205e None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:42.283297 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8fcb873b-43e7-49d8-9a36-c204d666205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:42.299155 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 985/1964] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:42.307043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb873b-43e7-49d8-9a36-c204d666205e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:42.313493 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8fcb873b-43e7-49d8-9a36-c204d666205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:42.330259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 980/1965] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:42.331736 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ef0c4-9904-4ead-a057-486bb761d302 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:42.332029 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ef0c4-9904-4ead-a057-486bb761d302 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:42.332526 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ef0c4-9904-4ead-a057-486bb761d302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:42.352810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cf4ef0c4-9904-4ead-a057-486bb761d302 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:42.353162 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb873b-43e7-49d8-9a36-c204d666205e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:42.355044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cf4ef0c4-9904-4ead-a057-486bb761d302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:42.366622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b61a4f-6090-4e5f-9e4f-ee3400a7ee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:42.367295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b61a4f-6090-4e5f-9e4f-ee3400a7ee7a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:42.367573 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b61a4f-6090-4e5f-9e4f-ee3400a7ee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:42.367843 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b61a4f-6090-4e5f-9e4f-ee3400a7ee7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:42.368531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b61a4f-6090-4e5f-9e4f-ee3400a7ee7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:42.370622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b61a4f-6090-4e5f-9e4f-ee3400a7ee7a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:42.378464 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 981/1966] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:42.381594 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ef0c4-9904-4ead-a057-486bb761d302 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:42.387271 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cf4ef0c4-9904-4ead-a057-486bb761d302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:42.408709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 986/1967] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:42 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:42.408709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b61a4f-6090-4e5f-9e4f-ee3400a7ee7a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:42.439505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:42.508845 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ef0c4-9904-4ead-a057-486bb761d302 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:42.536905 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b61a4f-6090-4e5f-9e4f-ee3400a7ee7a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:42.543411 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2715f7d-2457-40f8-91be-e641693884a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:42.545463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2715f7d-2457-40f8-91be-e641693884a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:42.546105 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2715f7d-2457-40f8-91be-e641693884a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:42.546469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2715f7d-2457-40f8-91be-e641693884a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:42.547391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2715f7d-2457-40f8-91be-e641693884a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:10:42.547748 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2715f7d-2457-40f8-91be-e641693884a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:42.550719 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2715f7d-2457-40f8-91be-e641693884a6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:42.567157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 987/1968] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:10:42.572305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2715f7d-2457-40f8-91be-e641693884a6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:42.574354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d9df5-dfa4-44cc-815f-5a7e181919c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:42.575672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d9df5-dfa4-44cc-815f-5a7e181919c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:42.576178 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d9df5-dfa4-44cc-815f-5a7e181919c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:42.576467 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d9df5-dfa4-44cc-815f-5a7e181919c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:42.586055 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2715f7d-2457-40f8-91be-e641693884a6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:42.590591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d9df5-dfa4-44cc-815f-5a7e181919c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:42.592136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95739418-d51e-4c93-acff-73b408cd9a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:42.592276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d9df5-dfa4-44cc-815f-5a7e181919c8 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:42.592987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95739418-d51e-4c93-acff-73b408cd9a7d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:42.593521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95739418-d51e-4c93-acff-73b408cd9a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:42.593899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95739418-d51e-4c93-acff-73b408cd9a7d admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:42.595169 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95739418-d51e-4c93-acff-73b408cd9a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:42.597346 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95739418-d51e-4c93-acff-73b408cd9a7d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:42.604701 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 982/1969] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:42.606130 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d9df5-dfa4-44cc-815f-5a7e181919c8 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:42.620613 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d9df5-dfa4-44cc-815f-5a7e181919c8 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:42.632509 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 988/1970] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:42 2022] POST /identity/v3/users => generated 292 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:42.637976 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95739418-d51e-4c93-acff-73b408cd9a7d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:42.638278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc958ad-ea65-4941-9f59-dc7feea93277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:42.638953 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc958ad-ea65-4941-9f59-dc7feea93277 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:42.639228 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc958ad-ea65-4941-9f59-dc7feea93277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:42.640269 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc958ad-ea65-4941-9f59-dc7feea93277 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:42.641070 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc958ad-ea65-4941-9f59-dc7feea93277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:42.643386 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc958ad-ea65-4941-9f59-dc7feea93277 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:42.653828 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95739418-d51e-4c93-acff-73b408cd9a7d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:42.661737 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1652d01-c148-488c-986d-2e3ca152af28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:42.662543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1652d01-c148-488c-986d-2e3ca152af28 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:42.662905 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1652d01-c148-488c-986d-2e3ca152af28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:42.663256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1652d01-c148-488c-986d-2e3ca152af28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:42.664464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1652d01-c148-488c-986d-2e3ca152af28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:42.667080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1652d01-c148-488c-986d-2e3ca152af28 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:42.680530 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 989/1971] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:10:42.685418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1652d01-c148-488c-986d-2e3ca152af28 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:42.697873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1652d01-c148-488c-986d-2e3ca152af28 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:42.699200 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 983/1972] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:42 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:42.703439 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc958ad-ea65-4941-9f59-dc7feea93277 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:42.703872 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:42.777739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5df85-fb60-4961-b644-9eeaa67f07d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:42.778430 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5df85-fb60-4961-b644-9eeaa67f07d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:42.778713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5df85-fb60-4961-b644-9eeaa67f07d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:42.778989 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5df85-fb60-4961-b644-9eeaa67f07d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:42.779811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5df85-fb60-4961-b644-9eeaa67f07d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:42.781548 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5df85-fb60-4961-b644-9eeaa67f07d5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:42.813621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc958ad-ea65-4941-9f59-dc7feea93277 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:42.813856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 990/1973] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:42.816583 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5df85-fb60-4961-b644-9eeaa67f07d5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:42.820074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e9772-b893-4fce-9308-b7b83ee94639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:42.820754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e9772-b893-4fce-9308-b7b83ee94639 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:42.821118 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e9772-b893-4fce-9308-b7b83ee94639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:42.821903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e9772-b893-4fce-9308-b7b83ee94639 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:42.822601 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e9772-b893-4fce-9308-b7b83ee94639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:42.825267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e9772-b893-4fce-9308-b7b83ee94639 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:42.833483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5df85-fb60-4961-b644-9eeaa67f07d5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:42.841789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea72480-690f-46a7-b3b6-9ad34df07382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:42.841789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea72480-690f-46a7-b3b6-9ad34df07382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:42.841789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea72480-690f-46a7-b3b6-9ad34df07382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:42.841789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea72480-690f-46a7-b3b6-9ad34df07382 admin admin] PATH_INFO: `/v3/projects/bcd9616cce644daf9c26d0b8d1782ae9/users/92874433831e40208b4e9101f6d37668/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:42.853990 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 984/1974] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:42 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:10:42.857806 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e9772-b893-4fce-9308-b7b83ee94639 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:42.862305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea72480-690f-46a7-b3b6-9ad34df07382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd9616cce644daf9c26d0b8d1782ae9, user_id=92874433831e40208b4e9101f6d37668, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:42.866161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea72480-690f-46a7-b3b6-9ad34df07382 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:42.873496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e9772-b893-4fce-9308-b7b83ee94639 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:42.879673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458e5f4-1f29-42ca-bbb5-b235a18bf978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:42.881044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e5f4-1f29-42ca-bbb5-b235a18bf978 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:42.881278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e5f4-1f29-42ca-bbb5-b235a18bf978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:42.881729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e5f4-1f29-42ca-bbb5-b235a18bf978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:42.883167 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458e5f4-1f29-42ca-bbb5-b235a18bf978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:42.884149 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458e5f4-1f29-42ca-bbb5-b235a18bf978 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:42.889444 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 991/1975] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:42 2022] PUT /identity/v3/projects/bcd9616cce644daf9c26d0b8d1782ae9/users/92874433831e40208b4e9101f6d37668/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:42.898318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64fc76-fcce-48ed-992e-4080cddd0602 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:42.898614 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64fc76-fcce-48ed-992e-4080cddd0602 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:42.898882 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64fc76-fcce-48ed-992e-4080cddd0602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:42.900211 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 985/1976] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:10:42.903700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458e5f4-1f29-42ca-bbb5-b235a18bf978 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:42.913973 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458e5f4-1f29-42ca-bbb5-b235a18bf978 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:42.930953 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6e64fc76-fcce-48ed-992e-4080cddd0602 None None] MFA Rules not processed for user `92874433831e40208b4e9101f6d37668`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:42.933153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6e64fc76-fcce-48ed-992e-4080cddd0602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:42.975009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:42.991252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054088b4-241b-456d-99c0-d59f4484bda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:42.991968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054088b4-241b-456d-99c0-d59f4484bda7 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:42.992250 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054088b4-241b-456d-99c0-d59f4484bda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:42.992527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054088b4-241b-456d-99c0-d59f4484bda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:42.993261 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054088b4-241b-456d-99c0-d59f4484bda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:42.994919 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054088b4-241b-456d-99c0-d59f4484bda7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:43.009899 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 986/1977] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:10:43.010845 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054088b4-241b-456d-99c0-d59f4484bda7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:43.020466 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 992/1978] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:10:43.022390 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054088b4-241b-456d-99c0-d59f4484bda7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:43.025237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64fc76-fcce-48ed-992e-4080cddd0602 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:43.028567 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8a614-0eba-416d-bf8d-961c7532aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:43.029653 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8a614-0eba-416d-bf8d-961c7532aa91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.030018 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8a614-0eba-416d-bf8d-961c7532aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.030385 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8a614-0eba-416d-bf8d-961c7532aa91 admin admin] PATH_INFO: `/v3/projects/365e18aac5a04e1283479dc21903b37a/users/9c007ee0845046a68da27a8336603b7a/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.038951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64fc76-fcce-48ed-992e-4080cddd0602 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:43.044122 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14759496-21bb-48d4-a990-9df3b89f8a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:43.044809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14759496-21bb-48d4-a990-9df3b89f8a1f admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.045077 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14759496-21bb-48d4-a990-9df3b89f8a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.045355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14759496-21bb-48d4-a990-9df3b89f8a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.046079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14759496-21bb-48d4-a990-9df3b89f8a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:43.048032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14759496-21bb-48d4-a990-9df3b89f8a1f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:43.049129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8a614-0eba-416d-bf8d-961c7532aa91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=365e18aac5a04e1283479dc21903b37a, user_id=9c007ee0845046a68da27a8336603b7a, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:43.052606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8a614-0eba-416d-bf8d-961c7532aa91 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:43.068126 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 987/1979] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:43 2022] PUT /identity/v3/projects/365e18aac5a04e1283479dc21903b37a/users/9c007ee0845046a68da27a8336603b7a/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:43.078697 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 993/1980] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:43 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:10:43.081738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ce008-29d1-4097-b21c-42476def4f68 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.082157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ce008-29d1-4097-b21c-42476def4f68 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.082448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ce008-29d1-4097-b21c-42476def4f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.083272 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14759496-21bb-48d4-a990-9df3b89f8a1f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:43.113753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0e1ce008-29d1-4097-b21c-42476def4f68 None None] MFA Rules not processed for user `9c007ee0845046a68da27a8336603b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:43.115527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0e1ce008-29d1-4097-b21c-42476def4f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:43.141002 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:43.162180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14759496-21bb-48d4-a990-9df3b89f8a1f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:43.169438 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d6aa8-e1d6-443f-a0e5-9daf26f276c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:43.170417 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d6aa8-e1d6-443f-a0e5-9daf26f276c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.170705 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d6aa8-e1d6-443f-a0e5-9daf26f276c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.170995 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d6aa8-e1d6-443f-a0e5-9daf26f276c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.171676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d6aa8-e1d6-443f-a0e5-9daf26f276c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:43.173618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d6aa8-e1d6-443f-a0e5-9daf26f276c1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:43.215579 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 988/1981] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:43.217405 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ce008-29d1-4097-b21c-42476def4f68 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:43.224223 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 994/1982] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:43 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:43.226923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d6aa8-e1d6-443f-a0e5-9daf26f276c1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:43.230689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ce008-29d1-4097-b21c-42476def4f68 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:43.235420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffa26a-0b77-4e38-816e-813093db93ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:43.236078 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffa26a-0b77-4e38-816e-813093db93ba admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.236363 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffa26a-0b77-4e38-816e-813093db93ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.236643 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffa26a-0b77-4e38-816e-813093db93ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.237510 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffa26a-0b77-4e38-816e-813093db93ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:43.239489 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffa26a-0b77-4e38-816e-813093db93ba admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:43.241975 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d6aa8-e1d6-443f-a0e5-9daf26f276c1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:43.248555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33857250-7e5d-4608-bf03-40f84fc950f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:43.249947 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33857250-7e5d-4608-bf03-40f84fc950f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.250428 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33857250-7e5d-4608-bf03-40f84fc950f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.251283 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33857250-7e5d-4608-bf03-40f84fc950f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.252266 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33857250-7e5d-4608-bf03-40f84fc950f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:43.254035 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33857250-7e5d-4608-bf03-40f84fc950f9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:43.266962 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 995/1983] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:43.270789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 989/1984] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:43 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:43.270999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33857250-7e5d-4608-bf03-40f84fc950f9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:43.274282 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffa26a-0b77-4e38-816e-813093db93ba admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:43.286189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33857250-7e5d-4608-bf03-40f84fc950f9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:43.348588 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffa26a-0b77-4e38-816e-813093db93ba admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:43.354400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f7b64-1138-4486-9fd8-c1efa3b890a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:43.355137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f7b64-1138-4486-9fd8-c1efa3b890a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.355409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f7b64-1138-4486-9fd8-c1efa3b890a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.355692 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f7b64-1138-4486-9fd8-c1efa3b890a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.356503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f7b64-1138-4486-9fd8-c1efa3b890a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:43.358463 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f7b64-1138-4486-9fd8-c1efa3b890a1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:43.366570 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aceaeb-2859-43be-bfa1-8e7c823e399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:43.367972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aceaeb-2859-43be-bfa1-8e7c823e399a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.368262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aceaeb-2859-43be-bfa1-8e7c823e399a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.368536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aceaeb-2859-43be-bfa1-8e7c823e399a admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.369305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aceaeb-2859-43be-bfa1-8e7c823e399a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:43.371046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aceaeb-2859-43be-bfa1-8e7c823e399a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:43.382302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 996/1985] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:10:43.383187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aceaeb-2859-43be-bfa1-8e7c823e399a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:43.384927 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b8aceaeb-2859-43be-bfa1-8e7c823e399a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:43.398263 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 990/1986] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:43 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:10:43.399083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f7b64-1138-4486-9fd8-c1efa3b890a1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:43.401136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aceaeb-2859-43be-bfa1-8e7c823e399a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:43.407131 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d4a5b-6d60-4ba9-aac9-52f5b891bb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:43.408191 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d4a5b-6d60-4ba9-aac9-52f5b891bb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.409278 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d4a5b-6d60-4ba9-aac9-52f5b891bb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.409653 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d4a5b-6d60-4ba9-aac9-52f5b891bb77 admin admin] PATH_INFO: `/v3/projects/180bf167b6714b0ca1112d3432f35300` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.410021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f7b64-1138-4486-9fd8-c1efa3b890a1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:43.410983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d4a5b-6d60-4ba9-aac9-52f5b891bb77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=180bf167b6714b0ca1112d3432f35300)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:43.414006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d4a5b-6d60-4ba9-aac9-52f5b891bb77 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:43.416477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bc7c4-3bbb-49ef-ab9d-00f1e1330577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:43.417587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bc7c4-3bbb-49ef-ab9d-00f1e1330577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.417939 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bc7c4-3bbb-49ef-ab9d-00f1e1330577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.419462 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bc7c4-3bbb-49ef-ab9d-00f1e1330577 admin admin] PATH_INFO: `/v3/projects/5f59c79b648a46a0bae8b265df141961/users/33b1eaa2425b48d9bb9c0adf4dc6bad3/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.437511 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:43.442499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bc7c4-3bbb-49ef-ab9d-00f1e1330577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f59c79b648a46a0bae8b265df141961, user_id=33b1eaa2425b48d9bb9c0adf4dc6bad3, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:43.447596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bc7c4-3bbb-49ef-ab9d-00f1e1330577 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:43.468905 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 991/1987] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:43 2022] PUT /identity/v3/projects/5f59c79b648a46a0bae8b265df141961/users/33b1eaa2425b48d9bb9c0adf4dc6bad3/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:43.469969 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bc7c4-3bbb-49ef-ab9d-00f1e1330577 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:43.513734 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4e4d4a5b-6d60-4ba9-aac9-52f5b891bb77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '180bf167b6714b0ca1112d3432f35300', 'request_id': 'req-4e4d4a5b-6d60-4ba9-aac9-52f5b891bb77'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:43.545057 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4e4d4a5b-6d60-4ba9-aac9-52f5b891bb77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '180bf167b6714b0ca1112d3432f35300', 'request_id': 'req-4e4d4a5b-6d60-4ba9-aac9-52f5b891bb77'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:43.561140 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4e4d4a5b-6d60-4ba9-aac9-52f5b891bb77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '180bf167b6714b0ca1112d3432f35300', 'request_id': 'req-4e4d4a5b-6d60-4ba9-aac9-52f5b891bb77'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:43.577568 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4e4d4a5b-6d60-4ba9-aac9-52f5b891bb77 admin admin] The token cache is being invalidate because project 180bf167b6714b0ca1112d3432f35300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:43.578326 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4e4d4a5b-6d60-4ba9-aac9-52f5b891bb77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:43.579277 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4e4d4a5b-6d60-4ba9-aac9-52f5b891bb77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:43.581531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 997/1988] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:43 2022] DELETE /identity/v3/projects/180bf167b6714b0ca1112d3432f35300 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:43.583027 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1d7e3-2610-4292-9898-7e526fda33c9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.583958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1d7e3-2610-4292-9898-7e526fda33c9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.584284 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1d7e3-2610-4292-9898-7e526fda33c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.596882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bc7c4-3bbb-49ef-ab9d-00f1e1330577 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:43.632732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d4a1d7e3-2610-4292-9898-7e526fda33c9 None None] MFA Rules not processed for user `33b1eaa2425b48d9bb9c0adf4dc6bad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:43.634293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d4a1d7e3-2610-4292-9898-7e526fda33c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:43.674333 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fb0ff-f271-4bbe-8059-4d46fcb6f6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:43.675748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fb0ff-f271-4bbe-8059-4d46fcb6f6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.676041 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fb0ff-f271-4bbe-8059-4d46fcb6f6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.676320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fb0ff-f271-4bbe-8059-4d46fcb6f6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.677484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fb0ff-f271-4bbe-8059-4d46fcb6f6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:43.679793 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:43.680125 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fb0ff-f271-4bbe-8059-4d46fcb6f6e6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:43.692270 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 992/1989] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:43.692270 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9322c1-3822-48d6-8e12-aca5a77f942b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.692270 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9322c1-3822-48d6-8e12-aca5a77f942b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.692270 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9322c1-3822-48d6-8e12-aca5a77f942b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.719771 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ed9322c1-3822-48d6-8e12-aca5a77f942b None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:43.720963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ed9322c1-3822-48d6-8e12-aca5a77f942b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:43.737751 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 993/1990] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:43.739714 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9322c1-3822-48d6-8e12-aca5a77f942b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:43.743282 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ed9322c1-3822-48d6-8e12-aca5a77f942b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:43.750659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 998/1991] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:43.752151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64fcf-0a9f-47eb-b343-696fbe975d2a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.752437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64fcf-0a9f-47eb-b343-696fbe975d2a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.752712 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64fcf-0a9f-47eb-b343-696fbe975d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.761394 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9322c1-3822-48d6-8e12-aca5a77f942b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:43.766942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050b47f-e395-489c-9369-68c7026fd4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:43.767614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b47f-e395-489c-9369-68c7026fd4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.767894 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b47f-e395-489c-9369-68c7026fd4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.768171 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b47f-e395-489c-9369-68c7026fd4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.768984 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050b47f-e395-489c-9369-68c7026fd4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:43.771435 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050b47f-e395-489c-9369-68c7026fd4b2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:43.782737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 994/1992] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:43.783721 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050b47f-e395-489c-9369-68c7026fd4b2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:43.787906 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2050b47f-e395-489c-9369-68c7026fd4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:43.789321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-15d64fcf-0a9f-47eb-b343-696fbe975d2a None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:43.790624 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-15d64fcf-0a9f-47eb-b343-696fbe975d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:43.806185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050b47f-e395-489c-9369-68c7026fd4b2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:43.811348 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4c931-f72b-4c71-a890-56e3c0f26126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:43.812010 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4c931-f72b-4c71-a890-56e3c0f26126 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.812291 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4c931-f72b-4c71-a890-56e3c0f26126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.812564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4c931-f72b-4c71-a890-56e3c0f26126 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.813262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4c931-f72b-4c71-a890-56e3c0f26126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:43.815376 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4c931-f72b-4c71-a890-56e3c0f26126 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:43.816637 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 999/1993] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:43.817268 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d64fcf-0a9f-47eb-b343-696fbe975d2a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:43.830762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d64fcf-0a9f-47eb-b343-696fbe975d2a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:43.837474 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d90a0b-87c0-4396-98fe-76ea63a4542e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:43.838368 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d90a0b-87c0-4396-98fe-76ea63a4542e admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.838646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d90a0b-87c0-4396-98fe-76ea63a4542e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.839851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d90a0b-87c0-4396-98fe-76ea63a4542e admin admin] PATH_INFO: `/v3/projects/91114c6b8b234fbc8134c9666c013d7d/users/e97f3a8dddd248ba8043ff969681973c/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.861032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d90a0b-87c0-4396-98fe-76ea63a4542e admin admin] RBAC: Authorizing `identity:create_grant(project_id=91114c6b8b234fbc8134c9666c013d7d, user_id=e97f3a8dddd248ba8043ff969681973c, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:43.864654 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d90a0b-87c0-4396-98fe-76ea63a4542e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:43.865665 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 995/1994] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:43 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:43.867083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4c931-f72b-4c71-a890-56e3c0f26126 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:43.885911 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1000/1995] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:43 2022] PUT /identity/v3/projects/91114c6b8b234fbc8134c9666c013d7d/users/e97f3a8dddd248ba8043ff969681973c/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:43.887564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d90a0b-87c0-4396-98fe-76ea63a4542e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:43.937170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:43.943822 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4c931-f72b-4c71-a890-56e3c0f26126 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:43.969245 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d90a0b-87c0-4396-98fe-76ea63a4542e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:43.974199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122a604-9602-43ef-b957-88ca926de2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:43.974864 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122a604-9602-43ef-b957-88ca926de2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.975143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122a604-9602-43ef-b957-88ca926de2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.975415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122a604-9602-43ef-b957-88ca926de2c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:43.976090 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122a604-9602-43ef-b957-88ca926de2c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:43.978038 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122a604-9602-43ef-b957-88ca926de2c6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:43.997910 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1001/1996] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:43 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:43.999134 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702f141-7b2c-4838-80c0-7dbda4154425 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:43.999418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702f141-7b2c-4838-80c0-7dbda4154425 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:43.999693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702f141-7b2c-4838-80c0-7dbda4154425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.004190 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156106be-9ecd-483f-97fa-9c1786afa91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.004859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156106be-9ecd-483f-97fa-9c1786afa91b admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.005735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156106be-9ecd-483f-97fa-9c1786afa91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.006012 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156106be-9ecd-483f-97fa-9c1786afa91b admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.006739 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156106be-9ecd-483f-97fa-9c1786afa91b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:10:44.007044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156106be-9ecd-483f-97fa-9c1786afa91b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.008633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156106be-9ecd-483f-97fa-9c1786afa91b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.021520 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 996/1997] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:10:44.022340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156106be-9ecd-483f-97fa-9c1786afa91b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.028683 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2702f141-7b2c-4838-80c0-7dbda4154425 None None] MFA Rules not processed for user `e97f3a8dddd248ba8043ff969681973c`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:44.030215 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2702f141-7b2c-4838-80c0-7dbda4154425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:44.034471 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156106be-9ecd-483f-97fa-9c1786afa91b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:44.040865 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2380d-0712-419f-84cb-5cf25e28a2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.041557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2380d-0712-419f-84cb-5cf25e28a2ec admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.041844 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2380d-0712-419f-84cb-5cf25e28a2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.042129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2380d-0712-419f-84cb-5cf25e28a2ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.042962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2380d-0712-419f-84cb-5cf25e28a2ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.044638 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2380d-0712-419f-84cb-5cf25e28a2ec admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.055223 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 997/1998] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:44.058354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2380d-0712-419f-84cb-5cf25e28a2ec admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.069334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2380d-0712-419f-84cb-5cf25e28a2ec admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:44.074357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155acf1-6d60-4165-ac5f-8fddba4c9e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.075442 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155acf1-6d60-4165-ac5f-8fddba4c9e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.075946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155acf1-6d60-4165-ac5f-8fddba4c9e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.076446 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155acf1-6d60-4165-ac5f-8fddba4c9e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.077956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155acf1-6d60-4165-ac5f-8fddba4c9e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.081239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155acf1-6d60-4165-ac5f-8fddba4c9e86 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.095018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1002/1999] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:44.096023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702f141-7b2c-4838-80c0-7dbda4154425 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.107579 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702f141-7b2c-4838-80c0-7dbda4154425 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:44.115157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 998/2000] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:44 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:44.115157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155acf1-6d60-4165-ac5f-8fddba4c9e86 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.116037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d6df6-9e5c-456c-8e10-a7ac2d4c2820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.116919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d6df6-9e5c-456c-8e10-a7ac2d4c2820 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.117229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d6df6-9e5c-456c-8e10-a7ac2d4c2820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.117529 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d6df6-9e5c-456c-8e10-a7ac2d4c2820 admin admin] PATH_INFO: `/v3/projects/8f3616be625943548820c6311908e62c/users/ddbd98dcef664e26b2226fd1959ff80d/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.131927 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d6df6-9e5c-456c-8e10-a7ac2d4c2820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3616be625943548820c6311908e62c, user_id=ddbd98dcef664e26b2226fd1959ff80d, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.134604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d6df6-9e5c-456c-8e10-a7ac2d4c2820 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.144261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:44.149837 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1003/2001] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:44 2022] PUT /identity/v3/projects/8f3616be625943548820c6311908e62c/users/ddbd98dcef664e26b2226fd1959ff80d/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:44.150776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d6df6-9e5c-456c-8e10-a7ac2d4c2820 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.180682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155acf1-6d60-4165-ac5f-8fddba4c9e86 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:44.221109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d6df6-9e5c-456c-8e10-a7ac2d4c2820 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:44.233580 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b91576-ea28-4dc8-8cf2-900f6635317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.234586 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b91576-ea28-4dc8-8cf2-900f6635317d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.234725 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b91576-ea28-4dc8-8cf2-900f6635317d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.234963 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b91576-ea28-4dc8-8cf2-900f6635317d admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.235704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b91576-ea28-4dc8-8cf2-900f6635317d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.237836 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b91576-ea28-4dc8-8cf2-900f6635317d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.244934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a1948-1c75-4d41-aa7f-f8420de5c2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.245852 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1948-1c75-4d41-aa7f-f8420de5c2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.245994 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1948-1c75-4d41-aa7f-f8420de5c2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.246249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1948-1c75-4d41-aa7f-f8420de5c2a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.246938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a1948-1c75-4d41-aa7f-f8420de5c2a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.248911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a1948-1c75-4d41-aa7f-f8420de5c2a6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.264448 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1004/2002] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:44 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:44.264448 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b91576-ea28-4dc8-8cf2-900f6635317d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.266907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:44.276598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b91576-ea28-4dc8-8cf2-900f6635317d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:44.281547 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8257c-7e50-41b9-bfa2-7064db7e48e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.282323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8257c-7e50-41b9-bfa2-7064db7e48e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.282531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 999/2003] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:44 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:44.282615 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8257c-7e50-41b9-bfa2-7064db7e48e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.282961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8257c-7e50-41b9-bfa2-7064db7e48e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.283260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a1948-1c75-4d41-aa7f-f8420de5c2a6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.283961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8257c-7e50-41b9-bfa2-7064db7e48e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.286218 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8257c-7e50-41b9-bfa2-7064db7e48e9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.297999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1005/2004] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:44.298814 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8257c-7e50-41b9-bfa2-7064db7e48e9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.308820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8257c-7e50-41b9-bfa2-7064db7e48e9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:44.361206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a1948-1c75-4d41-aa7f-f8420de5c2a6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:44.367397 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ab256-74fd-4c5a-b76a-68e5caf8f36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.368068 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ab256-74fd-4c5a-b76a-68e5caf8f36b admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.368367 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ab256-74fd-4c5a-b76a-68e5caf8f36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.368742 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ab256-74fd-4c5a-b76a-68e5caf8f36b admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.369503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ab256-74fd-4c5a-b76a-68e5caf8f36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.371141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ab256-74fd-4c5a-b76a-68e5caf8f36b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.375166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527a1e6-0eef-44cf-9d40-c25b1c790ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.375889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527a1e6-0eef-44cf-9d40-c25b1c790ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.376124 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527a1e6-0eef-44cf-9d40-c25b1c790ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.376750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527a1e6-0eef-44cf-9d40-c25b1c790ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.377088 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527a1e6-0eef-44cf-9d40-c25b1c790ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.379099 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527a1e6-0eef-44cf-9d40-c25b1c790ea9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.384660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1000/2005] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:44.385998 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ab256-74fd-4c5a-b76a-68e5caf8f36b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.399347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ab256-74fd-4c5a-b76a-68e5caf8f36b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:44.401100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1006/2006] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:44 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:44.401848 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527a1e6-0eef-44cf-9d40-c25b1c790ea9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.407160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d6c30-bc57-4187-999a-d0d04a89a85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.408134 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d6c30-bc57-4187-999a-d0d04a89a85a admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.408484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d6c30-bc57-4187-999a-d0d04a89a85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.408854 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d6c30-bc57-4187-999a-d0d04a89a85a admin admin] PATH_INFO: `/v3/projects/8f3616be625943548820c6311908e62c/users/ddbd98dcef664e26b2226fd1959ff80d/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.410931 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d6c30-bc57-4187-999a-d0d04a89a85a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3616be625943548820c6311908e62c, user_id=ddbd98dcef664e26b2226fd1959ff80d, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.412850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527a1e6-0eef-44cf-9d40-c25b1c790ea9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:44.414252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d6c30-bc57-4187-999a-d0d04a89a85a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.417529 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91e512-4fd2-4f6b-ad4c-e3b1471881e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.418177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91e512-4fd2-4f6b-ad4c-e3b1471881e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.418463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91e512-4fd2-4f6b-ad4c-e3b1471881e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.418739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91e512-4fd2-4f6b-ad4c-e3b1471881e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.419468 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91e512-4fd2-4f6b-ad4c-e3b1471881e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.421042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91e512-4fd2-4f6b-ad4c-e3b1471881e7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.425300 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1001/2007] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:44 2022] PUT /identity/v3/projects/8f3616be625943548820c6311908e62c/users/ddbd98dcef664e26b2226fd1959ff80d/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:44.430147 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d6c30-bc57-4187-999a-d0d04a89a85a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.431103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1007/2008] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:44.434872 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91e512-4fd2-4f6b-ad4c-e3b1471881e7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.444337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91e512-4fd2-4f6b-ad4c-e3b1471881e7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:44.495067 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d6c30-bc57-4187-999a-d0d04a89a85a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:44.497644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:44.500008 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1f666-a86e-4f81-891e-405fa48e0cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.500737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1f666-a86e-4f81-891e-405fa48e0cbc admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.501015 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1f666-a86e-4f81-891e-405fa48e0cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.501287 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1f666-a86e-4f81-891e-405fa48e0cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.502045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1f666-a86e-4f81-891e-405fa48e0cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.503661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1f666-a86e-4f81-891e-405fa48e0cbc admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.505085 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21c5e7-1c8d-48cd-8627-3e1c6cc22cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.506524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21c5e7-1c8d-48cd-8627-3e1c6cc22cff admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.506805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21c5e7-1c8d-48cd-8627-3e1c6cc22cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.507084 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21c5e7-1c8d-48cd-8627-3e1c6cc22cff admin admin] PATH_INFO: `/v3/projects/d54cb3bc33a0497faf61dfe707177013/users/1286cb003f96449a9d761e1d407fa554/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.518066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1002/2009] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:44.518066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ef37-3b6a-425f-9fcb-c5a982c330b9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.518066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ef37-3b6a-425f-9fcb-c5a982c330b9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.518066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ef37-3b6a-425f-9fcb-c5a982c330b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.524992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21c5e7-1c8d-48cd-8627-3e1c6cc22cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54cb3bc33a0497faf61dfe707177013, user_id=1286cb003f96449a9d761e1d407fa554, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.527663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21c5e7-1c8d-48cd-8627-3e1c6cc22cff admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.542512 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1008/2010] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:44 2022] PUT /identity/v3/projects/d54cb3bc33a0497faf61dfe707177013/users/1286cb003f96449a9d761e1d407fa554/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:44.543294 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21c5e7-1c8d-48cd-8627-3e1c6cc22cff admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.553845 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-16d6ef37-3b6a-425f-9fcb-c5a982c330b9 None None] MFA Rules not processed for user `ddbd98dcef664e26b2226fd1959ff80d`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:44.555418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-16d6ef37-3b6a-425f-9fcb-c5a982c330b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:44.605414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21c5e7-1c8d-48cd-8627-3e1c6cc22cff admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:44.610754 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a9dc9-0599-456b-a0c9-cddd62d3d085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.611843 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a9dc9-0599-456b-a0c9-cddd62d3d085 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.612123 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a9dc9-0599-456b-a0c9-cddd62d3d085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.612396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a9dc9-0599-456b-a0c9-cddd62d3d085 admin admin] PATH_INFO: `/v3/projects/fdc0f76a1fd14fa98b2707ca282614df/users/484ca94e80b64d6ba14a00fa4f2e12f4/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.625486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:44.629535 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a9dc9-0599-456b-a0c9-cddd62d3d085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc0f76a1fd14fa98b2707ca282614df, user_id=484ca94e80b64d6ba14a00fa4f2e12f4, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.631223 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1003/2011] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:44.632552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2d760-c961-4d82-8287-ea1535cca580 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.633801 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2d760-c961-4d82-8287-ea1535cca580 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.634218 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2d760-c961-4d82-8287-ea1535cca580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.644722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a9dc9-0599-456b-a0c9-cddd62d3d085 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.665841 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1009/2012] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:44 2022] PUT /identity/v3/projects/fdc0f76a1fd14fa98b2707ca282614df/users/484ca94e80b64d6ba14a00fa4f2e12f4/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:44.666989 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a9dc9-0599-456b-a0c9-cddd62d3d085 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.668690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-426a9dc9-0599-456b-a0c9-cddd62d3d085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:44.668817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-69c2d760-c961-4d82-8287-ea1535cca580 None None] MFA Rules not processed for user `1286cb003f96449a9d761e1d407fa554`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:44.670136 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-69c2d760-c961-4d82-8287-ea1535cca580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:44.744935 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a9dc9-0599-456b-a0c9-cddd62d3d085 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:44.751071 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee93b1-4090-4cd4-9443-7c90584ebb01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.752176 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee93b1-4090-4cd4-9443-7c90584ebb01 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.752545 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee93b1-4090-4cd4-9443-7c90584ebb01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.753012 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee93b1-4090-4cd4-9443-7c90584ebb01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.753639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1004/2013] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:44.754700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2d760-c961-4d82-8287-ea1535cca580 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.761789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c5ee93b1-4090-4cd4-9443-7c90584ebb01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:44.836636 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee93b1-4090-4cd4-9443-7c90584ebb01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.838116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee93b1-4090-4cd4-9443-7c90584ebb01 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.846131 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2d760-c961-4d82-8287-ea1535cca580 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:44.848182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1010/2014] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:44.848878 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee93b1-4090-4cd4-9443-7c90584ebb01 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.850179 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c5ee93b1-4090-4cd4-9443-7c90584ebb01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:44.852410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f07a64-43cd-4842-897a-0df1cc060ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.852410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07a64-43cd-4842-897a-0df1cc060ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.852410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07a64-43cd-4842-897a-0df1cc060ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.852410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07a64-43cd-4842-897a-0df1cc060ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.853217 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f07a64-43cd-4842-897a-0df1cc060ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.855325 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f07a64-43cd-4842-897a-0df1cc060ea3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.862710 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee93b1-4090-4cd4-9443-7c90584ebb01 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:44.867162 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e19b4-bfbe-4fa6-9c3f-45b6c2ddb335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.867599 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1005/2015] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:44.867973 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e19b4-bfbe-4fa6-9c3f-45b6c2ddb335 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.868317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e19b4-bfbe-4fa6-9c3f-45b6c2ddb335 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.868763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e19b4-bfbe-4fa6-9c3f-45b6c2ddb335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.871711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f07a64-43cd-4842-897a-0df1cc060ea3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.878396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e19b4-bfbe-4fa6-9c3f-45b6c2ddb335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.880705 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e19b4-bfbe-4fa6-9c3f-45b6c2ddb335 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.885104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f07a64-43cd-4842-897a-0df1cc060ea3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:44.890160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddf30a-465c-4962-81a6-412bc07d1039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:44.891196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddf30a-465c-4962-81a6-412bc07d1039 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.891949 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddf30a-465c-4962-81a6-412bc07d1039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.892354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddf30a-465c-4962-81a6-412bc07d1039 admin admin] PATH_INFO: `/v3/projects/fdc0f76a1fd14fa98b2707ca282614df/users/484ca94e80b64d6ba14a00fa4f2e12f4/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.894583 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddf30a-465c-4962-81a6-412bc07d1039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc0f76a1fd14fa98b2707ca282614df, user_id=484ca94e80b64d6ba14a00fa4f2e12f4, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:44.898185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddf30a-465c-4962-81a6-412bc07d1039 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:44.907238 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1011/2016] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:44.924041 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c120d-0c3d-4275-8a29-4cb9f950577a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:44.924330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c120d-0c3d-4275-8a29-4cb9f950577a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:44.924632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c120d-0c3d-4275-8a29-4cb9f950577a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:44.928903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1006/2017] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:44 2022] PUT /identity/v3/projects/fdc0f76a1fd14fa98b2707ca282614df/users/484ca94e80b64d6ba14a00fa4f2e12f4/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:44.930894 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddf30a-465c-4962-81a6-412bc07d1039 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:44.934393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:44.980412 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-786c120d-0c3d-4275-8a29-4cb9f950577a None None] MFA Rules not processed for user `484ca94e80b64d6ba14a00fa4f2e12f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:44.981841 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-786c120d-0c3d-4275-8a29-4cb9f950577a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:45.021099 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddf30a-465c-4962-81a6-412bc07d1039 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:45.035470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d243e-5cf9-4c13-af84-03c8a390c2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:45.035470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d243e-5cf9-4c13-af84-03c8a390c2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:45.035470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d243e-5cf9-4c13-af84-03c8a390c2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:45.035954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d243e-5cf9-4c13-af84-03c8a390c2fd admin admin] PATH_INFO: `/v3/users/1286cb003f96449a9d761e1d407fa554` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:45.038122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d243e-5cf9-4c13-af84-03c8a390c2fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1286cb003f96449a9d761e1d407fa554)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:45.041346 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d243e-5cf9-4c13-af84-03c8a390c2fd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:45.058140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:45.109080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-323d243e-5cf9-4c13-af84-03c8a390c2fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1286cb003f96449a9d761e1d407fa554'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:45.114436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1012/2018] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:10:45.124582 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-323d243e-5cf9-4c13-af84-03c8a390c2fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1286cb003f96449a9d761e1d407fa554'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:45.125237 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-323d243e-5cf9-4c13-af84-03c8a390c2fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1286cb003f96449a9d761e1d407fa554'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:45.133090 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c120d-0c3d-4275-8a29-4cb9f950577a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:45.134045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-323d243e-5cf9-4c13-af84-03c8a390c2fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1286cb003f96449a9d761e1d407fa554'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:45.148111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-323d243e-5cf9-4c13-af84-03c8a390c2fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1286cb003f96449a9d761e1d407fa554'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:45.165792 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1007/2019] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:44 2022] DELETE /identity/v3/users/1286cb003f96449a9d761e1d407fa554 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:45.170225 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817b1da-5ac5-4658-b025-76e860724d5e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:45.170586 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817b1da-5ac5-4658-b025-76e860724d5e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:45.170892 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817b1da-5ac5-4658-b025-76e860724d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:45.189586 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2817b1da-5ac5-4658-b025-76e860724d5e None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:45.191255 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2817b1da-5ac5-4658-b025-76e860724d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:45.211080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c120d-0c3d-4275-8a29-4cb9f950577a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:45.281729 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42fd98-210b-4f86-83af-4bf07f201b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:45.282741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42fd98-210b-4f86-83af-4bf07f201b9c service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:45.283455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42fd98-210b-4f86-83af-4bf07f201b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:45.284989 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42fd98-210b-4f86-83af-4bf07f201b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:45.288362 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dd42fd98-210b-4f86-83af-4bf07f201b9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:45.298254 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1008/2020] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:10:45.313529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817b1da-5ac5-4658-b025-76e860724d5e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:45.315897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2817b1da-5ac5-4658-b025-76e860724d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:45.374921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42fd98-210b-4f86-83af-4bf07f201b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:45.376402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42fd98-210b-4f86-83af-4bf07f201b9c service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:45.383385 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:45.390469 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817b1da-5ac5-4658-b025-76e860724d5e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:45.393524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1013/2021] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:10:45.394713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42fd98-210b-4f86-83af-4bf07f201b9c service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:45.396131 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5d64d-1073-4677-94aa-b4211dfa80dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:45.396454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dd42fd98-210b-4f86-83af-4bf07f201b9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:45.397095 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5d64d-1073-4677-94aa-b4211dfa80dd service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:45.397553 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5d64d-1073-4677-94aa-b4211dfa80dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:45.398067 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5d64d-1073-4677-94aa-b4211dfa80dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:45.414509 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42fd98-210b-4f86-83af-4bf07f201b9c service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:45.418092 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2274126-963b-4a6a-a14c-10b7de56b990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:45.418878 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2274126-963b-4a6a-a14c-10b7de56b990 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:45.419170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2274126-963b-4a6a-a14c-10b7de56b990 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:45.419452 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2274126-963b-4a6a-a14c-10b7de56b990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:45.419627 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5d64d-1073-4677-94aa-b4211dfa80dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:45.421337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b2274126-963b-4a6a-a14c-10b7de56b990 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:45.422955 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5d64d-1073-4677-94aa-b4211dfa80dd service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:45.462341 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1009/2022] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:45.492281 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2274126-963b-4a6a-a14c-10b7de56b990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:45.494418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2274126-963b-4a6a-a14c-10b7de56b990 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:45.507782 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1014/2023] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:46.002349 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5d64d-1073-4677-94aa-b4211dfa80dd service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:46.004201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0af5d64d-1073-4677-94aa-b4211dfa80dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:46.022970 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5d64d-1073-4677-94aa-b4211dfa80dd service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:46.030778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230519d2-4fb1-4392-b1bc-334d78490e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:46.032031 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230519d2-4fb1-4392-b1bc-334d78490e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:46.032867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230519d2-4fb1-4392-b1bc-334d78490e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:46.032867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230519d2-4fb1-4392-b1bc-334d78490e5a admin admin] PATH_INFO: `/v3/projects/d54cb3bc33a0497faf61dfe707177013` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:46.034106 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230519d2-4fb1-4392-b1bc-334d78490e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54cb3bc33a0497faf61dfe707177013)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:46.037783 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230519d2-4fb1-4392-b1bc-334d78490e5a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:46.116475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:46.128293 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-230519d2-4fb1-4392-b1bc-334d78490e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54cb3bc33a0497faf61dfe707177013', 'request_id': 'req-230519d2-4fb1-4392-b1bc-334d78490e5a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:46.135663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-230519d2-4fb1-4392-b1bc-334d78490e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54cb3bc33a0497faf61dfe707177013', 'request_id': 'req-230519d2-4fb1-4392-b1bc-334d78490e5a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:46.141771 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-230519d2-4fb1-4392-b1bc-334d78490e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54cb3bc33a0497faf61dfe707177013', 'request_id': 'req-230519d2-4fb1-4392-b1bc-334d78490e5a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:46.156917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-230519d2-4fb1-4392-b1bc-334d78490e5a admin admin] The token cache is being invalidate because project d54cb3bc33a0497faf61dfe707177013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:46.157204 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-230519d2-4fb1-4392-b1bc-334d78490e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:46.157916 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-230519d2-4fb1-4392-b1bc-334d78490e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:46.159609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1010/2024] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:46 2022] DELETE /identity/v3/projects/d54cb3bc33a0497faf61dfe707177013 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:46.165088 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a631bb-808a-43e4-967c-b64b6c33b614 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:46.165576 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a631bb-808a-43e4-967c-b64b6c33b614 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:46.166037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a631bb-808a-43e4-967c-b64b6c33b614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:46.186361 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-71a631bb-808a-43e4-967c-b64b6c33b614 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:46.187573 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-71a631bb-808a-43e4-967c-b64b6c33b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:46.287251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1015/2025] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:46.294723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890567f-dda3-4556-ada0-8d0b4d057c25 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:46.295015 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890567f-dda3-4556-ada0-8d0b4d057c25 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:46.295296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890567f-dda3-4556-ada0-8d0b4d057c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:46.321721 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b890567f-dda3-4556-ada0-8d0b4d057c25 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:46.323651 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b890567f-dda3-4556-ada0-8d0b4d057c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:46.337022 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1011/2026] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:46.340945 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a631bb-808a-43e4-967c-b64b6c33b614 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:46.358837 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a631bb-808a-43e4-967c-b64b6c33b614 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:46.374732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed94c6c-5eb2-45b6-bae7-24e7916b7181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:46.376869 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed94c6c-5eb2-45b6-bae7-24e7916b7181 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:46.382533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed94c6c-5eb2-45b6-bae7-24e7916b7181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:46.383073 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed94c6c-5eb2-45b6-bae7-24e7916b7181 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:46.384351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed94c6c-5eb2-45b6-bae7-24e7916b7181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:10:46.384854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed94c6c-5eb2-45b6-bae7-24e7916b7181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:46.386980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed94c6c-5eb2-45b6-bae7-24e7916b7181 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:46.412872 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1016/2027] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:10:46.416859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890567f-dda3-4556-ada0-8d0b4d057c25 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:46.432404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890567f-dda3-4556-ada0-8d0b4d057c25 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:46.441085 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681b3ac-b1dc-47df-8b7c-ea6ac584de87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:46.441867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681b3ac-b1dc-47df-8b7c-ea6ac584de87 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:46.442235 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681b3ac-b1dc-47df-8b7c-ea6ac584de87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:46.443131 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681b3ac-b1dc-47df-8b7c-ea6ac584de87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:46.444160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681b3ac-b1dc-47df-8b7c-ea6ac584de87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:46.446489 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681b3ac-b1dc-47df-8b7c-ea6ac584de87 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:46.490538 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1012/2028] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:46 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:46.491531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed94c6c-5eb2-45b6-bae7-24e7916b7181 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:46.504556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed94c6c-5eb2-45b6-bae7-24e7916b7181 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:46.596237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12a14f-bfff-404e-9771-cc2533afbb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:46.597134 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12a14f-bfff-404e-9771-cc2533afbb23 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:46.597848 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12a14f-bfff-404e-9771-cc2533afbb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:46.598444 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12a14f-bfff-404e-9771-cc2533afbb23 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:46.599951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12a14f-bfff-404e-9771-cc2533afbb23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:46.601908 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12a14f-bfff-404e-9771-cc2533afbb23 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:46.629851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1017/2029] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:46 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:46.634145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681b3ac-b1dc-47df-8b7c-ea6ac584de87 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:46.658832 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681b3ac-b1dc-47df-8b7c-ea6ac584de87 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:46.669789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0bc38-472e-4477-8a0b-d656cf524a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:46.670480 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0bc38-472e-4477-8a0b-d656cf524a70 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:46.670762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0bc38-472e-4477-8a0b-d656cf524a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:46.671037 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0bc38-472e-4477-8a0b-d656cf524a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:46.672061 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0bc38-472e-4477-8a0b-d656cf524a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:46.673970 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0bc38-472e-4477-8a0b-d656cf524a70 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:46.690924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1013/2030] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:10:46.692741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12a14f-bfff-404e-9771-cc2533afbb23 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:46.709734 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12a14f-bfff-404e-9771-cc2533afbb23 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:46.718401 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332ff4c-8c92-4f11-8563-6d34eaaa66f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:46.719290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332ff4c-8c92-4f11-8563-6d34eaaa66f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:46.719655 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332ff4c-8c92-4f11-8563-6d34eaaa66f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:46.720000 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332ff4c-8c92-4f11-8563-6d34eaaa66f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:46.720870 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332ff4c-8c92-4f11-8563-6d34eaaa66f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:46.722870 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332ff4c-8c92-4f11-8563-6d34eaaa66f0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:46.736935 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0bc38-472e-4477-8a0b-d656cf524a70 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:46.738833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-01d0bc38-472e-4477-8a0b-d656cf524a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:46.745023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1018/2031] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:46.748929 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332ff4c-8c92-4f11-8563-6d34eaaa66f0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:46.759959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:46.764480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332ff4c-8c92-4f11-8563-6d34eaaa66f0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:46.774982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b95341-1718-4396-8a4e-508056a3f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:46.775996 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b95341-1718-4396-8a4e-508056a3f3a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:46.776379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b95341-1718-4396-8a4e-508056a3f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:46.776755 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b95341-1718-4396-8a4e-508056a3f3a7 admin admin] PATH_INFO: `/v3/projects/1f6e17b6e64c4eb1a8e6f358c3e1bcbb/users/3ce30513dcc846fc82ec79a1d68ad4ce/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:46.796083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b95341-1718-4396-8a4e-508056a3f3a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f6e17b6e64c4eb1a8e6f358c3e1bcbb, user_id=3ce30513dcc846fc82ec79a1d68ad4ce, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:46.799095 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b95341-1718-4396-8a4e-508056a3f3a7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:46.816521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1019/2032] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:46 2022] PUT /identity/v3/projects/1f6e17b6e64c4eb1a8e6f358c3e1bcbb/users/3ce30513dcc846fc82ec79a1d68ad4ce/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:46.821613 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf796e-9037-4625-989a-14b81bb05504 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:46.821901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf796e-9037-4625-989a-14b81bb05504 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:46.822181 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf796e-9037-4625-989a-14b81bb05504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:46.826148 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0bc38-472e-4477-8a0b-d656cf524a70 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:46.843218 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8dcf796e-9037-4625-989a-14b81bb05504 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:46.844424 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8dcf796e-9037-4625-989a-14b81bb05504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:46.896782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83108ef6-79dd-4740-b477-1259f650979e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:46.901536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83108ef6-79dd-4740-b477-1259f650979e service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:46.901923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83108ef6-79dd-4740-b477-1259f650979e service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:46.902376 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83108ef6-79dd-4740-b477-1259f650979e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:46.907104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-83108ef6-79dd-4740-b477-1259f650979e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:46.925050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1020/2033] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:10:46.938579 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf796e-9037-4625-989a-14b81bb05504 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:46.940173 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8dcf796e-9037-4625-989a-14b81bb05504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:46.988175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:47.006084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83108ef6-79dd-4740-b477-1259f650979e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:47.007814 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83108ef6-79dd-4740-b477-1259f650979e service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:47.017319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf796e-9037-4625-989a-14b81bb05504 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:47.024254 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432a903-3882-4c33-ae4b-973660f8003a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:47.024984 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a903-3882-4c33-ae4b-973660f8003a service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:47.025274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a903-3882-4c33-ae4b-973660f8003a service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:47.025606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a903-3882-4c33-ae4b-973660f8003a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:47.042950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432a903-3882-4c33-ae4b-973660f8003a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:47.044594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432a903-3882-4c33-ae4b-973660f8003a service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:47.044958 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1014/2034] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:47.056640 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1021/2035] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:47.119408 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83108ef6-79dd-4740-b477-1259f650979e service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:47.122797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-83108ef6-79dd-4740-b477-1259f650979e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:47.133944 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83108ef6-79dd-4740-b477-1259f650979e service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:47.139186 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60373a76-61d8-40b1-80fc-d951b06a89ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:47.139981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60373a76-61d8-40b1-80fc-d951b06a89ad service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:47.140362 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60373a76-61d8-40b1-80fc-d951b06a89ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:47.140712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60373a76-61d8-40b1-80fc-d951b06a89ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:47.144749 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-60373a76-61d8-40b1-80fc-d951b06a89ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:47.251837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60373a76-61d8-40b1-80fc-d951b06a89ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:47.253924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60373a76-61d8-40b1-80fc-d951b06a89ad service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:47.265853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1015/2036] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:48.101377 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432a903-3882-4c33-ae4b-973660f8003a service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:48.122303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432a903-3882-4c33-ae4b-973660f8003a service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:48.133151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e260dc7-7df3-44c0-994a-908545f2d57d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:48.133853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e260dc7-7df3-44c0-994a-908545f2d57d service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:48.134149 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e260dc7-7df3-44c0-994a-908545f2d57d service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:48.135261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e260dc7-7df3-44c0-994a-908545f2d57d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:48.137393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4e260dc7-7df3-44c0-994a-908545f2d57d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:48.264278 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e260dc7-7df3-44c0-994a-908545f2d57d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:48.267183 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e260dc7-7df3-44c0-994a-908545f2d57d service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:48.281990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1022/2037] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:48.366585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60373a76-61d8-40b1-80fc-d951b06a89ad service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:48.381589 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60373a76-61d8-40b1-80fc-d951b06a89ad service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:48.390536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afa858-514a-4cf1-8587-fe1c12cbc0b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:48.391858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afa858-514a-4cf1-8587-fe1c12cbc0b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:48.392531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afa858-514a-4cf1-8587-fe1c12cbc0b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:48.393182 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afa858-514a-4cf1-8587-fe1c12cbc0b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:48.395491 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e4afa858-514a-4cf1-8587-fe1c12cbc0b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:48.502527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afa858-514a-4cf1-8587-fe1c12cbc0b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:48.504060 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afa858-514a-4cf1-8587-fe1c12cbc0b7 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:48.531342 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1016/2038] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:48.640982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e260dc7-7df3-44c0-994a-908545f2d57d service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:48.643288 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4e260dc7-7df3-44c0-994a-908545f2d57d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:48.681054 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e260dc7-7df3-44c0-994a-908545f2d57d service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:48.693287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6e181-b5e1-472c-82cd-cce8847f1f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:48.694589 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6e181-b5e1-472c-82cd-cce8847f1f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:48.695002 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6e181-b5e1-472c-82cd-cce8847f1f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:48.696907 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6e181-b5e1-472c-82cd-cce8847f1f0f admin admin] PATH_INFO: `/v3/users/2ead7647612e44aca805f9ae0859cc00` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:48.699241 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6e181-b5e1-472c-82cd-cce8847f1f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ead7647612e44aca805f9ae0859cc00)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:48.705955 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6e181-b5e1-472c-82cd-cce8847f1f0f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:48.727153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:48.789478 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1df6e181-b5e1-472c-82cd-cce8847f1f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ead7647612e44aca805f9ae0859cc00'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:48.818382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1df6e181-b5e1-472c-82cd-cce8847f1f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ead7647612e44aca805f9ae0859cc00'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:48.819199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1df6e181-b5e1-472c-82cd-cce8847f1f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ead7647612e44aca805f9ae0859cc00'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:48.819835 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1df6e181-b5e1-472c-82cd-cce8847f1f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ead7647612e44aca805f9ae0859cc00'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:48.841500 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1df6e181-b5e1-472c-82cd-cce8847f1f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ead7647612e44aca805f9ae0859cc00'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:48.868058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1023/2039] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:48 2022] DELETE /identity/v3/users/2ead7647612e44aca805f9ae0859cc00 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:48.870063 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab9ac8-7749-4988-807a-14dafdb87190 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:48.870356 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab9ac8-7749-4988-807a-14dafdb87190 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:48.870674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab9ac8-7749-4988-807a-14dafdb87190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:48.901347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0bab9ac8-7749-4988-807a-14dafdb87190 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:48.902664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0bab9ac8-7749-4988-807a-14dafdb87190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:49.056995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1017/2040] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:49.067201 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6e181-b5e1-472c-82cd-cce8847f1f0f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:49.070127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1df6e181-b5e1-472c-82cd-cce8847f1f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:49.145259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6e181-b5e1-472c-82cd-cce8847f1f0f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:49.169492 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a69b5-275f-4da2-b0e7-634c82162bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:49.170163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a69b5-275f-4da2-b0e7-634c82162bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:49.170408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a69b5-275f-4da2-b0e7-634c82162bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:49.170744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a69b5-275f-4da2-b0e7-634c82162bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:49.190548 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a69b5-275f-4da2-b0e7-634c82162bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:49.192059 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a69b5-275f-4da2-b0e7-634c82162bd0 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:49.236196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1024/2041] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:49.984052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab9ac8-7749-4988-807a-14dafdb87190 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:49.985706 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0bab9ac8-7749-4988-807a-14dafdb87190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:49.999220 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab9ac8-7749-4988-807a-14dafdb87190 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:50.004683 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3671ce9-97d5-49a9-9fab-a06247ffc60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:50.006391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3671ce9-97d5-49a9-9fab-a06247ffc60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:50.006707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3671ce9-97d5-49a9-9fab-a06247ffc60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:50.006981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3671ce9-97d5-49a9-9fab-a06247ffc60d admin admin] PATH_INFO: `/v3/projects/6e4d3eae20f14680923622e20d8ca16b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:50.008299 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3671ce9-97d5-49a9-9fab-a06247ffc60d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e4d3eae20f14680923622e20d8ca16b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:50.010527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3671ce9-97d5-49a9-9fab-a06247ffc60d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:50.034595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:50.102032 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f3671ce9-97d5-49a9-9fab-a06247ffc60d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e4d3eae20f14680923622e20d8ca16b', 'request_id': 'req-f3671ce9-97d5-49a9-9fab-a06247ffc60d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:50.109565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f3671ce9-97d5-49a9-9fab-a06247ffc60d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e4d3eae20f14680923622e20d8ca16b', 'request_id': 'req-f3671ce9-97d5-49a9-9fab-a06247ffc60d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:50.118650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f3671ce9-97d5-49a9-9fab-a06247ffc60d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e4d3eae20f14680923622e20d8ca16b', 'request_id': 'req-f3671ce9-97d5-49a9-9fab-a06247ffc60d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:50.140481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f3671ce9-97d5-49a9-9fab-a06247ffc60d admin admin] The token cache is being invalidate because project 6e4d3eae20f14680923622e20d8ca16b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:50.140930 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f3671ce9-97d5-49a9-9fab-a06247ffc60d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:50.143731 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f3671ce9-97d5-49a9-9fab-a06247ffc60d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:50.146888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1018/2042] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:49 2022] DELETE /identity/v3/projects/6e4d3eae20f14680923622e20d8ca16b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:50.150996 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a69b5-275f-4da2-b0e7-634c82162bd0 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:50.180174 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a69b5-275f-4da2-b0e7-634c82162bd0 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:50.283597 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bf425-3bf1-4aaf-919c-5ce745e67478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:50.284474 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bf425-3bf1-4aaf-919c-5ce745e67478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:50.284947 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bf425-3bf1-4aaf-919c-5ce745e67478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:50.285421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bf425-3bf1-4aaf-919c-5ce745e67478 admin admin] PATH_INFO: `/v3/users/efb52185c47d4a0baa1247f1fbd0e8d4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:50.287253 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bf425-3bf1-4aaf-919c-5ce745e67478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efb52185c47d4a0baa1247f1fbd0e8d4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:50.289354 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bf425-3bf1-4aaf-919c-5ce745e67478 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:50.343704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:50.375292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-564bf425-3bf1-4aaf-919c-5ce745e67478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb52185c47d4a0baa1247f1fbd0e8d4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:50.400762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-564bf425-3bf1-4aaf-919c-5ce745e67478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb52185c47d4a0baa1247f1fbd0e8d4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:50.401694 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-564bf425-3bf1-4aaf-919c-5ce745e67478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb52185c47d4a0baa1247f1fbd0e8d4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:50.402193 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-564bf425-3bf1-4aaf-919c-5ce745e67478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb52185c47d4a0baa1247f1fbd0e8d4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:50.415504 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-564bf425-3bf1-4aaf-919c-5ce745e67478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb52185c47d4a0baa1247f1fbd0e8d4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:50.435159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1025/2043] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:50 2022] DELETE /identity/v3/users/efb52185c47d4a0baa1247f1fbd0e8d4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:52.060088 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3671ce9-97d5-49a9-9fab-a06247ffc60d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:52.062389 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f3671ce9-97d5-49a9-9fab-a06247ffc60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:52.094432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3671ce9-97d5-49a9-9fab-a06247ffc60d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:52.256805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edeece-60a3-4776-bab2-17576723e8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:52.258195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edeece-60a3-4776-bab2-17576723e8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:52.258486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edeece-60a3-4776-bab2-17576723e8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:52.258809 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edeece-60a3-4776-bab2-17576723e8e6 admin admin] PATH_INFO: `/v3/projects/7455011e81454bcaa87818e232fd3c06` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:52.260200 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edeece-60a3-4776-bab2-17576723e8e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7455011e81454bcaa87818e232fd3c06)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:52.262488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edeece-60a3-4776-bab2-17576723e8e6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:52.346780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c5edeece-60a3-4776-bab2-17576723e8e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7455011e81454bcaa87818e232fd3c06', 'request_id': 'req-c5edeece-60a3-4776-bab2-17576723e8e6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:52.359514 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c5edeece-60a3-4776-bab2-17576723e8e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7455011e81454bcaa87818e232fd3c06', 'request_id': 'req-c5edeece-60a3-4776-bab2-17576723e8e6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:52.376227 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c5edeece-60a3-4776-bab2-17576723e8e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7455011e81454bcaa87818e232fd3c06', 'request_id': 'req-c5edeece-60a3-4776-bab2-17576723e8e6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:52.390307 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c5edeece-60a3-4776-bab2-17576723e8e6 admin admin] The token cache is being invalidate because project 7455011e81454bcaa87818e232fd3c06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:52.390610 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c5edeece-60a3-4776-bab2-17576723e8e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:52.392286 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c5edeece-60a3-4776-bab2-17576723e8e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:52.393677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1019/2044] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:52 2022] DELETE /identity/v3/projects/7455011e81454bcaa87818e232fd3c06 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:52.398198 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bf425-3bf1-4aaf-919c-5ce745e67478 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:52.400381 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-564bf425-3bf1-4aaf-919c-5ce745e67478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:52.418220 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bf425-3bf1-4aaf-919c-5ce745e67478 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:52.512610 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7b893-f537-48bb-b2ac-a8c91eb0bac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:52.513540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7b893-f537-48bb-b2ac-a8c91eb0bac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:52.513825 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7b893-f537-48bb-b2ac-a8c91eb0bac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:52.514101 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7b893-f537-48bb-b2ac-a8c91eb0bac9 admin admin] PATH_INFO: `/v3/users/e9d4ef5e9c4a46378d3e237a0b613027` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:52.516484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7b893-f537-48bb-b2ac-a8c91eb0bac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9d4ef5e9c4a46378d3e237a0b613027)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:52.523155 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7b893-f537-48bb-b2ac-a8c91eb0bac9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:52.626978 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2bd7b893-f537-48bb-b2ac-a8c91eb0bac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9d4ef5e9c4a46378d3e237a0b613027'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:52.644198 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2bd7b893-f537-48bb-b2ac-a8c91eb0bac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9d4ef5e9c4a46378d3e237a0b613027'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:52.647465 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2bd7b893-f537-48bb-b2ac-a8c91eb0bac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9d4ef5e9c4a46378d3e237a0b613027'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:52.648198 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2bd7b893-f537-48bb-b2ac-a8c91eb0bac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9d4ef5e9c4a46378d3e237a0b613027'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:52.659141 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2bd7b893-f537-48bb-b2ac-a8c91eb0bac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9d4ef5e9c4a46378d3e237a0b613027'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:52.698577 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1026/2045] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:52 2022] DELETE /identity/v3/users/e9d4ef5e9c4a46378d3e237a0b613027 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:53.268350 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edeece-60a3-4776-bab2-17576723e8e6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:53.271514 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c5edeece-60a3-4776-bab2-17576723e8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:53.326898 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edeece-60a3-4776-bab2-17576723e8e6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:53.331206 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7b893-f537-48bb-b2ac-a8c91eb0bac9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:53.333423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2bd7b893-f537-48bb-b2ac-a8c91eb0bac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:53.384629 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:53.429629 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:53.430126 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f24ec1-e306-45e0-868f-926036a29637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:53.434001 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f24ec1-e306-45e0-868f-926036a29637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:53.434939 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f24ec1-e306-45e0-868f-926036a29637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:53.435297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f24ec1-e306-45e0-868f-926036a29637 admin admin] PATH_INFO: `/v3/projects/882609aced4b4deab1088e9d1b512325` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:53.439080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f24ec1-e306-45e0-868f-926036a29637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=882609aced4b4deab1088e9d1b512325)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:53.445177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f24ec1-e306-45e0-868f-926036a29637 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:53.505798 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7b893-f537-48bb-b2ac-a8c91eb0bac9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:53.512829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab1e1d-13e0-41f3-ae2b-0fefb083fe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:53.513876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab1e1d-13e0-41f3-ae2b-0fefb083fe71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:53.516084 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab1e1d-13e0-41f3-ae2b-0fefb083fe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:53.516915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab1e1d-13e0-41f3-ae2b-0fefb083fe71 admin admin] PATH_INFO: `/v3/users/92874433831e40208b4e9101f6d37668` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:53.519021 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab1e1d-13e0-41f3-ae2b-0fefb083fe71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92874433831e40208b4e9101f6d37668)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:53.525329 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab1e1d-13e0-41f3-ae2b-0fefb083fe71 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:53.549604 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-47f24ec1-e306-45e0-868f-926036a29637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882609aced4b4deab1088e9d1b512325', 'request_id': 'req-47f24ec1-e306-45e0-868f-926036a29637'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:53.557562 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-47f24ec1-e306-45e0-868f-926036a29637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882609aced4b4deab1088e9d1b512325', 'request_id': 'req-47f24ec1-e306-45e0-868f-926036a29637'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:53.567157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-47f24ec1-e306-45e0-868f-926036a29637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882609aced4b4deab1088e9d1b512325', 'request_id': 'req-47f24ec1-e306-45e0-868f-926036a29637'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:53.619166 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-47f24ec1-e306-45e0-868f-926036a29637 admin admin] The token cache is being invalidate because project 882609aced4b4deab1088e9d1b512325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:53.620015 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-47f24ec1-e306-45e0-868f-926036a29637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:53.620767 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-47f24ec1-e306-45e0-868f-926036a29637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:53.627276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1020/2046] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:53 2022] DELETE /identity/v3/projects/882609aced4b4deab1088e9d1b512325 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:53.627276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f24ec1-e306-45e0-868f-926036a29637 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:53.627276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-47f24ec1-e306-45e0-868f-926036a29637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:53.640207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bdab1e1d-13e0-41f3-ae2b-0fefb083fe71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92874433831e40208b4e9101f6d37668'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:53.669587 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bdab1e1d-13e0-41f3-ae2b-0fefb083fe71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92874433831e40208b4e9101f6d37668'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:53.670301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bdab1e1d-13e0-41f3-ae2b-0fefb083fe71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92874433831e40208b4e9101f6d37668'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:53.671082 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bdab1e1d-13e0-41f3-ae2b-0fefb083fe71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92874433831e40208b4e9101f6d37668'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:53.694273 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bdab1e1d-13e0-41f3-ae2b-0fefb083fe71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92874433831e40208b4e9101f6d37668'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:53.716582 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1027/2047] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:53 2022] DELETE /identity/v3/users/92874433831e40208b4e9101f6d37668 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:53.717942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0a86e-0f3d-4f08-bf29-44a6210e6de4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:53.718232 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0a86e-0f3d-4f08-bf29-44a6210e6de4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:53.718512 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0a86e-0f3d-4f08-bf29-44a6210e6de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:53.786919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-79c0a86e-0f3d-4f08-bf29-44a6210e6de4 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:53.792415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-79c0a86e-0f3d-4f08-bf29-44a6210e6de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:53.806797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f24ec1-e306-45e0-868f-926036a29637 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:53.945606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1028/2048] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:53.947142 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646a5ea-c72d-4551-a3d9-66455bf9a14f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:53.947497 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646a5ea-c72d-4551-a3d9-66455bf9a14f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:53.947862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646a5ea-c72d-4551-a3d9-66455bf9a14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:53.968358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3143e2-bc82-4170-9eba-5d1c46573e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:53.970224 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3143e2-bc82-4170-9eba-5d1c46573e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:53.972716 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3143e2-bc82-4170-9eba-5d1c46573e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:53.973177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3143e2-bc82-4170-9eba-5d1c46573e14 admin admin] PATH_INFO: `/v3/users/9c007ee0845046a68da27a8336603b7a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:53.976328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a646a5ea-c72d-4551-a3d9-66455bf9a14f None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:53.978094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a646a5ea-c72d-4551-a3d9-66455bf9a14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:53.978210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3143e2-bc82-4170-9eba-5d1c46573e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c007ee0845046a68da27a8336603b7a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:53.985110 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3143e2-bc82-4170-9eba-5d1c46573e14 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:53.994982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1029/2049] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:54.000378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa05068-cc55-4373-9320-138a31fa74c8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:54.001854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa05068-cc55-4373-9320-138a31fa74c8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:54.003513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa05068-cc55-4373-9320-138a31fa74c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:54.019010 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:54.055019 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5aa05068-cc55-4373-9320-138a31fa74c8 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:54.056959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5aa05068-cc55-4373-9320-138a31fa74c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:54.086442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1030/2050] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:54.086442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa05068-cc55-4373-9320-138a31fa74c8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:54.087375 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ec3143e2-bc82-4170-9eba-5d1c46573e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c007ee0845046a68da27a8336603b7a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:54.088280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5aa05068-cc55-4373-9320-138a31fa74c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:54.126423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ec3143e2-bc82-4170-9eba-5d1c46573e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c007ee0845046a68da27a8336603b7a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:54.127277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ec3143e2-bc82-4170-9eba-5d1c46573e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c007ee0845046a68da27a8336603b7a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:54.128891 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ec3143e2-bc82-4170-9eba-5d1c46573e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c007ee0845046a68da27a8336603b7a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:54.146486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ec3143e2-bc82-4170-9eba-5d1c46573e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c007ee0845046a68da27a8336603b7a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:54.175415 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1021/2051] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:53 2022] DELETE /identity/v3/users/9c007ee0845046a68da27a8336603b7a => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:54.180482 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:54.187895 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3143e2-bc82-4170-9eba-5d1c46573e14 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:54.193481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ec3143e2-bc82-4170-9eba-5d1c46573e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:54.238854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa05068-cc55-4373-9320-138a31fa74c8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:54.376312 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a48bbc-a560-4674-aa34-266150edab62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:54.376995 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a48bbc-a560-4674-aa34-266150edab62 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:54.377277 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a48bbc-a560-4674-aa34-266150edab62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:54.377596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a48bbc-a560-4674-aa34-266150edab62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:54.381091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-00a48bbc-a560-4674-aa34-266150edab62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:54.451436 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3143e2-bc82-4170-9eba-5d1c46573e14 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:54.469503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b778c03-ebb4-4213-8f9a-3f54a426324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:54.470193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b778c03-ebb4-4213-8f9a-3f54a426324a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:54.470472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b778c03-ebb4-4213-8f9a-3f54a426324a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:54.470742 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b778c03-ebb4-4213-8f9a-3f54a426324a admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:54.471541 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b778c03-ebb4-4213-8f9a-3f54a426324a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:10:54.471848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b778c03-ebb4-4213-8f9a-3f54a426324a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:54.474003 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b778c03-ebb4-4213-8f9a-3f54a426324a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:54.482589 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a48bbc-a560-4674-aa34-266150edab62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:54.484074 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a48bbc-a560-4674-aa34-266150edab62 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:54.491869 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1022/2052] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:10:54.493290 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfcf21-0f2d-4ace-9871-4cc6fa40294a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:54.493630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfcf21-0f2d-4ace-9871-4cc6fa40294a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:54.493906 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfcf21-0f2d-4ace-9871-4cc6fa40294a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:54.514282 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1031/2053] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:10:54.515240 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a48bbc-a560-4674-aa34-266150edab62 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:54.532995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-37dfcf21-0f2d-4ace-9871-4cc6fa40294a None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:54.534256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-37dfcf21-0f2d-4ace-9871-4cc6fa40294a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:54.535642 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a48bbc-a560-4674-aa34-266150edab62 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:54.551481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488eb6d-b139-4935-8a36-82c1e0b919ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:54.555257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488eb6d-b139-4935-8a36-82c1e0b919ab admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:54.556467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488eb6d-b139-4935-8a36-82c1e0b919ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:54.557147 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488eb6d-b139-4935-8a36-82c1e0b919ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:54.558285 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488eb6d-b139-4935-8a36-82c1e0b919ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:54.560546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488eb6d-b139-4935-8a36-82c1e0b919ab admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:54.593864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1023/2054] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:54.609549 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1032/2055] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:54 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:54.613704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfcf21-0f2d-4ace-9871-4cc6fa40294a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:54.615594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488eb6d-b139-4935-8a36-82c1e0b919ab admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:54.617797 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9488eb6d-b139-4935-8a36-82c1e0b919ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:54.644572 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfcf21-0f2d-4ace-9871-4cc6fa40294a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:54.764648 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7e2b6-ba34-464a-bffa-ef75ef474e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:54.765345 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7e2b6-ba34-464a-bffa-ef75ef474e3c admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:54.765640 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488eb6d-b139-4935-8a36-82c1e0b919ab admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:54.768547 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7e2b6-ba34-464a-bffa-ef75ef474e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:54.768885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7e2b6-ba34-464a-bffa-ef75ef474e3c admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:54.771978 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0333aa-0736-49d6-93b9-8fe9876580ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:54.772951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0333aa-0736-49d6-93b9-8fe9876580ab service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:54.773502 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0333aa-0736-49d6-93b9-8fe9876580ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:54.774010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0333aa-0736-49d6-93b9-8fe9876580ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:54.774845 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7e2b6-ba34-464a-bffa-ef75ef474e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:54.776818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7e2b6-ba34-464a-bffa-ef75ef474e3c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:54.803355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0333aa-0736-49d6-93b9-8fe9876580ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:54.805175 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0333aa-0736-49d6-93b9-8fe9876580ab service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:54.821887 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1024/2056] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:54 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:54.822774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7e2b6-ba34-464a-bffa-ef75ef474e3c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:54.843496 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1033/2057] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:54.845305 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7e2b6-ba34-464a-bffa-ef75ef474e3c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:54.854836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afbc9c-6f57-46a1-95d7-dd918ba48073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:54.855662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afbc9c-6f57-46a1-95d7-dd918ba48073 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:54.855945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afbc9c-6f57-46a1-95d7-dd918ba48073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:54.856219 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afbc9c-6f57-46a1-95d7-dd918ba48073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:54.857069 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afbc9c-6f57-46a1-95d7-dd918ba48073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:54.858608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afbc9c-6f57-46a1-95d7-dd918ba48073 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:54.871750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:54.904784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1025/2058] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:54.906168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0333aa-0736-49d6-93b9-8fe9876580ab service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:54.920152 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0333aa-0736-49d6-93b9-8fe9876580ab service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:54.934226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0623655-ea36-4949-b4d2-9c871da9c270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:54.935117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0623655-ea36-4949-b4d2-9c871da9c270 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:54.935479 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0623655-ea36-4949-b4d2-9c871da9c270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:54.935852 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0623655-ea36-4949-b4d2-9c871da9c270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:54.937515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0623655-ea36-4949-b4d2-9c871da9c270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:54.940608 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0623655-ea36-4949-b4d2-9c871da9c270 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:54.973097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afbc9c-6f57-46a1-95d7-dd918ba48073 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:54.976247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1034/2059] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:54.986684 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afbc9c-6f57-46a1-95d7-dd918ba48073 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:54.993943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15155e5-f20b-4475-831d-e7ef2b39bfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:54.995075 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15155e5-f20b-4475-831d-e7ef2b39bfd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:54.995598 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15155e5-f20b-4475-831d-e7ef2b39bfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:54.996253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15155e5-f20b-4475-831d-e7ef2b39bfd7 admin admin] PATH_INFO: `/v3/projects/a9fe2c42c33a484a8fc9c4615ca95e05/users/891c4f916715491bbf610425fe339777/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:55.014874 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15155e5-f20b-4475-831d-e7ef2b39bfd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9fe2c42c33a484a8fc9c4615ca95e05, user_id=891c4f916715491bbf610425fe339777, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:55.018614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15155e5-f20b-4475-831d-e7ef2b39bfd7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:55.049235 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1026/2060] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:54 2022] PUT /identity/v3/projects/a9fe2c42c33a484a8fc9c4615ca95e05/users/891c4f916715491bbf610425fe339777/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:55.056257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292e6d6-51a6-46c7-96a4-e79992a27384 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:55.056257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292e6d6-51a6-46c7-96a4-e79992a27384 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:55.056820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292e6d6-51a6-46c7-96a4-e79992a27384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:55.088890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c292e6d6-51a6-46c7-96a4-e79992a27384 None None] MFA Rules not processed for user `891c4f916715491bbf610425fe339777`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:55.091443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:55.092509 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c292e6d6-51a6-46c7-96a4-e79992a27384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:55.193433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1035/2061] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:55.200381 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15155e5-f20b-4475-831d-e7ef2b39bfd7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:55.295361 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15155e5-f20b-4475-831d-e7ef2b39bfd7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:55.301111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae6cc1-ce3a-4a03-9501-6c67f374b6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:55.302604 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae6cc1-ce3a-4a03-9501-6c67f374b6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:55.302748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae6cc1-ce3a-4a03-9501-6c67f374b6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:55.302958 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae6cc1-ce3a-4a03-9501-6c67f374b6f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:55.303646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae6cc1-ce3a-4a03-9501-6c67f374b6f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:55.305729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae6cc1-ce3a-4a03-9501-6c67f374b6f5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:55.345625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292e6d6-51a6-46c7-96a4-e79992a27384 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:55.347232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1027/2062] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:55 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:55.350829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a359cf1-bfa0-45e8-ba6e-1b654d2550d1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:55.352616 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a359cf1-bfa0-45e8-ba6e-1b654d2550d1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:55.353673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a359cf1-bfa0-45e8-ba6e-1b654d2550d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:55.362006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292e6d6-51a6-46c7-96a4-e79992a27384 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:55.420654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4a359cf1-bfa0-45e8-ba6e-1b654d2550d1 None None] MFA Rules not processed for user `3ce30513dcc846fc82ec79a1d68ad4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:55.422313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4a359cf1-bfa0-45e8-ba6e-1b654d2550d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:55.455562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6759b-7701-4fd6-bff0-c8d836d0238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:55.456757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6759b-7701-4fd6-bff0-c8d836d0238c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:55.457116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6759b-7701-4fd6-bff0-c8d836d0238c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:55.457501 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6759b-7701-4fd6-bff0-c8d836d0238c admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:55.458474 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6759b-7701-4fd6-bff0-c8d836d0238c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:55.465864 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6759b-7701-4fd6-bff0-c8d836d0238c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:55.499930 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1036/2063] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:55 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:55.503591 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6759b-7701-4fd6-bff0-c8d836d0238c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:55.516198 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6759b-7701-4fd6-bff0-c8d836d0238c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:55.523593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411d8a8-5a52-4e1b-bcf8-7183bf2579f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:55.524898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411d8a8-5a52-4e1b-bcf8-7183bf2579f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:55.525237 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411d8a8-5a52-4e1b-bcf8-7183bf2579f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:55.525634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411d8a8-5a52-4e1b-bcf8-7183bf2579f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:55.527207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411d8a8-5a52-4e1b-bcf8-7183bf2579f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:55.529289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411d8a8-5a52-4e1b-bcf8-7183bf2579f2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:55.533344 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1028/2064] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:55.534839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a359cf1-bfa0-45e8-ba6e-1b654d2550d1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:55.538116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4a359cf1-bfa0-45e8-ba6e-1b654d2550d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:55.552437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1037/2065] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:10:55.556057 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a359cf1-bfa0-45e8-ba6e-1b654d2550d1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:55.557112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411d8a8-5a52-4e1b-bcf8-7183bf2579f2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:55.573805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa323d4e-74db-4c86-8d07-80715940274b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:55.574226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411d8a8-5a52-4e1b-bcf8-7183bf2579f2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:55.575397 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa323d4e-74db-4c86-8d07-80715940274b admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:55.576011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa323d4e-74db-4c86-8d07-80715940274b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:55.576446 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa323d4e-74db-4c86-8d07-80715940274b admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:55.577349 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa323d4e-74db-4c86-8d07-80715940274b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:55.579770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a729337-f83d-4a90-9f62-e75ee601c2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:55.579986 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa323d4e-74db-4c86-8d07-80715940274b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:55.580609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a729337-f83d-4a90-9f62-e75ee601c2f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:55.580902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a729337-f83d-4a90-9f62-e75ee601c2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:55.581391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a729337-f83d-4a90-9f62-e75ee601c2f8 admin admin] PATH_INFO: `/v3/projects/794770a3c825488cb0acc8af6df708a7/users/f4ff4dd34d1248e18cd2d0325e23c5c4/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:55.615678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a729337-f83d-4a90-9f62-e75ee601c2f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=794770a3c825488cb0acc8af6df708a7, user_id=f4ff4dd34d1248e18cd2d0325e23c5c4, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:55.622662 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a729337-f83d-4a90-9f62-e75ee601c2f8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:55.644860 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1029/2066] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:55 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:55.644860 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa323d4e-74db-4c86-8d07-80715940274b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:55.647306 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-aa323d4e-74db-4c86-8d07-80715940274b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:55.670810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1038/2067] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:55 2022] PUT /identity/v3/projects/794770a3c825488cb0acc8af6df708a7/users/f4ff4dd34d1248e18cd2d0325e23c5c4/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:55.671818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a729337-f83d-4a90-9f62-e75ee601c2f8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:55.698964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:55.752955 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:55.761666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a729337-f83d-4a90-9f62-e75ee601c2f8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:55.798981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa323d4e-74db-4c86-8d07-80715940274b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:55.808395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:55.809396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:55.809750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:55.810108 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284 admin admin] PATH_INFO: `/v3/projects/bcd9616cce644daf9c26d0b8d1782ae9` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:55.815096 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd9616cce644daf9c26d0b8d1782ae9)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:55.815096 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:55.886789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af623c90-96cb-4883-bd75-18b98baa9252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:55.887484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623c90-96cb-4883-bd75-18b98baa9252 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:55.887942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623c90-96cb-4883-bd75-18b98baa9252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:55.888235 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623c90-96cb-4883-bd75-18b98baa9252 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:55.889153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af623c90-96cb-4883-bd75-18b98baa9252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:55.892400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af623c90-96cb-4883-bd75-18b98baa9252 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:55.914338 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd9616cce644daf9c26d0b8d1782ae9', 'request_id': 'req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:55.923759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd9616cce644daf9c26d0b8d1782ae9', 'request_id': 'req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:55.930138 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1039/2068] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:55 2022] POST /identity/v3/users => generated 296 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:55.931185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af623c90-96cb-4883-bd75-18b98baa9252 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:55.937991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd9616cce644daf9c26d0b8d1782ae9', 'request_id': 'req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:55.948925 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af623c90-96cb-4883-bd75-18b98baa9252 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:55.984528 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284 admin admin] The token cache is being invalidate because project bcd9616cce644daf9c26d0b8d1782ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:55.984884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:55.985971 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:55.988839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1030/2069] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:55 2022] DELETE /identity/v3/projects/bcd9616cce644daf9c26d0b8d1782ae9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:55.993978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:55.998969 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:56.075102 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9db2a3-109d-4c32-ab9f-baa382ddacd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:56.077259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9db2a3-109d-4c32-ab9f-baa382ddacd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:56.078299 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9db2a3-109d-4c32-ab9f-baa382ddacd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:56.078774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9db2a3-109d-4c32-ab9f-baa382ddacd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:56.080794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9db2a3-109d-4c32-ab9f-baa382ddacd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:56.084159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9db2a3-109d-4c32-ab9f-baa382ddacd9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:56.101140 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1040/2070] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:56.104449 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9db2a3-109d-4c32-ab9f-baa382ddacd9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:56.107669 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-df9db2a3-109d-4c32-ab9f-baa382ddacd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:56.139481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499b28e-77be-4cc9-9ad9-5e5a9dc0d284 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:56.142493 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9db2a3-109d-4c32-ab9f-baa382ddacd9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:56.169344 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfef208-ba42-474e-aef6-06371645b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:56.169941 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13939d4-6662-41dc-92f7-90132bf03599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:56.170639 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13939d4-6662-41dc-92f7-90132bf03599 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:56.170928 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13939d4-6662-41dc-92f7-90132bf03599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:56.171495 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13939d4-6662-41dc-92f7-90132bf03599 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:56.178454 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfef208-ba42-474e-aef6-06371645b0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:56.179255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13939d4-6662-41dc-92f7-90132bf03599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:56.180365 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfef208-ba42-474e-aef6-06371645b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:56.180868 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfef208-ba42-474e-aef6-06371645b0e6 admin admin] PATH_INFO: `/v3/projects/365e18aac5a04e1283479dc21903b37a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:56.181109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13939d4-6662-41dc-92f7-90132bf03599 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:56.183325 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfef208-ba42-474e-aef6-06371645b0e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=365e18aac5a04e1283479dc21903b37a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:56.185817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfef208-ba42-474e-aef6-06371645b0e6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:56.206467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1041/2071] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:56.207006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13939d4-6662-41dc-92f7-90132bf03599 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:56.210672 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b13939d4-6662-41dc-92f7-90132bf03599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:56.230200 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13939d4-6662-41dc-92f7-90132bf03599 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:56.236574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54565179-4b5a-4678-8e74-2676d72bd7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:56.237926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54565179-4b5a-4678-8e74-2676d72bd7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:56.238415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54565179-4b5a-4678-8e74-2676d72bd7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:56.238951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54565179-4b5a-4678-8e74-2676d72bd7f1 admin admin] PATH_INFO: `/v3/users/33b1eaa2425b48d9bb9c0adf4dc6bad3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:56.240824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54565179-4b5a-4678-8e74-2676d72bd7f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b1eaa2425b48d9bb9c0adf4dc6bad3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:56.243323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54565179-4b5a-4678-8e74-2676d72bd7f1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:56.267318 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4bfef208-ba42-474e-aef6-06371645b0e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '365e18aac5a04e1283479dc21903b37a', 'request_id': 'req-4bfef208-ba42-474e-aef6-06371645b0e6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:56.276606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4bfef208-ba42-474e-aef6-06371645b0e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '365e18aac5a04e1283479dc21903b37a', 'request_id': 'req-4bfef208-ba42-474e-aef6-06371645b0e6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:56.282059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:56.286450 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4bfef208-ba42-474e-aef6-06371645b0e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '365e18aac5a04e1283479dc21903b37a', 'request_id': 'req-4bfef208-ba42-474e-aef6-06371645b0e6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:56.314371 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4bfef208-ba42-474e-aef6-06371645b0e6 admin admin] The token cache is being invalidate because project 365e18aac5a04e1283479dc21903b37a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:56.314730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4bfef208-ba42-474e-aef6-06371645b0e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:56.315451 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4bfef208-ba42-474e-aef6-06371645b0e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:56.317930 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1031/2072] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:55 2022] DELETE /identity/v3/projects/365e18aac5a04e1283479dc21903b37a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:56.318711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfef208-ba42-474e-aef6-06371645b0e6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:56.320049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4bfef208-ba42-474e-aef6-06371645b0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:56.322442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-54565179-4b5a-4678-8e74-2676d72bd7f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b1eaa2425b48d9bb9c0adf4dc6bad3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:56.335998 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-54565179-4b5a-4678-8e74-2676d72bd7f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b1eaa2425b48d9bb9c0adf4dc6bad3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:56.336738 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-54565179-4b5a-4678-8e74-2676d72bd7f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b1eaa2425b48d9bb9c0adf4dc6bad3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:56.338020 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-54565179-4b5a-4678-8e74-2676d72bd7f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b1eaa2425b48d9bb9c0adf4dc6bad3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:56.354456 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-54565179-4b5a-4678-8e74-2676d72bd7f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b1eaa2425b48d9bb9c0adf4dc6bad3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:56.358299 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:56.391273 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1042/2073] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:56 2022] DELETE /identity/v3/users/33b1eaa2425b48d9bb9c0adf4dc6bad3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:56.391273 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54565179-4b5a-4678-8e74-2676d72bd7f1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:56.393314 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-54565179-4b5a-4678-8e74-2676d72bd7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:56.432144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfef208-ba42-474e-aef6-06371645b0e6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:56.480971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54565179-4b5a-4678-8e74-2676d72bd7f1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:56.486116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d7986-04de-407a-a427-80d9f69ee036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:56.487156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d7986-04de-407a-a427-80d9f69ee036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:56.487443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d7986-04de-407a-a427-80d9f69ee036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:56.487816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d7986-04de-407a-a427-80d9f69ee036 admin admin] PATH_INFO: `/v3/projects/82befa97308542d88aa2b5a29dcb4299/users/e3c2cdaa5c69445f804fcb1dc21b848f/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:56.516427 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d7986-04de-407a-a427-80d9f69ee036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82befa97308542d88aa2b5a29dcb4299, user_id=e3c2cdaa5c69445f804fcb1dc21b848f, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:56.519620 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d7986-04de-407a-a427-80d9f69ee036 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:56.541566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1043/2074] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:56 2022] PUT /identity/v3/projects/82befa97308542d88aa2b5a29dcb4299/users/e3c2cdaa5c69445f804fcb1dc21b848f/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:56.542589 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d7986-04de-407a-a427-80d9f69ee036 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:56.548566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-051d7986-04de-407a-a427-80d9f69ee036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:56.550455 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ad6e3-c232-4d24-8eb9-bee87652e0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:56.552014 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ad6e3-c232-4d24-8eb9-bee87652e0ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:56.552820 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ad6e3-c232-4d24-8eb9-bee87652e0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:56.553117 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ad6e3-c232-4d24-8eb9-bee87652e0ec admin admin] PATH_INFO: `/v3/projects/794770a3c825488cb0acc8af6df708a7/users/f4ff4dd34d1248e18cd2d0325e23c5c4/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:56.555299 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ad6e3-c232-4d24-8eb9-bee87652e0ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=794770a3c825488cb0acc8af6df708a7, user_id=f4ff4dd34d1248e18cd2d0325e23c5c4, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:56.558191 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ad6e3-c232-4d24-8eb9-bee87652e0ec admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:56.575792 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1032/2075] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:56 2022] PUT /identity/v3/projects/794770a3c825488cb0acc8af6df708a7/users/f4ff4dd34d1248e18cd2d0325e23c5c4/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:56.576913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ad6e3-c232-4d24-8eb9-bee87652e0ec admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:56.693740 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d7986-04de-407a-a427-80d9f69ee036 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:56.745929 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ad6e3-c232-4d24-8eb9-bee87652e0ec admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:56.757478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f85a9-1b80-4006-b69f-c616f7e9315e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:56.758451 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f85a9-1b80-4006-b69f-c616f7e9315e admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:56.760475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f85a9-1b80-4006-b69f-c616f7e9315e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:56.760828 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f85a9-1b80-4006-b69f-c616f7e9315e admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:56.761679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f85a9-1b80-4006-b69f-c616f7e9315e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:56.768668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f85a9-1b80-4006-b69f-c616f7e9315e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:56.798451 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1033/2076] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:56.799608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12248976-9409-491d-a894-5c4773033c9d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:56.799997 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12248976-9409-491d-a894-5c4773033c9d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:56.801618 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12248976-9409-491d-a894-5c4773033c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:56.830748 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd80611-6d5f-45ae-8dd1-0ceb8683cef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:56.831745 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd80611-6d5f-45ae-8dd1-0ceb8683cef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:56.832096 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd80611-6d5f-45ae-8dd1-0ceb8683cef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:56.832447 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd80611-6d5f-45ae-8dd1-0ceb8683cef0 admin admin] PATH_INFO: `/v3/users/e97f3a8dddd248ba8043ff969681973c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:56.837393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd80611-6d5f-45ae-8dd1-0ceb8683cef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e97f3a8dddd248ba8043ff969681973c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:56.839386 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd80611-6d5f-45ae-8dd1-0ceb8683cef0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:56.848406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-12248976-9409-491d-a894-5c4773033c9d None None] MFA Rules not processed for user `f4ff4dd34d1248e18cd2d0325e23c5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:56.849738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-12248976-9409-491d-a894-5c4773033c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:56.862563 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:56.876797 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:56.930189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-efd80611-6d5f-45ae-8dd1-0ceb8683cef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e97f3a8dddd248ba8043ff969681973c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:56.947133 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-efd80611-6d5f-45ae-8dd1-0ceb8683cef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e97f3a8dddd248ba8043ff969681973c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:56.947851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-efd80611-6d5f-45ae-8dd1-0ceb8683cef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e97f3a8dddd248ba8043ff969681973c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:56.948605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-efd80611-6d5f-45ae-8dd1-0ceb8683cef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e97f3a8dddd248ba8043ff969681973c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:56.953749 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1034/2077] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:56.954590 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12248976-9409-491d-a894-5c4773033c9d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:56.966716 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-efd80611-6d5f-45ae-8dd1-0ceb8683cef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e97f3a8dddd248ba8043ff969681973c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:56.969189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12248976-9409-491d-a894-5c4773033c9d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:56.978941 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce036da3-3f8a-49bd-83d3-75a8d75b2e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:56.979854 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce036da3-3f8a-49bd-83d3-75a8d75b2e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:56.980142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce036da3-3f8a-49bd-83d3-75a8d75b2e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:56.980423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce036da3-3f8a-49bd-83d3-75a8d75b2e93 admin admin] PATH_INFO: `/v3/projects/82befa97308542d88aa2b5a29dcb4299/users/e3c2cdaa5c69445f804fcb1dc21b848f/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:56.983682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce036da3-3f8a-49bd-83d3-75a8d75b2e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82befa97308542d88aa2b5a29dcb4299, user_id=e3c2cdaa5c69445f804fcb1dc21b848f, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:56.986493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce036da3-3f8a-49bd-83d3-75a8d75b2e93 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:56.995462 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1044/2078] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:56 2022] DELETE /identity/v3/users/e97f3a8dddd248ba8043ff969681973c => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:56.999949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd80611-6d5f-45ae-8dd1-0ceb8683cef0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:57.001566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-efd80611-6d5f-45ae-8dd1-0ceb8683cef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:57.023280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1035/2079] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:56 2022] PUT /identity/v3/projects/82befa97308542d88aa2b5a29dcb4299/users/e3c2cdaa5c69445f804fcb1dc21b848f/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:57.025446 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce036da3-3f8a-49bd-83d3-75a8d75b2e93 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:57.037771 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ce036da3-3f8a-49bd-83d3-75a8d75b2e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:57.156215 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd80611-6d5f-45ae-8dd1-0ceb8683cef0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:57.247617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce036da3-3f8a-49bd-83d3-75a8d75b2e93 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:57.265494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da02144-7af6-41cd-bd3e-c0d835f19863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:57.266529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02144-7af6-41cd-bd3e-c0d835f19863 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:57.272328 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02144-7af6-41cd-bd3e-c0d835f19863 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:57.272665 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02144-7af6-41cd-bd3e-c0d835f19863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:57.277312 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0da02144-7af6-41cd-bd3e-c0d835f19863 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:57.338116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052776ca-4c27-4c11-b048-258b117c68c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:57.339186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052776ca-4c27-4c11-b048-258b117c68c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:57.339531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052776ca-4c27-4c11-b048-258b117c68c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:57.339830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052776ca-4c27-4c11-b048-258b117c68c7 admin admin] PATH_INFO: `/v3/projects/5f59c79b648a46a0bae8b265df141961` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:57.342447 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052776ca-4c27-4c11-b048-258b117c68c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f59c79b648a46a0bae8b265df141961)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:57.344389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052776ca-4c27-4c11-b048-258b117c68c7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:57.431531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da02144-7af6-41cd-bd3e-c0d835f19863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:57.433862 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da02144-7af6-41cd-bd3e-c0d835f19863 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:57.456880 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-052776ca-4c27-4c11-b048-258b117c68c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f59c79b648a46a0bae8b265df141961', 'request_id': 'req-052776ca-4c27-4c11-b048-258b117c68c7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:57.461694 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1036/2080] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:57.463228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:57.487769 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-052776ca-4c27-4c11-b048-258b117c68c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f59c79b648a46a0bae8b265df141961', 'request_id': 'req-052776ca-4c27-4c11-b048-258b117c68c7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:57.499154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-052776ca-4c27-4c11-b048-258b117c68c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f59c79b648a46a0bae8b265df141961', 'request_id': 'req-052776ca-4c27-4c11-b048-258b117c68c7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:57.537554 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-052776ca-4c27-4c11-b048-258b117c68c7 admin admin] The token cache is being invalidate because project 5f59c79b648a46a0bae8b265df141961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:57.538136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-052776ca-4c27-4c11-b048-258b117c68c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:57.539854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-052776ca-4c27-4c11-b048-258b117c68c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:57.544108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1045/2081] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:56 2022] DELETE /identity/v3/projects/5f59c79b648a46a0bae8b265df141961 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:57.548358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da02144-7af6-41cd-bd3e-c0d835f19863 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:57.567416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da02144-7af6-41cd-bd3e-c0d835f19863 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:57.702668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:57.746885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1c27c-b6f8-44d8-be71-ba1454e32477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:57.748317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1c27c-b6f8-44d8-be71-ba1454e32477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:57.748820 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1c27c-b6f8-44d8-be71-ba1454e32477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:57.749304 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1c27c-b6f8-44d8-be71-ba1454e32477 admin admin] PATH_INFO: `/v3/users/ddbd98dcef664e26b2226fd1959ff80d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:57.751080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1c27c-b6f8-44d8-be71-ba1454e32477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddbd98dcef664e26b2226fd1959ff80d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:57.753929 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1c27c-b6f8-44d8-be71-ba1454e32477 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:57.857892 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-72c1c27c-b6f8-44d8-be71-ba1454e32477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddbd98dcef664e26b2226fd1959ff80d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:57.881417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-72c1c27c-b6f8-44d8-be71-ba1454e32477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddbd98dcef664e26b2226fd1959ff80d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:57.882585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-72c1c27c-b6f8-44d8-be71-ba1454e32477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddbd98dcef664e26b2226fd1959ff80d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:57.883587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-72c1c27c-b6f8-44d8-be71-ba1454e32477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddbd98dcef664e26b2226fd1959ff80d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:57.898254 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-72c1c27c-b6f8-44d8-be71-ba1454e32477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddbd98dcef664e26b2226fd1959ff80d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:57.967528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052776ca-4c27-4c11-b048-258b117c68c7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:57.969883 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-052776ca-4c27-4c11-b048-258b117c68c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:58.002277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1037/2082] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:57 2022] DELETE /identity/v3/users/ddbd98dcef664e26b2226fd1959ff80d => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:58.002901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052776ca-4c27-4c11-b048-258b117c68c7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:58.168485 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3b301-48a7-46d4-9899-d1eed12e6fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:58.170043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3b301-48a7-46d4-9899-d1eed12e6fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:58.170043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3b301-48a7-46d4-9899-d1eed12e6fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:58.171249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3b301-48a7-46d4-9899-d1eed12e6fc6 admin admin] PATH_INFO: `/v3/projects/91114c6b8b234fbc8134c9666c013d7d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:58.174230 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3b301-48a7-46d4-9899-d1eed12e6fc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91114c6b8b234fbc8134c9666c013d7d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:58.178750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3b301-48a7-46d4-9899-d1eed12e6fc6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:58.277052 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-68a3b301-48a7-46d4-9899-d1eed12e6fc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91114c6b8b234fbc8134c9666c013d7d', 'request_id': 'req-68a3b301-48a7-46d4-9899-d1eed12e6fc6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.291482 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-68a3b301-48a7-46d4-9899-d1eed12e6fc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91114c6b8b234fbc8134c9666c013d7d', 'request_id': 'req-68a3b301-48a7-46d4-9899-d1eed12e6fc6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.311180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-68a3b301-48a7-46d4-9899-d1eed12e6fc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91114c6b8b234fbc8134c9666c013d7d', 'request_id': 'req-68a3b301-48a7-46d4-9899-d1eed12e6fc6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.330112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-68a3b301-48a7-46d4-9899-d1eed12e6fc6 admin admin] The token cache is being invalidate because project 91114c6b8b234fbc8134c9666c013d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:58.330422 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-68a3b301-48a7-46d4-9899-d1eed12e6fc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.331087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-68a3b301-48a7-46d4-9899-d1eed12e6fc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.337433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1046/2083] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:57 2022] DELETE /identity/v3/projects/91114c6b8b234fbc8134c9666c013d7d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:10:58.341260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1c27c-b6f8-44d8-be71-ba1454e32477 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:58.343144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-72c1c27c-b6f8-44d8-be71-ba1454e32477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:58.366500 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1c27c-b6f8-44d8-be71-ba1454e32477 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:58.507040 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f11e0a-41c3-4c8a-8139-f028a47aa4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:58.508147 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f11e0a-41c3-4c8a-8139-f028a47aa4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:58.508627 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f11e0a-41c3-4c8a-8139-f028a47aa4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:58.509063 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f11e0a-41c3-4c8a-8139-f028a47aa4d7 admin admin] PATH_INFO: `/v3/users/484ca94e80b64d6ba14a00fa4f2e12f4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:58.513761 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f11e0a-41c3-4c8a-8139-f028a47aa4d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=484ca94e80b64d6ba14a00fa4f2e12f4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:58.516010 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f11e0a-41c3-4c8a-8139-f028a47aa4d7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:58.519779 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3b301-48a7-46d4-9899-d1eed12e6fc6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:58.521887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-68a3b301-48a7-46d4-9899-d1eed12e6fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:58.560079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3b301-48a7-46d4-9899-d1eed12e6fc6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:58.575125 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc1790-a7f6-4c73-8351-95e9dcac9e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:58.577182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc1790-a7f6-4c73-8351-95e9dcac9e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:58.578704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc1790-a7f6-4c73-8351-95e9dcac9e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:58.580367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc1790-a7f6-4c73-8351-95e9dcac9e77 admin admin] PATH_INFO: `/v3/projects/8f3616be625943548820c6311908e62c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:58.583894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc1790-a7f6-4c73-8351-95e9dcac9e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3616be625943548820c6311908e62c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:58.595706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc1790-a7f6-4c73-8351-95e9dcac9e77 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:58.649913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-50f11e0a-41c3-4c8a-8139-f028a47aa4d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '484ca94e80b64d6ba14a00fa4f2e12f4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.678704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-50f11e0a-41c3-4c8a-8139-f028a47aa4d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '484ca94e80b64d6ba14a00fa4f2e12f4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.679695 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-50f11e0a-41c3-4c8a-8139-f028a47aa4d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '484ca94e80b64d6ba14a00fa4f2e12f4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.680475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-50f11e0a-41c3-4c8a-8139-f028a47aa4d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '484ca94e80b64d6ba14a00fa4f2e12f4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.683756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:58.696667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-50f11e0a-41c3-4c8a-8139-f028a47aa4d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '484ca94e80b64d6ba14a00fa4f2e12f4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.709676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fcbc1790-a7f6-4c73-8351-95e9dcac9e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3616be625943548820c6311908e62c', 'request_id': 'req-fcbc1790-a7f6-4c73-8351-95e9dcac9e77'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.720528 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1038/2084] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:58 2022] DELETE /identity/v3/users/484ca94e80b64d6ba14a00fa4f2e12f4 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:58.723516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f11e0a-41c3-4c8a-8139-f028a47aa4d7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:58.723516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-50f11e0a-41c3-4c8a-8139-f028a47aa4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:58.723719 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fcbc1790-a7f6-4c73-8351-95e9dcac9e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3616be625943548820c6311908e62c', 'request_id': 'req-fcbc1790-a7f6-4c73-8351-95e9dcac9e77'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.730492 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:INSERT=3,keystone:DELETE=17,keystone:SELECT=80 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:58.732559 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fcbc1790-a7f6-4c73-8351-95e9dcac9e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3616be625943548820c6311908e62c', 'request_id': 'req-fcbc1790-a7f6-4c73-8351-95e9dcac9e77'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.752020 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fcbc1790-a7f6-4c73-8351-95e9dcac9e77 admin admin] The token cache is being invalidate because project 8f3616be625943548820c6311908e62c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:10:58.752901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fcbc1790-a7f6-4c73-8351-95e9dcac9e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.754092 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fcbc1790-a7f6-4c73-8351-95e9dcac9e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.785173 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1047/2085] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:58 2022] DELETE /identity/v3/projects/8f3616be625943548820c6311908e62c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:58.792490 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad544f-a9c6-464c-bc8f-86885918b7db None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:58.793253 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad544f-a9c6-464c-bc8f-86885918b7db None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:58.793896 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad544f-a9c6-464c-bc8f-86885918b7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:58.823014 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f11e0a-41c3-4c8a-8139-f028a47aa4d7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:58.830738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22852119-632b-45e3-a23c-a17372000af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:58.831970 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22852119-632b-45e3-a23c-a17372000af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:58.832488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22852119-632b-45e3-a23c-a17372000af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:58.833808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22852119-632b-45e3-a23c-a17372000af4 admin admin] PATH_INFO: `/v3/users/891c4f916715491bbf610425fe339777` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:58.836817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22852119-632b-45e3-a23c-a17372000af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=891c4f916715491bbf610425fe339777)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:58.839881 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22852119-632b-45e3-a23c-a17372000af4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:58.852743 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9aad544f-a9c6-464c-bc8f-86885918b7db None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:58.855491 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9aad544f-a9c6-464c-bc8f-86885918b7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:58.877467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1048/2086] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:58.887960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d9ae0-1838-4662-9f03-86d6298c2d2a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:58.888631 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d9ae0-1838-4662-9f03-86d6298c2d2a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:58.889221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d9ae0-1838-4662-9f03-86d6298c2d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:58.918437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-277d9ae0-1838-4662-9f03-86d6298c2d2a None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:58.920215 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-277d9ae0-1838-4662-9f03-86d6298c2d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:58.937392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1049/2087] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:10:58.950560 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d9ae0-1838-4662-9f03-86d6298c2d2a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:58.950790 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-22852119-632b-45e3-a23c-a17372000af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891c4f916715491bbf610425fe339777'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.967903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d9ae0-1838-4662-9f03-86d6298c2d2a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:58.976393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0745d5-64ae-49af-be0d-3fc295d1aad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:58.977396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0745d5-64ae-49af-be0d-3fc295d1aad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:58.977832 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0745d5-64ae-49af-be0d-3fc295d1aad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:58.978279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0745d5-64ae-49af-be0d-3fc295d1aad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:58.979845 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0745d5-64ae-49af-be0d-3fc295d1aad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:10:58.981049 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0745d5-64ae-49af-be0d-3fc295d1aad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:58.981908 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-22852119-632b-45e3-a23c-a17372000af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891c4f916715491bbf610425fe339777'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.983079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0745d5-64ae-49af-be0d-3fc295d1aad3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:58.984313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-22852119-632b-45e3-a23c-a17372000af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891c4f916715491bbf610425fe339777'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:58.986666 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-22852119-632b-45e3-a23c-a17372000af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891c4f916715491bbf610425fe339777'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:59.009024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1050/2088] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 11:10:59.014061 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0745d5-64ae-49af-be0d-3fc295d1aad3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:59.014373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-22852119-632b-45e3-a23c-a17372000af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891c4f916715491bbf610425fe339777'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:10:59.020285 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4a0745d5-64ae-49af-be0d-3fc295d1aad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:59.037173 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1039/2089] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:10:58 2022] DELETE /identity/v3/users/891c4f916715491bbf610425fe339777 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:59.039660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007c50b-0400-4a77-a01c-7adbf8094ce1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:59.040082 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007c50b-0400-4a77-a01c-7adbf8094ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:59.040619 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007c50b-0400-4a77-a01c-7adbf8094ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:59.058902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0745d5-64ae-49af-be0d-3fc295d1aad3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:59.082396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9007c50b-0400-4a77-a01c-7adbf8094ce1 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:59.083733 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9007c50b-0400-4a77-a01c-7adbf8094ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:59.191855 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa24f9-3d6e-4881-af40-96792da6d89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:59.192933 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa24f9-3d6e-4881-af40-96792da6d89b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:59.194050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa24f9-3d6e-4881-af40-96792da6d89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:59.194705 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa24f9-3d6e-4881-af40-96792da6d89b admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:59.196224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa24f9-3d6e-4881-af40-96792da6d89b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:59.208623 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa24f9-3d6e-4881-af40-96792da6d89b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:59.230908 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1040/2090] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:10:59.254624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007c50b-0400-4a77-a01c-7adbf8094ce1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:59.262280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9007c50b-0400-4a77-a01c-7adbf8094ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:59.287225 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:59.306052 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1051/2091] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:10:59 2022] POST /identity/v3/projects => generated 375 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:10:59.310294 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa24f9-3d6e-4881-af40-96792da6d89b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:59.412768 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007c50b-0400-4a77-a01c-7adbf8094ce1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:59.476580 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa24f9-3d6e-4881-af40-96792da6d89b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:59.482010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfc22f-0409-43d9-ba94-c1ca0ac2592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:59.482911 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfc22f-0409-43d9-ba94-c1ca0ac2592b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:59.483388 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfc22f-0409-43d9-ba94-c1ca0ac2592b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:59.483834 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfc22f-0409-43d9-ba94-c1ca0ac2592b admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:59.484724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfc22f-0409-43d9-ba94-c1ca0ac2592b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:59.486853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfc22f-0409-43d9-ba94-c1ca0ac2592b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:59.530345 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1052/2092] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:10:59 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:10:59.535529 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfc22f-0409-43d9-ba94-c1ca0ac2592b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:59.552743 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfc22f-0409-43d9-ba94-c1ca0ac2592b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:59.553732 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e4d71-5c12-4ba0-b0c4-451bd5752a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:59.554525 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e4d71-5c12-4ba0-b0c4-451bd5752a8b service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:59.554806 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e4d71-5c12-4ba0-b0c4-451bd5752a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:59.555084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e4d71-5c12-4ba0-b0c4-451bd5752a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:59.577175 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12fcd6-ef2e-4a1a-adaa-e6cbdb9c0d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:59.579167 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12fcd6-ef2e-4a1a-adaa-e6cbdb9c0d44 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:59.579618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12fcd6-ef2e-4a1a-adaa-e6cbdb9c0d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:59.580500 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12fcd6-ef2e-4a1a-adaa-e6cbdb9c0d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:59.583558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12fcd6-ef2e-4a1a-adaa-e6cbdb9c0d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:59.587247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e4d71-5c12-4ba0-b0c4-451bd5752a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:59.588807 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e4d71-5c12-4ba0-b0c4-451bd5752a8b service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:59.589029 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12fcd6-ef2e-4a1a-adaa-e6cbdb9c0d44 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:59.614777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1053/2093] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:10:59.618161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12fcd6-ef2e-4a1a-adaa-e6cbdb9c0d44 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:59.641085 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1041/2094] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:10:59.650295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12fcd6-ef2e-4a1a-adaa-e6cbdb9c0d44 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:59.670212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b283a-4b13-45b8-bcf5-ad7ccc96d596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:59.671259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b283a-4b13-45b8-bcf5-ad7ccc96d596 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:59.671726 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b283a-4b13-45b8-bcf5-ad7ccc96d596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:59.672101 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b283a-4b13-45b8-bcf5-ad7ccc96d596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:59.673034 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b283a-4b13-45b8-bcf5-ad7ccc96d596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:59.674859 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b283a-4b13-45b8-bcf5-ad7ccc96d596 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:59.699681 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1054/2095] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:10:59.703527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e4d71-5c12-4ba0-b0c4-451bd5752a8b service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:59.720995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e4d71-5c12-4ba0-b0c4-451bd5752a8b service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:10:59.737937 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397958ca-cb7e-4da5-9cc7-70ea5eb22507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:10:59.739058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397958ca-cb7e-4da5-9cc7-70ea5eb22507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:59.739346 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397958ca-cb7e-4da5-9cc7-70ea5eb22507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:59.739867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397958ca-cb7e-4da5-9cc7-70ea5eb22507 admin admin] PATH_INFO: `/v3/projects/0302e92ad9e1475ab61bef9b91af363d/users/3948cc90b04245268e103cd504b4c850/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:59.781396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397958ca-cb7e-4da5-9cc7-70ea5eb22507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0302e92ad9e1475ab61bef9b91af363d, user_id=3948cc90b04245268e103cd504b4c850, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:10:59.786654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397958ca-cb7e-4da5-9cc7-70ea5eb22507 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:10:59.821217 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1042/2096] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:10:59 2022] PUT /identity/v3/projects/0302e92ad9e1475ab61bef9b91af363d/users/3948cc90b04245268e103cd504b4c850/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:10:59.831043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ad3f1-a6a3-43f1-9d97-5a42d4df7326 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:10:59.831400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ad3f1-a6a3-43f1-9d97-5a42d4df7326 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:10:59.831680 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ad3f1-a6a3-43f1-9d97-5a42d4df7326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:10:59.906417 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7c1ad3f1-a6a3-43f1-9d97-5a42d4df7326 None None] MFA Rules not processed for user `3948cc90b04245268e103cd504b4c850`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:10:59.908200 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7c1ad3f1-a6a3-43f1-9d97-5a42d4df7326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:10:59.931886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:10:59.968065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397958ca-cb7e-4da5-9cc7-70ea5eb22507 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:10:59.971463 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-397958ca-cb7e-4da5-9cc7-70ea5eb22507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:00.060282 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1055/2097] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:10:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:00.077786 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ad3f1-a6a3-43f1-9d97-5a42d4df7326 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:00.081073 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7c1ad3f1-a6a3-43f1-9d97-5a42d4df7326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:00.165883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397958ca-cb7e-4da5-9cc7-70ea5eb22507 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:00.178261 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd33059-0163-4c83-974e-e55d03294930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:00.184248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33059-0163-4c83-974e-e55d03294930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:00.184248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33059-0163-4c83-974e-e55d03294930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:00.184248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33059-0163-4c83-974e-e55d03294930 admin admin] PATH_INFO: `/v3/projects/fdc0f76a1fd14fa98b2707ca282614df` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:00.184248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd33059-0163-4c83-974e-e55d03294930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc0f76a1fd14fa98b2707ca282614df)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:00.184248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd33059-0163-4c83-974e-e55d03294930 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:00.217676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ad3f1-a6a3-43f1-9d97-5a42d4df7326 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:00.224226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b33dc5-3e8a-4a9a-85f5-16a8ab8153d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:00.225829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b33dc5-3e8a-4a9a-85f5-16a8ab8153d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:00.226020 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b33dc5-3e8a-4a9a-85f5-16a8ab8153d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:00.226392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b33dc5-3e8a-4a9a-85f5-16a8ab8153d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:00.239822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b33dc5-3e8a-4a9a-85f5-16a8ab8153d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:00.241519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b33dc5-3e8a-4a9a-85f5-16a8ab8153d3 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:00.256395 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1056/2098] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:00.294982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:00.305894 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8bd33059-0163-4c83-974e-e55d03294930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc0f76a1fd14fa98b2707ca282614df', 'request_id': 'req-8bd33059-0163-4c83-974e-e55d03294930'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:00.330664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8bd33059-0163-4c83-974e-e55d03294930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc0f76a1fd14fa98b2707ca282614df', 'request_id': 'req-8bd33059-0163-4c83-974e-e55d03294930'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:00.371583 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8bd33059-0163-4c83-974e-e55d03294930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc0f76a1fd14fa98b2707ca282614df', 'request_id': 'req-8bd33059-0163-4c83-974e-e55d03294930'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:00.423823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8bd33059-0163-4c83-974e-e55d03294930 admin admin] The token cache is being invalidate because project fdc0f76a1fd14fa98b2707ca282614df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:11:00.424130 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8bd33059-0163-4c83-974e-e55d03294930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:00.424864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8bd33059-0163-4c83-974e-e55d03294930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:00.426580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1043/2099] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:10:59 2022] DELETE /identity/v3/projects/fdc0f76a1fd14fa98b2707ca282614df => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:11:00.432415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a24c8-2c70-466e-bf38-5338ce79083b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:00.432713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a24c8-2c70-466e-bf38-5338ce79083b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:00.432988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a24c8-2c70-466e-bf38-5338ce79083b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:00.468864 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-db9a24c8-2c70-466e-bf38-5338ce79083b None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:00.470454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-db9a24c8-2c70-466e-bf38-5338ce79083b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:00.547621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd33059-0163-4c83-974e-e55d03294930 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:00.549817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8bd33059-0163-4c83-974e-e55d03294930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:00.651056 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1057/2100] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:00.653819 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce2c9-d288-4397-90f3-72cbad6c3006 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:00.654194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce2c9-d288-4397-90f3-72cbad6c3006 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:00.654504 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce2c9-d288-4397-90f3-72cbad6c3006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:00.691942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ee3ce2c9-d288-4397-90f3-72cbad6c3006 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:00.700717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ee3ce2c9-d288-4397-90f3-72cbad6c3006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:00.712881 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd33059-0163-4c83-974e-e55d03294930 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:00.725197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1058/2101] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:11:00.726858 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ce2c9-d288-4397-90f3-72cbad6c3006 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:00.730899 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:00.731932 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:00.732185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:00.732378 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448 admin admin] PATH_INFO: `/v3/projects/a9fe2c42c33a484a8fc9c4615ca95e05` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:00.738591 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9fe2c42c33a484a8fc9c4615ca95e05)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:00.740650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:00.750946 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ce2c9-d288-4397-90f3-72cbad6c3006 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:00.765154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b583e4-65ab-4c96-9805-9dd394b0b6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:00.765882 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b583e4-65ab-4c96-9805-9dd394b0b6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:00.766161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b583e4-65ab-4c96-9805-9dd394b0b6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:00.766433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b583e4-65ab-4c96-9805-9dd394b0b6d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:00.767426 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b583e4-65ab-4c96-9805-9dd394b0b6d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:11:00.767812 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b583e4-65ab-4c96-9805-9dd394b0b6d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:00.771242 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b583e4-65ab-4c96-9805-9dd394b0b6d1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:00.792244 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1059/2102] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:11:00.797544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b583e4-65ab-4c96-9805-9dd394b0b6d1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:00.808983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b583e4-65ab-4c96-9805-9dd394b0b6d1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:00.819475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120be9a-4298-4ddb-a5bd-aacc8009146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:00.820151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120be9a-4298-4ddb-a5bd-aacc8009146b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:00.820432 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120be9a-4298-4ddb-a5bd-aacc8009146b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:00.820730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120be9a-4298-4ddb-a5bd-aacc8009146b admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:00.821577 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120be9a-4298-4ddb-a5bd-aacc8009146b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:00.825847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120be9a-4298-4ddb-a5bd-aacc8009146b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:00.840766 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9fe2c42c33a484a8fc9c4615ca95e05', 'request_id': 'req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:00.850652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9fe2c42c33a484a8fc9c4615ca95e05', 'request_id': 'req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:00.859005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9fe2c42c33a484a8fc9c4615ca95e05', 'request_id': 'req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:00.887858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448 admin admin] The token cache is being invalidate because project a9fe2c42c33a484a8fc9c4615ca95e05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:11:00.888599 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:00.889749 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:00.912690 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1044/2103] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:11:00 2022] DELETE /identity/v3/projects/a9fe2c42c33a484a8fc9c4615ca95e05 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:11:00.913942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:00.918372 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:00.928138 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1060/2104] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:11:00 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:00.939993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120be9a-4298-4ddb-a5bd-aacc8009146b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:00.982611 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7120be9a-4298-4ddb-a5bd-aacc8009146b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:01.050979 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:01.126486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e3f6d-0b01-4ba0-867a-e2a48626c448 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:01.133280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:01.249325 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120be9a-4298-4ddb-a5bd-aacc8009146b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:01.268225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e5866-13be-42dc-a73b-8449ce21de2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:01.269072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e5866-13be-42dc-a73b-8449ce21de2c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:01.269920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e5866-13be-42dc-a73b-8449ce21de2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:01.270283 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e5866-13be-42dc-a73b-8449ce21de2c admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:01.271181 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e5866-13be-42dc-a73b-8449ce21de2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:01.273323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e5866-13be-42dc-a73b-8449ce21de2c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:01.304253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec2653-6592-4025-b3f2-9e29e60de61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:01.306886 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec2653-6592-4025-b3f2-9e29e60de61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:01.308910 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec2653-6592-4025-b3f2-9e29e60de61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:01.313309 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec2653-6592-4025-b3f2-9e29e60de61f admin admin] PATH_INFO: `/v3/users/f4ff4dd34d1248e18cd2d0325e23c5c4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:01.316321 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec2653-6592-4025-b3f2-9e29e60de61f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4ff4dd34d1248e18cd2d0325e23c5c4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:01.317111 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1061/2105] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:11:00 2022] POST /identity/v3/users => generated 293 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:01.318730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec2653-6592-4025-b3f2-9e29e60de61f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:01.322580 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e5866-13be-42dc-a73b-8449ce21de2c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:01.336723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e5866-13be-42dc-a73b-8449ce21de2c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:01.342561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a64b9-5c46-4990-bda5-6a5266f77c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:01.343592 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a64b9-5c46-4990-bda5-6a5266f77c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:01.350777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a64b9-5c46-4990-bda5-6a5266f77c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:01.351424 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a64b9-5c46-4990-bda5-6a5266f77c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:01.352644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a64b9-5c46-4990-bda5-6a5266f77c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:01.354419 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a64b9-5c46-4990-bda5-6a5266f77c67 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:01.371199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1062/2106] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:11:01.374524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a64b9-5c46-4990-bda5-6a5266f77c67 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:01.394222 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a64b9-5c46-4990-bda5-6a5266f77c67 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:01.402931 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29df0e-a04b-4976-b757-9db7ed5d3da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:01.404113 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29df0e-a04b-4976-b757-9db7ed5d3da9 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:01.404464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29df0e-a04b-4976-b757-9db7ed5d3da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:01.404747 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29df0e-a04b-4976-b757-9db7ed5d3da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:01.405728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29df0e-a04b-4976-b757-9db7ed5d3da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:01.409029 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29df0e-a04b-4976-b757-9db7ed5d3da9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:01.414422 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-edec2653-6592-4025-b3f2-9e29e60de61f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4ff4dd34d1248e18cd2d0325e23c5c4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:01.425204 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1063/2107] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:11:01.427637 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29df0e-a04b-4976-b757-9db7ed5d3da9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:01.440915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-edec2653-6592-4025-b3f2-9e29e60de61f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4ff4dd34d1248e18cd2d0325e23c5c4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:01.442106 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-edec2653-6592-4025-b3f2-9e29e60de61f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4ff4dd34d1248e18cd2d0325e23c5c4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:01.442763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29df0e-a04b-4976-b757-9db7ed5d3da9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:01.443154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-edec2653-6592-4025-b3f2-9e29e60de61f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4ff4dd34d1248e18cd2d0325e23c5c4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:01.448403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702180a-c84a-4cc1-bfaa-c00c985f46da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:01.449303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702180a-c84a-4cc1-bfaa-c00c985f46da admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:01.449783 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702180a-c84a-4cc1-bfaa-c00c985f46da admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:01.450069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702180a-c84a-4cc1-bfaa-c00c985f46da admin admin] PATH_INFO: `/v3/projects/f6ebe741ae92433db5c798526e437eba/users/a14dee7c481a4ea19a78f0f69f836896/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:01.460339 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-edec2653-6592-4025-b3f2-9e29e60de61f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4ff4dd34d1248e18cd2d0325e23c5c4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:01.474469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702180a-c84a-4cc1-bfaa-c00c985f46da admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ebe741ae92433db5c798526e437eba, user_id=a14dee7c481a4ea19a78f0f69f836896, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:01.477813 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702180a-c84a-4cc1-bfaa-c00c985f46da admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:01.490492 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1045/2108] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:11:00 2022] DELETE /identity/v3/users/f4ff4dd34d1248e18cd2d0325e23c5c4 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:01.511532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedcf2c-4f6d-4dec-8c74-378054258f8d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:01.511846 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedcf2c-4f6d-4dec-8c74-378054258f8d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:01.512084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedcf2c-4f6d-4dec-8c74-378054258f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:01.513437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1064/2109] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:01 2022] PUT /identity/v3/projects/f6ebe741ae92433db5c798526e437eba/users/a14dee7c481a4ea19a78f0f69f836896/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:01.546022 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0cedcf2c-4f6d-4dec-8c74-378054258f8d None None] MFA Rules not processed for user `a14dee7c481a4ea19a78f0f69f836896`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:01.547156 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0cedcf2c-4f6d-4dec-8c74-378054258f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:01.666201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1046/2110] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:11:01.683288 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702180a-c84a-4cc1-bfaa-c00c985f46da admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:01.685572 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e702180a-c84a-4cc1-bfaa-c00c985f46da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:01.791022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702180a-c84a-4cc1-bfaa-c00c985f46da admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:01.854968 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f4d63-7948-42f1-b2ce-94ca070af5c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:01.856111 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f4d63-7948-42f1-b2ce-94ca070af5c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:01.856556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f4d63-7948-42f1-b2ce-94ca070af5c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:01.856831 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f4d63-7948-42f1-b2ce-94ca070af5c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:01.871567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f4d63-7948-42f1-b2ce-94ca070af5c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:01.873341 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f4d63-7948-42f1-b2ce-94ca070af5c7 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:01.887364 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1065/2111] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:01.931673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedcf2c-4f6d-4dec-8c74-378054258f8d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:01.934292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0cedcf2c-4f6d-4dec-8c74-378054258f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:01.975450 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:02.070844 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedcf2c-4f6d-4dec-8c74-378054258f8d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:02.078864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ebcbf-b39a-4381-9c28-5bfd11db2e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:02.080476 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ebcbf-b39a-4381-9c28-5bfd11db2e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:02.080836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ebcbf-b39a-4381-9c28-5bfd11db2e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:02.081171 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ebcbf-b39a-4381-9c28-5bfd11db2e66 admin admin] PATH_INFO: `/v3/projects/794770a3c825488cb0acc8af6df708a7` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:02.083240 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ebcbf-b39a-4381-9c28-5bfd11db2e66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=794770a3c825488cb0acc8af6df708a7)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:02.086072 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ebcbf-b39a-4381-9c28-5bfd11db2e66 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:02.219253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-118ebcbf-b39a-4381-9c28-5bfd11db2e66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '794770a3c825488cb0acc8af6df708a7', 'request_id': 'req-118ebcbf-b39a-4381-9c28-5bfd11db2e66'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:02.237743 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-118ebcbf-b39a-4381-9c28-5bfd11db2e66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '794770a3c825488cb0acc8af6df708a7', 'request_id': 'req-118ebcbf-b39a-4381-9c28-5bfd11db2e66'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:02.267069 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-118ebcbf-b39a-4381-9c28-5bfd11db2e66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '794770a3c825488cb0acc8af6df708a7', 'request_id': 'req-118ebcbf-b39a-4381-9c28-5bfd11db2e66'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:02.291009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-118ebcbf-b39a-4381-9c28-5bfd11db2e66 admin admin] The token cache is being invalidate because project 794770a3c825488cb0acc8af6df708a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:11:02.291461 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-118ebcbf-b39a-4381-9c28-5bfd11db2e66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:02.292198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-118ebcbf-b39a-4381-9c28-5bfd11db2e66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:02.298571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1047/2112] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:11:01 2022] DELETE /identity/v3/projects/794770a3c825488cb0acc8af6df708a7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:02.300243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df42667-4214-4370-b8a3-d63a03de59b6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:02.300540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df42667-4214-4370-b8a3-d63a03de59b6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:02.300818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df42667-4214-4370-b8a3-d63a03de59b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:02.362526 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0df42667-4214-4370-b8a3-d63a03de59b6 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:02.365152 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0df42667-4214-4370-b8a3-d63a03de59b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:02.391398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:02.533686 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1066/2113] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:02.541237 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf0cab-8058-4308-8d43-9eecf2181fca None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:02.542177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf0cab-8058-4308-8d43-9eecf2181fca None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:02.542910 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf0cab-8058-4308-8d43-9eecf2181fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:02.572780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5dcf0cab-8058-4308-8d43-9eecf2181fca None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:02.575722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5dcf0cab-8058-4308-8d43-9eecf2181fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:02.588999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1048/2114] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:11:02.594461 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df42667-4214-4370-b8a3-d63a03de59b6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:02.607861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df42667-4214-4370-b8a3-d63a03de59b6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:02.614496 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e60662-5052-42f6-ae26-1c740576d0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:02.616041 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e60662-5052-42f6-ae26-1c740576d0ca admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:02.616427 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e60662-5052-42f6-ae26-1c740576d0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:02.616958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e60662-5052-42f6-ae26-1c740576d0ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:02.617981 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e60662-5052-42f6-ae26-1c740576d0ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:11:02.618391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e60662-5052-42f6-ae26-1c740576d0ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:02.620355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e60662-5052-42f6-ae26-1c740576d0ca admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:02.637096 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1067/2115] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:11:02.641212 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf0cab-8058-4308-8d43-9eecf2181fca None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:02.663056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf0cab-8058-4308-8d43-9eecf2181fca None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:02.680381 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ffac4-5c6c-4121-8f99-91ce3d7cd463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:02.681468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ffac4-5c6c-4121-8f99-91ce3d7cd463 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:02.681955 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ffac4-5c6c-4121-8f99-91ce3d7cd463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:02.682445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ffac4-5c6c-4121-8f99-91ce3d7cd463 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:02.683369 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ffac4-5c6c-4121-8f99-91ce3d7cd463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:02.685689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ffac4-5c6c-4121-8f99-91ce3d7cd463 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:02.734673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1049/2116] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:11:02 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:02.738889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e60662-5052-42f6-ae26-1c740576d0ca admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:02.754668 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e60662-5052-42f6-ae26-1c740576d0ca admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:02.915349 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdeb7e-44da-4e2c-87be-4fe5f3d7c9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:02.916406 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdeb7e-44da-4e2c-87be-4fe5f3d7c9ce admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:02.916777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdeb7e-44da-4e2c-87be-4fe5f3d7c9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:02.917120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdeb7e-44da-4e2c-87be-4fe5f3d7c9ce admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:02.917957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdeb7e-44da-4e2c-87be-4fe5f3d7c9ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:02.926034 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdeb7e-44da-4e2c-87be-4fe5f3d7c9ce admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:02.984757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1068/2117] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:11:02 2022] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:02.987489 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ffac4-5c6c-4121-8f99-91ce3d7cd463 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:02.998897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ffac4-5c6c-4121-8f99-91ce3d7cd463 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:03.016311 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38663b1c-88ca-41a0-82e7-02e81b15dda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:03.017911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38663b1c-88ca-41a0-82e7-02e81b15dda3 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:03.018191 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38663b1c-88ca-41a0-82e7-02e81b15dda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:03.018462 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38663b1c-88ca-41a0-82e7-02e81b15dda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:03.019205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38663b1c-88ca-41a0-82e7-02e81b15dda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:03.021484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38663b1c-88ca-41a0-82e7-02e81b15dda3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:03.053631 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1050/2118] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:03.057821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdeb7e-44da-4e2c-87be-4fe5f3d7c9ce admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:03.071399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdeb7e-44da-4e2c-87be-4fe5f3d7c9ce admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:03.081799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba303ae0-56e8-4dc4-a138-249285d2df24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:03.082584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba303ae0-56e8-4dc4-a138-249285d2df24 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:03.082876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba303ae0-56e8-4dc4-a138-249285d2df24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:03.083149 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba303ae0-56e8-4dc4-a138-249285d2df24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:03.083888 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba303ae0-56e8-4dc4-a138-249285d2df24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:03.092247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba303ae0-56e8-4dc4-a138-249285d2df24 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:03.116528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1069/2119] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:03.120554 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38663b1c-88ca-41a0-82e7-02e81b15dda3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:03.132743 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38663b1c-88ca-41a0-82e7-02e81b15dda3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:03.141400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c76c9-b76b-4b6d-b266-a27bbdab7429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:03.142429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c76c9-b76b-4b6d-b266-a27bbdab7429 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:03.142781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c76c9-b76b-4b6d-b266-a27bbdab7429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:03.143161 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c76c9-b76b-4b6d-b266-a27bbdab7429 admin admin] PATH_INFO: `/v3/projects/de690ad0550d46cb98c0cf9b61820d56/users/7ff232cb336743ee98162a54171bf0b8/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:03.161999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c76c9-b76b-4b6d-b266-a27bbdab7429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de690ad0550d46cb98c0cf9b61820d56, user_id=7ff232cb336743ee98162a54171bf0b8, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:03.164833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c76c9-b76b-4b6d-b266-a27bbdab7429 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:03.201684 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1051/2120] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:03 2022] PUT /identity/v3/projects/de690ad0550d46cb98c0cf9b61820d56/users/7ff232cb336743ee98162a54171bf0b8/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:11:03.203277 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf001d1-c4d3-4988-884c-fd06cfa559df None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:03.203572 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf001d1-c4d3-4988-884c-fd06cfa559df None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:03.203850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf001d1-c4d3-4988-884c-fd06cfa559df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:03.242922 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4cf001d1-c4d3-4988-884c-fd06cfa559df None None] MFA Rules not processed for user `7ff232cb336743ee98162a54171bf0b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:03.245944 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4cf001d1-c4d3-4988-884c-fd06cfa559df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:03.331545 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1070/2121] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:11:03.332731 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c76c9-b76b-4b6d-b266-a27bbdab7429 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:03.396093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:03.423653 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c76c9-b76b-4b6d-b266-a27bbdab7429 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:03.430920 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e59ede-103f-475a-82cc-546f0dbbdadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:03.432094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e59ede-103f-475a-82cc-546f0dbbdadf admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:03.432380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e59ede-103f-475a-82cc-546f0dbbdadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:03.432837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e59ede-103f-475a-82cc-546f0dbbdadf admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:03.434321 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e59ede-103f-475a-82cc-546f0dbbdadf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:03.436452 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e59ede-103f-475a-82cc-546f0dbbdadf admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:03.479053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1052/2122] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:11:03 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:03.483010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf001d1-c4d3-4988-884c-fd06cfa559df None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:03.499905 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf001d1-c4d3-4988-884c-fd06cfa559df None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:03.504024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:03.585401 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd201850-59ef-4727-920f-9793e0d220a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:03.586292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd201850-59ef-4727-920f-9793e0d220a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:03.586523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd201850-59ef-4727-920f-9793e0d220a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:03.586799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd201850-59ef-4727-920f-9793e0d220a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:03.587507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd201850-59ef-4727-920f-9793e0d220a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:03.590028 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd201850-59ef-4727-920f-9793e0d220a8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:03.631023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1071/2123] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:11:03 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:11:03.632690 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e59ede-103f-475a-82cc-546f0dbbdadf admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:03.652646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e59ede-103f-475a-82cc-546f0dbbdadf admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:03.664859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cefba-a403-4304-8082-e5cd9b19db4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:03.665896 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cefba-a403-4304-8082-e5cd9b19db4b admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:03.666184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cefba-a403-4304-8082-e5cd9b19db4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:03.666463 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cefba-a403-4304-8082-e5cd9b19db4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:03.668872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cefba-a403-4304-8082-e5cd9b19db4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:03.671786 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cefba-a403-4304-8082-e5cd9b19db4b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:03.715637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1053/2124] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:03.719764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd201850-59ef-4727-920f-9793e0d220a8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:03.743258 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd201850-59ef-4727-920f-9793e0d220a8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:03.752465 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3ad7b-0e10-44b9-b0c7-affd14bd7568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:03.753896 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3ad7b-0e10-44b9-b0c7-affd14bd7568 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:03.754368 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3ad7b-0e10-44b9-b0c7-affd14bd7568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:03.754886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3ad7b-0e10-44b9-b0c7-affd14bd7568 admin admin] PATH_INFO: `/v3/projects/1be5f16f0d54436e980f92ab48ce027e/users/3a8c9ead71624463a35a5b6823ba7ab8/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:03.783245 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3ad7b-0e10-44b9-b0c7-affd14bd7568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be5f16f0d54436e980f92ab48ce027e, user_id=3a8c9ead71624463a35a5b6823ba7ab8, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:03.787293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3ad7b-0e10-44b9-b0c7-affd14bd7568 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:03.806410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1072/2125] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:03 2022] PUT /identity/v3/projects/1be5f16f0d54436e980f92ab48ce027e/users/3a8c9ead71624463a35a5b6823ba7ab8/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:11:03.813296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cefba-a403-4304-8082-e5cd9b19db4b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:03.829956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cefba-a403-4304-8082-e5cd9b19db4b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:03.954309 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddca2e7-66fc-4417-87aa-7671e1127230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:03.955119 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddca2e7-66fc-4417-87aa-7671e1127230 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:03.955446 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddca2e7-66fc-4417-87aa-7671e1127230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:03.955795 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddca2e7-66fc-4417-87aa-7671e1127230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:03.956777 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddca2e7-66fc-4417-87aa-7671e1127230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:03.960181 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddca2e7-66fc-4417-87aa-7671e1127230 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:03.975025 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1054/2126] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:03.978982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3ad7b-0e10-44b9-b0c7-affd14bd7568 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:03.993322 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3ad7b-0e10-44b9-b0c7-affd14bd7568 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:04.013958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db2851-25b0-4cd1-a1b4-f0de5c50319c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:04.014862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db2851-25b0-4cd1-a1b4-f0de5c50319c admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:04.016982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db2851-25b0-4cd1-a1b4-f0de5c50319c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:04.018322 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db2851-25b0-4cd1-a1b4-f0de5c50319c admin admin] PATH_INFO: `/v3/projects/1be5f16f0d54436e980f92ab48ce027e/users/3a8c9ead71624463a35a5b6823ba7ab8/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:04.024168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db2851-25b0-4cd1-a1b4-f0de5c50319c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be5f16f0d54436e980f92ab48ce027e, user_id=3a8c9ead71624463a35a5b6823ba7ab8, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:04.026929 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db2851-25b0-4cd1-a1b4-f0de5c50319c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:04.058405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1073/2127] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:03 2022] PUT /identity/v3/projects/1be5f16f0d54436e980f92ab48ce027e/users/3a8c9ead71624463a35a5b6823ba7ab8/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:04.071791 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37569b57-00dd-4aa6-8b01-fb2a50730baf None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:04.072568 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37569b57-00dd-4aa6-8b01-fb2a50730baf None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:04.072860 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37569b57-00dd-4aa6-8b01-fb2a50730baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:04.119670 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-37569b57-00dd-4aa6-8b01-fb2a50730baf None None] MFA Rules not processed for user `3a8c9ead71624463a35a5b6823ba7ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:04.121135 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-37569b57-00dd-4aa6-8b01-fb2a50730baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:04.214349 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1055/2128] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:04.361960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db2851-25b0-4cd1-a1b4-f0de5c50319c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:04.364924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-32db2851-25b0-4cd1-a1b4-f0de5c50319c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:04.468290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db2851-25b0-4cd1-a1b4-f0de5c50319c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:04.477948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6ade2-226e-4110-8388-631d49bba8d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:04.479060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6ade2-226e-4110-8388-631d49bba8d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:04.479648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6ade2-226e-4110-8388-631d49bba8d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:04.480135 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6ade2-226e-4110-8388-631d49bba8d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:04.641184 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6ade2-226e-4110-8388-631d49bba8d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:04.653214 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6ade2-226e-4110-8388-631d49bba8d8 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:04.674594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1074/2129] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:04.722661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37569b57-00dd-4aa6-8b01-fb2a50730baf None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:04.724806 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-37569b57-00dd-4aa6-8b01-fb2a50730baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:04.805484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:04.848895 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37569b57-00dd-4aa6-8b01-fb2a50730baf None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:04.859492 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49eba1-033d-49a3-be39-bd9ca0a3f482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:04.860388 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49eba1-033d-49a3-be39-bd9ca0a3f482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:04.860664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49eba1-033d-49a3-be39-bd9ca0a3f482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:04.860932 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49eba1-033d-49a3-be39-bd9ca0a3f482 admin admin] PATH_INFO: `/v3/users/a14dee7c481a4ea19a78f0f69f836896` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:04.862535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49eba1-033d-49a3-be39-bd9ca0a3f482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14dee7c481a4ea19a78f0f69f836896)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:04.865028 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49eba1-033d-49a3-be39-bd9ca0a3f482 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:04.948389 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2e49eba1-033d-49a3-be39-bd9ca0a3f482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14dee7c481a4ea19a78f0f69f836896'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:04.970352 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2e49eba1-033d-49a3-be39-bd9ca0a3f482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14dee7c481a4ea19a78f0f69f836896'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:04.971041 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2e49eba1-033d-49a3-be39-bd9ca0a3f482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14dee7c481a4ea19a78f0f69f836896'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:04.971850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2e49eba1-033d-49a3-be39-bd9ca0a3f482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14dee7c481a4ea19a78f0f69f836896'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:04.981623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2e49eba1-033d-49a3-be39-bd9ca0a3f482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14dee7c481a4ea19a78f0f69f836896'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:05.005247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1056/2130] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:11:04 2022] DELETE /identity/v3/users/a14dee7c481a4ea19a78f0f69f836896 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:05.007469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9607a1-bd0d-40f0-ab4d-b3fd0d98c254 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:05.007953 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9607a1-bd0d-40f0-ab4d-b3fd0d98c254 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:05.008057 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9607a1-bd0d-40f0-ab4d-b3fd0d98c254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:05.032689 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6f9607a1-bd0d-40f0-ab4d-b3fd0d98c254 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:05.035182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6f9607a1-bd0d-40f0-ab4d-b3fd0d98c254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:05.049127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:05.138654 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1075/2131] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:11:05.149349 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49eba1-033d-49a3-be39-bd9ca0a3f482 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:05.150742 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2e49eba1-033d-49a3-be39-bd9ca0a3f482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:05.269166 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49eba1-033d-49a3-be39-bd9ca0a3f482 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:05.278499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0aac62-a70a-4760-ad41-abf6075cf44b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:05.280660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aac62-a70a-4760-ad41-abf6075cf44b service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:05.281872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aac62-a70a-4760-ad41-abf6075cf44b service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:05.282518 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aac62-a70a-4760-ad41-abf6075cf44b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:05.298002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0aac62-a70a-4760-ad41-abf6075cf44b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:05.300192 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0aac62-a70a-4760-ad41-abf6075cf44b service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:05.315143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1057/2132] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:06.023749 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9607a1-bd0d-40f0-ab4d-b3fd0d98c254 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:06.026394 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6f9607a1-bd0d-40f0-ab4d-b3fd0d98c254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:06.071243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9607a1-bd0d-40f0-ab4d-b3fd0d98c254 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:06.089456 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61f360-4407-482c-b082-4422d39dcd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:06.091325 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61f360-4407-482c-b082-4422d39dcd6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:06.093082 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61f360-4407-482c-b082-4422d39dcd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:06.094462 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61f360-4407-482c-b082-4422d39dcd6e admin admin] PATH_INFO: `/v3/projects/f6ebe741ae92433db5c798526e437eba` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:06.098189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61f360-4407-482c-b082-4422d39dcd6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ebe741ae92433db5c798526e437eba)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:06.105447 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61f360-4407-482c-b082-4422d39dcd6e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:06.224262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9724df2-eacc-4834-9130-baead50e2318 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:06.224773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9724df2-eacc-4834-9130-baead50e2318 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:06.224855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9724df2-eacc-4834-9130-baead50e2318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:06.291556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb61f360-4407-482c-b082-4422d39dcd6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ebe741ae92433db5c798526e437eba', 'request_id': 'req-cb61f360-4407-482c-b082-4422d39dcd6e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:06.295564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a9724df2-eacc-4834-9130-baead50e2318 None None] MFA Rules not processed for user `e3c2cdaa5c69445f804fcb1dc21b848f`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:06.297294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a9724df2-eacc-4834-9130-baead50e2318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:06.308459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb61f360-4407-482c-b082-4422d39dcd6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ebe741ae92433db5c798526e437eba', 'request_id': 'req-cb61f360-4407-482c-b082-4422d39dcd6e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:06.329835 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb61f360-4407-482c-b082-4422d39dcd6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ebe741ae92433db5c798526e437eba', 'request_id': 'req-cb61f360-4407-482c-b082-4422d39dcd6e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:06.365988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb61f360-4407-482c-b082-4422d39dcd6e admin admin] The token cache is being invalidate because project f6ebe741ae92433db5c798526e437eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:11:06.366290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb61f360-4407-482c-b082-4422d39dcd6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:06.366948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb61f360-4407-482c-b082-4422d39dcd6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:06.369286 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1076/2133] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:11:06 2022] DELETE /identity/v3/projects/f6ebe741ae92433db5c798526e437eba => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:06.374272 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d11d38-c816-44e7-a36a-593bc8421198 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:06.374562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d11d38-c816-44e7-a36a-593bc8421198 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:06.376552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d11d38-c816-44e7-a36a-593bc8421198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:06.408290 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:06.417594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a0d11d38-c816-44e7-a36a-593bc8421198 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:06.421562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a0d11d38-c816-44e7-a36a-593bc8421198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:06.451988 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1058/2134] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:06.470385 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9724df2-eacc-4834-9130-baead50e2318 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:06.472656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a9724df2-eacc-4834-9130-baead50e2318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:06.521206 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1077/2135] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:06.523050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa277e5-1aae-4328-888f-f82f0a28490c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:06.523445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa277e5-1aae-4328-888f-f82f0a28490c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:06.523729 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa277e5-1aae-4328-888f-f82f0a28490c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:06.553757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3aa277e5-1aae-4328-888f-f82f0a28490c None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:06.555537 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3aa277e5-1aae-4328-888f-f82f0a28490c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:06.569631 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1078/2136] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:11:06.574215 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa277e5-1aae-4328-888f-f82f0a28490c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:06.586701 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9724df2-eacc-4834-9130-baead50e2318 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:06.588763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa277e5-1aae-4328-888f-f82f0a28490c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:06.599302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e44cb-f61b-40e0-802d-db3e9274c304 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:06.599966 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e44cb-f61b-40e0-802d-db3e9274c304 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:06.600250 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e44cb-f61b-40e0-802d-db3e9274c304 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:06.600474 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea56c5-081f-473d-8a4a-5cf252eb3b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:06.600606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e44cb-f61b-40e0-802d-db3e9274c304 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:06.601464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea56c5-081f-473d-8a4a-5cf252eb3b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:06.601751 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea56c5-081f-473d-8a4a-5cf252eb3b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:06.602026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea56c5-081f-473d-8a4a-5cf252eb3b19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:06.602866 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea56c5-081f-473d-8a4a-5cf252eb3b19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:11:06.603202 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea56c5-081f-473d-8a4a-5cf252eb3b19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:06.604947 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea56c5-081f-473d-8a4a-5cf252eb3b19 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:06.605842 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-eb1e44cb-f61b-40e0-802d-db3e9274c304 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:06.619848 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1079/2137] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 11:11:06.625330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea56c5-081f-473d-8a4a-5cf252eb3b19 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:06.637861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea56c5-081f-473d-8a4a-5cf252eb3b19 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:06.643618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76da5c-fb36-4726-ad46-b797b99e3f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:06.644621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76da5c-fb36-4726-ad46-b797b99e3f1c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:06.645844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76da5c-fb36-4726-ad46-b797b99e3f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:06.646130 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76da5c-fb36-4726-ad46-b797b99e3f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:06.647508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76da5c-fb36-4726-ad46-b797b99e3f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:06.650154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76da5c-fb36-4726-ad46-b797b99e3f1c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:06.669562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:06.689429 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1080/2138] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:11:06 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:11:06.693657 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76da5c-fb36-4726-ad46-b797b99e3f1c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:06.704563 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e44cb-f61b-40e0-802d-db3e9274c304 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:06.706559 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e44cb-f61b-40e0-802d-db3e9274c304 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:06.720337 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1059/2139] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:06.824943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76da5c-fb36-4726-ad46-b797b99e3f1c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:06.830870 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009232a5-05ff-4b38-9165-7d34fc4a6269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:06.831544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009232a5-05ff-4b38-9165-7d34fc4a6269 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:06.831829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009232a5-05ff-4b38-9165-7d34fc4a6269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:06.832161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009232a5-05ff-4b38-9165-7d34fc4a6269 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:06.833331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009232a5-05ff-4b38-9165-7d34fc4a6269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:06.835587 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009232a5-05ff-4b38-9165-7d34fc4a6269 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:06.878826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1081/2140] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:11:06 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:06.883521 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e44cb-f61b-40e0-802d-db3e9274c304 service nova] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:06.903076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e44cb-f61b-40e0-802d-db3e9274c304 service nova] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:06.918903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c692c9-709b-452b-ab6a-c1767b502a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:06.919642 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c692c9-709b-452b-ab6a-c1767b502a51 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:06.919929 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c692c9-709b-452b-ab6a-c1767b502a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:06.920257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c692c9-709b-452b-ab6a-c1767b502a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:06.921040 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c692c9-709b-452b-ab6a-c1767b502a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:06.922788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c692c9-709b-452b-ab6a-c1767b502a51 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:06.952749 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1060/2141] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:06.954043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009232a5-05ff-4b38-9165-7d34fc4a6269 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:06.967481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009232a5-05ff-4b38-9165-7d34fc4a6269 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:06.979569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71e848-05cc-40b9-89aa-655e4def2a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:06.980579 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71e848-05cc-40b9-89aa-655e4def2a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:06.981043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71e848-05cc-40b9-89aa-655e4def2a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:06.981437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71e848-05cc-40b9-89aa-655e4def2a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:06.983086 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71e848-05cc-40b9-89aa-655e4def2a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:06.985529 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71e848-05cc-40b9-89aa-655e4def2a7f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:06.999762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1082/2142] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:11:07.003890 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c692c9-709b-452b-ab6a-c1767b502a51 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:07.020250 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c692c9-709b-452b-ab6a-c1767b502a51 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:07.031684 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0439ccd-012c-48d7-9753-2d8240cdd119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:07.033169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0439ccd-012c-48d7-9753-2d8240cdd119 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:07.033711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0439ccd-012c-48d7-9753-2d8240cdd119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:07.034251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0439ccd-012c-48d7-9753-2d8240cdd119 admin admin] PATH_INFO: `/v3/projects/9f75b4226ffa41afb397d83a095aded7/users/fe9f5cfe16304e12a99b29d9e0cf94ee/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:07.061456 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0439ccd-012c-48d7-9753-2d8240cdd119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f75b4226ffa41afb397d83a095aded7, user_id=fe9f5cfe16304e12a99b29d9e0cf94ee, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:07.064260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0439ccd-012c-48d7-9753-2d8240cdd119 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:07.084891 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1061/2143] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:07 2022] PUT /identity/v3/projects/9f75b4226ffa41afb397d83a095aded7/users/fe9f5cfe16304e12a99b29d9e0cf94ee/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:07.096208 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc40bb-7ecd-41e3-8701-f5bd201939ae None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:07.096738 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc40bb-7ecd-41e3-8701-f5bd201939ae None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:07.096920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc40bb-7ecd-41e3-8701-f5bd201939ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:07.130881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-03dc40bb-7ecd-41e3-8701-f5bd201939ae None None] MFA Rules not processed for user `fe9f5cfe16304e12a99b29d9e0cf94ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:07.132146 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-03dc40bb-7ecd-41e3-8701-f5bd201939ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:07.284733 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1083/2144] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:11:07.298457 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0439ccd-012c-48d7-9753-2d8240cdd119 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:07.300437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e0439ccd-012c-48d7-9753-2d8240cdd119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:07.382979 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:07.389350 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0439ccd-012c-48d7-9753-2d8240cdd119 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:07.396243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1b2a3-3d2b-4014-8209-64583dedcbac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:07.397139 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1b2a3-3d2b-4014-8209-64583dedcbac service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:07.397921 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1b2a3-3d2b-4014-8209-64583dedcbac service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:07.398603 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1b2a3-3d2b-4014-8209-64583dedcbac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:07.413634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1b2a3-3d2b-4014-8209-64583dedcbac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:07.416190 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1b2a3-3d2b-4014-8209-64583dedcbac service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:07.429954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1062/2145] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:07.598767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc40bb-7ecd-41e3-8701-f5bd201939ae None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:07.600292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-03dc40bb-7ecd-41e3-8701-f5bd201939ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:07.764307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc40bb-7ecd-41e3-8701-f5bd201939ae None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:07.778631 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19916f1d-5ffb-4813-95b5-1f35792adab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:07.780156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19916f1d-5ffb-4813-95b5-1f35792adab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:07.780414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19916f1d-5ffb-4813-95b5-1f35792adab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:07.780702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19916f1d-5ffb-4813-95b5-1f35792adab9 admin admin] PATH_INFO: `/v3/users/7ff232cb336743ee98162a54171bf0b8` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:07.782354 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19916f1d-5ffb-4813-95b5-1f35792adab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff232cb336743ee98162a54171bf0b8)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:07.784447 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19916f1d-5ffb-4813-95b5-1f35792adab9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:07.802688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:07.888123 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-19916f1d-5ffb-4813-95b5-1f35792adab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff232cb336743ee98162a54171bf0b8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:07.938374 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-19916f1d-5ffb-4813-95b5-1f35792adab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff232cb336743ee98162a54171bf0b8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:07.939296 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-19916f1d-5ffb-4813-95b5-1f35792adab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff232cb336743ee98162a54171bf0b8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:07.940104 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-19916f1d-5ffb-4813-95b5-1f35792adab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff232cb336743ee98162a54171bf0b8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:07.965915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-19916f1d-5ffb-4813-95b5-1f35792adab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff232cb336743ee98162a54171bf0b8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:07.984335 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1084/2146] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:11:07 2022] DELETE /identity/v3/users/7ff232cb336743ee98162a54171bf0b8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:07.988992 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0531c16-be13-4703-b812-000abd1ea733 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:07.989605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0531c16-be13-4703-b812-000abd1ea733 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:07.990090 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0531c16-be13-4703-b812-000abd1ea733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:08.034885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e0531c16-be13-4703-b812-000abd1ea733 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:08.039717 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e0531c16-be13-4703-b812-000abd1ea733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:08.229934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1063/2147] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:08.240680 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19916f1d-5ffb-4813-95b5-1f35792adab9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:08.242406 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-19916f1d-5ffb-4813-95b5-1f35792adab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:08.344502 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19916f1d-5ffb-4813-95b5-1f35792adab9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:08.355758 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa7940-64f8-43ba-bb71-36ab20e053b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:08.356590 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa7940-64f8-43ba-bb71-36ab20e053b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:08.357224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa7940-64f8-43ba-bb71-36ab20e053b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:08.357621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa7940-64f8-43ba-bb71-36ab20e053b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:08.380743 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa7940-64f8-43ba-bb71-36ab20e053b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:08.382338 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa7940-64f8-43ba-bb71-36ab20e053b0 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:08.408668 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1085/2148] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:09.027222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0531c16-be13-4703-b812-000abd1ea733 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:09.028767 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e0531c16-be13-4703-b812-000abd1ea733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:09.045241 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acb692-c9b6-4733-a77f-e93f44b99ec3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:09.046383 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acb692-c9b6-4733-a77f-e93f44b99ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:09.047006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acb692-c9b6-4733-a77f-e93f44b99ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:09.062111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0531c16-be13-4703-b812-000abd1ea733 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:09.078449 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-08acb692-c9b6-4733-a77f-e93f44b99ec3 None None] MFA Rules not processed for user `fe9f5cfe16304e12a99b29d9e0cf94ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:09.079753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-08acb692-c9b6-4733-a77f-e93f44b99ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:09.084218 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c717a8-2709-49c2-86c2-d18d5aa3849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:09.085216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c717a8-2709-49c2-86c2-d18d5aa3849a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:09.085616 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c717a8-2709-49c2-86c2-d18d5aa3849a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:09.085992 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c717a8-2709-49c2-86c2-d18d5aa3849a admin admin] PATH_INFO: `/v3/projects/de690ad0550d46cb98c0cf9b61820d56` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:09.088800 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c717a8-2709-49c2-86c2-d18d5aa3849a admin admin] RBAC: Authorizing `identity:delete_project(project_id=de690ad0550d46cb98c0cf9b61820d56)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:09.094175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c717a8-2709-49c2-86c2-d18d5aa3849a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:09.246814 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1086/2149] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:11:09.301058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4c717a8-2709-49c2-86c2-d18d5aa3849a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de690ad0550d46cb98c0cf9b61820d56', 'request_id': 'req-f4c717a8-2709-49c2-86c2-d18d5aa3849a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:09.322700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4c717a8-2709-49c2-86c2-d18d5aa3849a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de690ad0550d46cb98c0cf9b61820d56', 'request_id': 'req-f4c717a8-2709-49c2-86c2-d18d5aa3849a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:09.345071 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4c717a8-2709-49c2-86c2-d18d5aa3849a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de690ad0550d46cb98c0cf9b61820d56', 'request_id': 'req-f4c717a8-2709-49c2-86c2-d18d5aa3849a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:09.375842 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4c717a8-2709-49c2-86c2-d18d5aa3849a admin admin] The token cache is being invalidate because project de690ad0550d46cb98c0cf9b61820d56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:11:09.376432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4c717a8-2709-49c2-86c2-d18d5aa3849a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:09.378060 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4c717a8-2709-49c2-86c2-d18d5aa3849a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:09.384565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1064/2150] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:11:09 2022] DELETE /identity/v3/projects/de690ad0550d46cb98c0cf9b61820d56 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:09.385326 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acb692-c9b6-4733-a77f-e93f44b99ec3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:09.398283 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acb692-c9b6-4733-a77f-e93f44b99ec3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:09.472683 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:09.544152 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d7463-e29b-454e-9121-53f34688aada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:09.545307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7463-e29b-454e-9121-53f34688aada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:09.545645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7463-e29b-454e-9121-53f34688aada admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:09.547349 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7463-e29b-454e-9121-53f34688aada admin admin] PATH_INFO: `/v3/users/3a8c9ead71624463a35a5b6823ba7ab8` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:09.549802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d7463-e29b-454e-9121-53f34688aada admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a8c9ead71624463a35a5b6823ba7ab8)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:09.553531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d7463-e29b-454e-9121-53f34688aada admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:09.664091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e6d7463-e29b-454e-9121-53f34688aada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a8c9ead71624463a35a5b6823ba7ab8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:09.709189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e6d7463-e29b-454e-9121-53f34688aada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a8c9ead71624463a35a5b6823ba7ab8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:09.710264 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e6d7463-e29b-454e-9121-53f34688aada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a8c9ead71624463a35a5b6823ba7ab8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:09.711057 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e6d7463-e29b-454e-9121-53f34688aada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a8c9ead71624463a35a5b6823ba7ab8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:09.728535 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e6d7463-e29b-454e-9121-53f34688aada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a8c9ead71624463a35a5b6823ba7ab8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:09.778746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1087/2151] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:11:09 2022] DELETE /identity/v3/users/3a8c9ead71624463a35a5b6823ba7ab8 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:10.596808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c717a8-2709-49c2-86c2-d18d5aa3849a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:10.599605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f4c717a8-2709-49c2-86c2-d18d5aa3849a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:10.629927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c717a8-2709-49c2-86c2-d18d5aa3849a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:10.759771 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc96d3-0768-4471-b5e2-754e3f828cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:10.761176 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc96d3-0768-4471-b5e2-754e3f828cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:10.761884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc96d3-0768-4471-b5e2-754e3f828cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:10.762385 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc96d3-0768-4471-b5e2-754e3f828cd7 admin admin] PATH_INFO: `/v3/projects/1be5f16f0d54436e980f92ab48ce027e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:10.764572 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc96d3-0768-4471-b5e2-754e3f828cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be5f16f0d54436e980f92ab48ce027e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:10.767539 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc96d3-0768-4471-b5e2-754e3f828cd7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:10.825266 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:10.883817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f9cc96d3-0768-4471-b5e2-754e3f828cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be5f16f0d54436e980f92ab48ce027e', 'request_id': 'req-f9cc96d3-0768-4471-b5e2-754e3f828cd7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:10.910200 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f9cc96d3-0768-4471-b5e2-754e3f828cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be5f16f0d54436e980f92ab48ce027e', 'request_id': 'req-f9cc96d3-0768-4471-b5e2-754e3f828cd7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:10.922112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f9cc96d3-0768-4471-b5e2-754e3f828cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be5f16f0d54436e980f92ab48ce027e', 'request_id': 'req-f9cc96d3-0768-4471-b5e2-754e3f828cd7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:10.946964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f9cc96d3-0768-4471-b5e2-754e3f828cd7 admin admin] The token cache is being invalidate because project 1be5f16f0d54436e980f92ab48ce027e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:11:10.947262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f9cc96d3-0768-4471-b5e2-754e3f828cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:10.948040 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f9cc96d3-0768-4471-b5e2-754e3f828cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:10.967090 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1065/2152] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:11:10 2022] DELETE /identity/v3/projects/1be5f16f0d54436e980f92ab48ce027e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:10.972311 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4df78-e8c9-4c68-9728-54bad9ad7c31 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:10.972837 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4df78-e8c9-4c68-9728-54bad9ad7c31 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:10.973678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4df78-e8c9-4c68-9728-54bad9ad7c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:11.005515 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f6f4df78-e8c9-4c68-9728-54bad9ad7c31 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:11.007106 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f6f4df78-e8c9-4c68-9728-54bad9ad7c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:11.111770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1088/2153] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:11.120738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e09d95-bef0-4810-b3f6-1d59c5aa6150 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:11.121071 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e09d95-bef0-4810-b3f6-1d59c5aa6150 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:11.121743 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e09d95-bef0-4810-b3f6-1d59c5aa6150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:11.167929 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a9e09d95-bef0-4810-b3f6-1d59c5aa6150 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:11.169147 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a9e09d95-bef0-4810-b3f6-1d59c5aa6150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:11.183323 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1066/2154] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:11.185116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4df78-e8c9-4c68-9728-54bad9ad7c31 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:11.210866 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4df78-e8c9-4c68-9728-54bad9ad7c31 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:11.216957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52841dea-8901-4dc5-aa7e-55155a6f1e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:11.217895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52841dea-8901-4dc5-aa7e-55155a6f1e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:11.218277 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52841dea-8901-4dc5-aa7e-55155a6f1e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:11.218650 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52841dea-8901-4dc5-aa7e-55155a6f1e49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:11.219585 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52841dea-8901-4dc5-aa7e-55155a6f1e49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:11:11.220552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52841dea-8901-4dc5-aa7e-55155a6f1e49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:11.223962 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52841dea-8901-4dc5-aa7e-55155a6f1e49 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:11.241749 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1089/2155] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 11:11:11.246153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e09d95-bef0-4810-b3f6-1d59c5aa6150 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:11.256367 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e09d95-bef0-4810-b3f6-1d59c5aa6150 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:11.261632 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605591d-5d7e-4c24-bd79-78f048c4e43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:11.262625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605591d-5d7e-4c24-bd79-78f048c4e43d admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:11.263087 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605591d-5d7e-4c24-bd79-78f048c4e43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:11.263686 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605591d-5d7e-4c24-bd79-78f048c4e43d admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:11.264758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605591d-5d7e-4c24-bd79-78f048c4e43d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:11.267540 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605591d-5d7e-4c24-bd79-78f048c4e43d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:11.328182 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1067/2156] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:11:11 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:11.329409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52841dea-8901-4dc5-aa7e-55155a6f1e49 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:11.343180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52841dea-8901-4dc5-aa7e-55155a6f1e49 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:11.387677 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:11.416048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed4489-19ae-4bf8-acc8-a00f48076717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:11.416813 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed4489-19ae-4bf8-acc8-a00f48076717 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:11.417163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed4489-19ae-4bf8-acc8-a00f48076717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:11.417535 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed4489-19ae-4bf8-acc8-a00f48076717 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:11.418303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed4489-19ae-4bf8-acc8-a00f48076717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:11.420340 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed4489-19ae-4bf8-acc8-a00f48076717 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:11.462833 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1090/2157] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:11:11 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:11:11.466917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605591d-5d7e-4c24-bd79-78f048c4e43d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:11.481890 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605591d-5d7e-4c24-bd79-78f048c4e43d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:11.486773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78e9c7-1831-424e-97b4-075bca31dd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:11.487786 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78e9c7-1831-424e-97b4-075bca31dd4d admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:11.488053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78e9c7-1831-424e-97b4-075bca31dd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:11.488417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78e9c7-1831-424e-97b4-075bca31dd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:11.489838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78e9c7-1831-424e-97b4-075bca31dd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:11.491961 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78e9c7-1831-424e-97b4-075bca31dd4d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:11.506605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1068/2158] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:11.510541 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed4489-19ae-4bf8-acc8-a00f48076717 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:11.521790 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed4489-19ae-4bf8-acc8-a00f48076717 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:11.527545 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b559ea3-5bd6-4668-85ac-efaa0e5bdba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:11.528337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b559ea3-5bd6-4668-85ac-efaa0e5bdba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:11.528694 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b559ea3-5bd6-4668-85ac-efaa0e5bdba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:11.529051 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b559ea3-5bd6-4668-85ac-efaa0e5bdba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:11.529916 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b559ea3-5bd6-4668-85ac-efaa0e5bdba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:11.531553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b559ea3-5bd6-4668-85ac-efaa0e5bdba9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:11.545987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1091/2159] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:11:11.547738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78e9c7-1831-424e-97b4-075bca31dd4d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:11.565467 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78e9c7-1831-424e-97b4-075bca31dd4d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:11.572838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3ee82-f38c-49cd-8b59-b8525900c857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:11.576132 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3ee82-f38c-49cd-8b59-b8525900c857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:11.577166 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3ee82-f38c-49cd-8b59-b8525900c857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:11.577792 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3ee82-f38c-49cd-8b59-b8525900c857 admin admin] PATH_INFO: `/v3/projects/40ecdd796a2645a4b500b6fe7be09794/users/7c3f5deff55f44dba5420c97469c2c09/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:11.627882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3ee82-f38c-49cd-8b59-b8525900c857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ecdd796a2645a4b500b6fe7be09794, user_id=7c3f5deff55f44dba5420c97469c2c09, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:11.631429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3ee82-f38c-49cd-8b59-b8525900c857 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:11.656457 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1069/2160] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:11 2022] PUT /identity/v3/projects/40ecdd796a2645a4b500b6fe7be09794/users/7c3f5deff55f44dba5420c97469c2c09/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:11.662289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f0929-dec8-406c-aa32-d2b431e4f1f5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:11.662859 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f0929-dec8-406c-aa32-d2b431e4f1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:11.663268 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f0929-dec8-406c-aa32-d2b431e4f1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:11.695781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-396f0929-dec8-406c-aa32-d2b431e4f1f5 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:11.697303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-396f0929-dec8-406c-aa32-d2b431e4f1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:11.831979 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1092/2161] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:11.859769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3ee82-f38c-49cd-8b59-b8525900c857 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:11.861481 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7eb3ee82-f38c-49cd-8b59-b8525900c857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:11.995589 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3ee82-f38c-49cd-8b59-b8525900c857 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:12.010436 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea423daf-5988-4c57-9ecc-ea4d3a282ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:12.011105 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea423daf-5988-4c57-9ecc-ea4d3a282ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:12.011393 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea423daf-5988-4c57-9ecc-ea4d3a282ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:12.011648 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea423daf-5988-4c57-9ecc-ea4d3a282ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:12.025626 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea423daf-5988-4c57-9ecc-ea4d3a282ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:12.028636 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea423daf-5988-4c57-9ecc-ea4d3a282ea8 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:12.051807 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1070/2162] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:13.045164 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f0929-dec8-406c-aa32-d2b431e4f1f5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:13.048439 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-396f0929-dec8-406c-aa32-d2b431e4f1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:13.065533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f0929-dec8-406c-aa32-d2b431e4f1f5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:13.072620 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9380aa-f5d4-4053-b463-376adf519e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:13.077138 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9380aa-f5d4-4053-b463-376adf519e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:13.078072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9380aa-f5d4-4053-b463-376adf519e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:13.078571 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9380aa-f5d4-4053-b463-376adf519e9a admin admin] PATH_INFO: `/v3/users/3948cc90b04245268e103cd504b4c850` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:13.080245 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9380aa-f5d4-4053-b463-376adf519e9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3948cc90b04245268e103cd504b4c850)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:13.084678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9380aa-f5d4-4053-b463-376adf519e9a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:13.186896 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f9380aa-f5d4-4053-b463-376adf519e9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3948cc90b04245268e103cd504b4c850'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:13.213480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f9380aa-f5d4-4053-b463-376adf519e9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3948cc90b04245268e103cd504b4c850'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:13.214335 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f9380aa-f5d4-4053-b463-376adf519e9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3948cc90b04245268e103cd504b4c850'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:13.215083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f9380aa-f5d4-4053-b463-376adf519e9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3948cc90b04245268e103cd504b4c850'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:13.225922 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f9380aa-f5d4-4053-b463-376adf519e9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3948cc90b04245268e103cd504b4c850'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:13.246709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1093/2163] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:11:13 2022] DELETE /identity/v3/users/3948cc90b04245268e103cd504b4c850 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:13.250927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d405b-3db9-4fe6-8be4-657a0739aade None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:13.251756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d405b-3db9-4fe6-8be4-657a0739aade None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:13.252183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d405b-3db9-4fe6-8be4-657a0739aade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:13.270939 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-229d405b-3db9-4fe6-8be4-657a0739aade None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:13.272947 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-229d405b-3db9-4fe6-8be4-657a0739aade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:13.337811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:13.375412 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1071/2164] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:11:13.392738 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9380aa-f5d4-4053-b463-376adf519e9a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:13.394289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2f9380aa-f5d4-4053-b463-376adf519e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:13.429190 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d405b-3db9-4fe6-8be4-657a0739aade None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:13.432650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-229d405b-3db9-4fe6-8be4-657a0739aade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:13.451282 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:13.455139 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d405b-3db9-4fe6-8be4-657a0739aade None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:13.467262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbef64d-8aeb-4aee-b50a-91fee245f93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:13.471333 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbef64d-8aeb-4aee-b50a-91fee245f93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:13.471333 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbef64d-8aeb-4aee-b50a-91fee245f93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:13.471333 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbef64d-8aeb-4aee-b50a-91fee245f93d admin admin] PATH_INFO: `/v3/users/28dd1fefe1ab4904b83e9fdbd08d3bfe` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:13.471333 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbef64d-8aeb-4aee-b50a-91fee245f93d admin admin] RBAC: Authorizing `identity:delete_user(user_id=28dd1fefe1ab4904b83e9fdbd08d3bfe)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:13.474973 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbef64d-8aeb-4aee-b50a-91fee245f93d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:13.486269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9380aa-f5d4-4053-b463-376adf519e9a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:13.492798 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a67588-e424-4203-b340-e9f441bf2007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:13.493675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a67588-e424-4203-b340-e9f441bf2007 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:13.494030 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a67588-e424-4203-b340-e9f441bf2007 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:13.494309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a67588-e424-4203-b340-e9f441bf2007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:13.511613 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a67588-e424-4203-b340-e9f441bf2007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:13.513179 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a67588-e424-4203-b340-e9f441bf2007 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:13.539366 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1094/2165] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:13.585967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2dbef64d-8aeb-4aee-b50a-91fee245f93d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28dd1fefe1ab4904b83e9fdbd08d3bfe'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:13.616092 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2dbef64d-8aeb-4aee-b50a-91fee245f93d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28dd1fefe1ab4904b83e9fdbd08d3bfe'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:13.617186 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2dbef64d-8aeb-4aee-b50a-91fee245f93d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28dd1fefe1ab4904b83e9fdbd08d3bfe'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:13.617984 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2dbef64d-8aeb-4aee-b50a-91fee245f93d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28dd1fefe1ab4904b83e9fdbd08d3bfe'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:13.630780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2dbef64d-8aeb-4aee-b50a-91fee245f93d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28dd1fefe1ab4904b83e9fdbd08d3bfe'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:13.655908 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1072/2166] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:11:13 2022] DELETE /identity/v3/users/28dd1fefe1ab4904b83e9fdbd08d3bfe => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:11:14.222369 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a67588-e424-4203-b340-e9f441bf2007 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:14.224434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d7a67588-e424-4203-b340-e9f441bf2007 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:14.250278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbef64d-8aeb-4aee-b50a-91fee245f93d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:14.251726 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2dbef64d-8aeb-4aee-b50a-91fee245f93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:14.257292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a67588-e424-4203-b340-e9f441bf2007 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:14.397336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbef64d-8aeb-4aee-b50a-91fee245f93d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:14.397607 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc9be0-a90e-4090-bb78-965adc779b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:14.398326 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc9be0-a90e-4090-bb78-965adc779b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:14.398622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc9be0-a90e-4090-bb78-965adc779b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:14.398900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc9be0-a90e-4090-bb78-965adc779b42 admin admin] PATH_INFO: `/v3/projects/0302e92ad9e1475ab61bef9b91af363d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:14.404713 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fdd0a-e6c5-439c-abd2-26af17b49175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:14.406543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc9be0-a90e-4090-bb78-965adc779b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0302e92ad9e1475ab61bef9b91af363d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:14.407419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fdd0a-e6c5-439c-abd2-26af17b49175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:14.407846 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fdd0a-e6c5-439c-abd2-26af17b49175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:14.408700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fdd0a-e6c5-439c-abd2-26af17b49175 admin admin] PATH_INFO: `/v3/projects/0801844b85614126a95ea1c8437cfa9b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:14.409132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc9be0-a90e-4090-bb78-965adc779b42 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:14.411348 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fdd0a-e6c5-439c-abd2-26af17b49175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0801844b85614126a95ea1c8437cfa9b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:14.413615 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fdd0a-e6c5-439c-abd2-26af17b49175 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:14.496877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-416fdd0a-e6c5-439c-abd2-26af17b49175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0801844b85614126a95ea1c8437cfa9b', 'request_id': 'req-416fdd0a-e6c5-439c-abd2-26af17b49175'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:14.497700 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-54bc9be0-a90e-4090-bb78-965adc779b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0302e92ad9e1475ab61bef9b91af363d', 'request_id': 'req-54bc9be0-a90e-4090-bb78-965adc779b42'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:14.511562 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-416fdd0a-e6c5-439c-abd2-26af17b49175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0801844b85614126a95ea1c8437cfa9b', 'request_id': 'req-416fdd0a-e6c5-439c-abd2-26af17b49175'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:14.512342 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-54bc9be0-a90e-4090-bb78-965adc779b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0302e92ad9e1475ab61bef9b91af363d', 'request_id': 'req-54bc9be0-a90e-4090-bb78-965adc779b42'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:14.518736 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:14.525826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-416fdd0a-e6c5-439c-abd2-26af17b49175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0801844b85614126a95ea1c8437cfa9b', 'request_id': 'req-416fdd0a-e6c5-439c-abd2-26af17b49175'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:14.532176 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-54bc9be0-a90e-4090-bb78-965adc779b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0302e92ad9e1475ab61bef9b91af363d', 'request_id': 'req-54bc9be0-a90e-4090-bb78-965adc779b42'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:14.545734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-416fdd0a-e6c5-439c-abd2-26af17b49175 admin admin] The token cache is being invalidate because project 0801844b85614126a95ea1c8437cfa9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:11:14.546189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-54bc9be0-a90e-4090-bb78-965adc779b42 admin admin] The token cache is being invalidate because project 0302e92ad9e1475ab61bef9b91af363d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:11:14.546623 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-54bc9be0-a90e-4090-bb78-965adc779b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:14.547718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-416fdd0a-e6c5-439c-abd2-26af17b49175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:14.547912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-54bc9be0-a90e-4090-bb78-965adc779b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:14.549086 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-416fdd0a-e6c5-439c-abd2-26af17b49175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:14.550479 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1095/2167] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:11:14 2022] DELETE /identity/v3/projects/0302e92ad9e1475ab61bef9b91af363d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:14.554621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1073/2168] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:11:14 2022] DELETE /identity/v3/projects/0801844b85614126a95ea1c8437cfa9b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:14.559397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d35a1-08be-4470-88b0-6be0be20bea3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:14.559676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d35a1-08be-4470-88b0-6be0be20bea3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:14.559966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d35a1-08be-4470-88b0-6be0be20bea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:14.581753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7a4d35a1-08be-4470-88b0-6be0be20bea3 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:14.583719 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7a4d35a1-08be-4470-88b0-6be0be20bea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:14.675809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1096/2169] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:14.686255 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aeba3-782e-435b-8140-e4325188d319 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:14.686787 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aeba3-782e-435b-8140-e4325188d319 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:14.687223 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aeba3-782e-435b-8140-e4325188d319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:14.738487 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d52aeba3-782e-435b-8140-e4325188d319 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:14.741334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d52aeba3-782e-435b-8140-e4325188d319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:14.764138 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1074/2170] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:14.770648 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d35a1-08be-4470-88b0-6be0be20bea3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:14.778217 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:14.784335 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d35a1-08be-4470-88b0-6be0be20bea3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:14.792764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a28a2-287c-4737-ad42-d6ceecc0828b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:14.793629 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a28a2-287c-4737-ad42-d6ceecc0828b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:14.793986 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a28a2-287c-4737-ad42-d6ceecc0828b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:14.794359 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a28a2-287c-4737-ad42-d6ceecc0828b admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:14.795222 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a28a2-287c-4737-ad42-d6ceecc0828b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:11:14.795624 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a28a2-287c-4737-ad42-d6ceecc0828b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:14.797410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a28a2-287c-4737-ad42-d6ceecc0828b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:14.812960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1097/2171] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:11:14.818495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aeba3-782e-435b-8140-e4325188d319 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:14.829644 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aeba3-782e-435b-8140-e4325188d319 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:14.836087 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e93d01-36c0-4a57-aa9f-9ebd69e3535c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:14.836782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e93d01-36c0-4a57-aa9f-9ebd69e3535c admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:14.837061 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e93d01-36c0-4a57-aa9f-9ebd69e3535c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:14.837337 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e93d01-36c0-4a57-aa9f-9ebd69e3535c admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:14.838182 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e93d01-36c0-4a57-aa9f-9ebd69e3535c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:14.841807 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e93d01-36c0-4a57-aa9f-9ebd69e3535c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:14.874885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1075/2172] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:11:14 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:14.879835 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a28a2-287c-4737-ad42-d6ceecc0828b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:14.893357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a28a2-287c-4737-ad42-d6ceecc0828b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:15.035742 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436e391-57ca-4490-9a39-1840bbeb7b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:15.037083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436e391-57ca-4490-9a39-1840bbeb7b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:15.037743 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436e391-57ca-4490-9a39-1840bbeb7b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:15.038046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436e391-57ca-4490-9a39-1840bbeb7b74 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:15.047581 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436e391-57ca-4490-9a39-1840bbeb7b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:15.054988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436e391-57ca-4490-9a39-1840bbeb7b74 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:15.093965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1098/2173] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:11:14 2022] POST /identity/v3/users => generated 284 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:15.095937 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e93d01-36c0-4a57-aa9f-9ebd69e3535c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:15.111581 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e93d01-36c0-4a57-aa9f-9ebd69e3535c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:15.126780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33075447-a808-4331-a277-d744efec3d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:15.130825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33075447-a808-4331-a277-d744efec3d8d admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:15.131297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33075447-a808-4331-a277-d744efec3d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:15.131645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33075447-a808-4331-a277-d744efec3d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:15.132579 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33075447-a808-4331-a277-d744efec3d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:15.134403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33075447-a808-4331-a277-d744efec3d8d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:15.166785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1076/2174] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:15.166938 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436e391-57ca-4490-9a39-1840bbeb7b74 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:15.180297 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436e391-57ca-4490-9a39-1840bbeb7b74 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:15.185474 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f3629-46b2-430e-8c10-21625224f85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:15.186238 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f3629-46b2-430e-8c10-21625224f85e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:15.186776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f3629-46b2-430e-8c10-21625224f85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:15.187191 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f3629-46b2-430e-8c10-21625224f85e admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:15.188942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f3629-46b2-430e-8c10-21625224f85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:15.192689 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f3629-46b2-430e-8c10-21625224f85e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:15.214776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1099/2175] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:15.218533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33075447-a808-4331-a277-d744efec3d8d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:15.236136 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33075447-a808-4331-a277-d744efec3d8d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:15.248248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdb429-a525-4380-b986-06afabdb76dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:15.249162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdb429-a525-4380-b986-06afabdb76dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:15.250144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdb429-a525-4380-b986-06afabdb76dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:15.250798 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdb429-a525-4380-b986-06afabdb76dc admin admin] PATH_INFO: `/v3/projects/6536244395c643f48742030962c0fd4d/users/ca56a34b5e7f4749bc81519ecf70e42f/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:15.274531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbdb429-a525-4380-b986-06afabdb76dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6536244395c643f48742030962c0fd4d, user_id=ca56a34b5e7f4749bc81519ecf70e42f, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:15.277259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbdb429-a525-4380-b986-06afabdb76dc admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:15.311738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1077/2176] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:15 2022] PUT /identity/v3/projects/6536244395c643f48742030962c0fd4d/users/ca56a34b5e7f4749bc81519ecf70e42f/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:11:15.323518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d085c-88f2-4585-a7fd-6d59d6f284ad None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:15.324019 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d085c-88f2-4585-a7fd-6d59d6f284ad None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:15.324724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d085c-88f2-4585-a7fd-6d59d6f284ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:15.362621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1b4d085c-88f2-4585-a7fd-6d59d6f284ad None None] MFA Rules not processed for user `ca56a34b5e7f4749bc81519ecf70e42f`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:15.365454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1b4d085c-88f2-4585-a7fd-6d59d6f284ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:15.486138 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1100/2177] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:15.489855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdb429-a525-4380-b986-06afabdb76dc admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:15.600608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdb429-a525-4380-b986-06afabdb76dc admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:15.605625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d282a-2742-4a05-8860-b853a241c3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:15.606369 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d282a-2742-4a05-8860-b853a241c3fc admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:15.606739 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d282a-2742-4a05-8860-b853a241c3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:15.607086 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d282a-2742-4a05-8860-b853a241c3fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:15.608052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d282a-2742-4a05-8860-b853a241c3fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:15.610215 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d282a-2742-4a05-8860-b853a241c3fc admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:15.657421 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1078/2178] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:11:15 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:15.657605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d085c-88f2-4585-a7fd-6d59d6f284ad None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:15.673965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d085c-88f2-4585-a7fd-6d59d6f284ad None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:15.760269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:15.774042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65318f-8663-41d9-9fde-e070dbb026eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:15.774870 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65318f-8663-41d9-9fde-e070dbb026eb admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:15.775163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65318f-8663-41d9-9fde-e070dbb026eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:15.775435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65318f-8663-41d9-9fde-e070dbb026eb admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:15.776132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65318f-8663-41d9-9fde-e070dbb026eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:15.778217 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65318f-8663-41d9-9fde-e070dbb026eb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:15.809813 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1101/2179] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:11:15 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:15.813503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d282a-2742-4a05-8860-b853a241c3fc admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:15.824316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d282a-2742-4a05-8860-b853a241c3fc admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:15.830477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4757d8-757b-4998-8d54-c45bdddf353a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:15.831154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4757d8-757b-4998-8d54-c45bdddf353a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:15.831714 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4757d8-757b-4998-8d54-c45bdddf353a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:15.831714 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4757d8-757b-4998-8d54-c45bdddf353a admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:15.833235 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4757d8-757b-4998-8d54-c45bdddf353a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:15.835072 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4757d8-757b-4998-8d54-c45bdddf353a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:15.858312 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65318f-8663-41d9-9fde-e070dbb026eb admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:15.863492 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1079/2180] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:15.876115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65318f-8663-41d9-9fde-e070dbb026eb admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:15.890214 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34331378-f793-4c0f-b6c5-df3280406ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:15.891564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34331378-f793-4c0f-b6c5-df3280406ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:15.891564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34331378-f793-4c0f-b6c5-df3280406ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:15.892028 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34331378-f793-4c0f-b6c5-df3280406ff7 admin admin] PATH_INFO: `/v3/projects/c14b0086027d4ae9af8af42e0189379c/users/bf5d2aea5199493fa56b25f6a5253b30/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:15.919011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34331378-f793-4c0f-b6c5-df3280406ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14b0086027d4ae9af8af42e0189379c, user_id=bf5d2aea5199493fa56b25f6a5253b30, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:15.922319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34331378-f793-4c0f-b6c5-df3280406ff7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:15.950225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1102/2181] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:15 2022] PUT /identity/v3/projects/c14b0086027d4ae9af8af42e0189379c/users/bf5d2aea5199493fa56b25f6a5253b30/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:15.951084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4757d8-757b-4998-8d54-c45bdddf353a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:15.963925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4757d8-757b-4998-8d54-c45bdddf353a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:16.035798 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:16.046852 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85afeb3-ba06-4020-a355-54c65c7ed39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:16.047795 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85afeb3-ba06-4020-a355-54c65c7ed39d admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:16.048120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85afeb3-ba06-4020-a355-54c65c7ed39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:16.048414 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85afeb3-ba06-4020-a355-54c65c7ed39d admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:16.049474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85afeb3-ba06-4020-a355-54c65c7ed39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:16.053688 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85afeb3-ba06-4020-a355-54c65c7ed39d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:16.067547 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1080/2182] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:11:16.072360 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34331378-f793-4c0f-b6c5-df3280406ff7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:16.087246 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34331378-f793-4c0f-b6c5-df3280406ff7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:16.093517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0740178-fc57-4ee5-ad48-f1f89ea72f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:16.094527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0740178-fc57-4ee5-ad48-f1f89ea72f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:16.094919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0740178-fc57-4ee5-ad48-f1f89ea72f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:16.095972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0740178-fc57-4ee5-ad48-f1f89ea72f47 admin admin] PATH_INFO: `/v3/projects/c14b0086027d4ae9af8af42e0189379c/users/bf5d2aea5199493fa56b25f6a5253b30/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:16.098326 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0740178-fc57-4ee5-ad48-f1f89ea72f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14b0086027d4ae9af8af42e0189379c, user_id=bf5d2aea5199493fa56b25f6a5253b30, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:16.101074 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0740178-fc57-4ee5-ad48-f1f89ea72f47 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:16.115886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1103/2183] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:16 2022] PUT /identity/v3/projects/c14b0086027d4ae9af8af42e0189379c/users/bf5d2aea5199493fa56b25f6a5253b30/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:16.128596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184f744-ed8a-43dc-a7db-c05e0af73142 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:16.128918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184f744-ed8a-43dc-a7db-c05e0af73142 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:16.129737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184f744-ed8a-43dc-a7db-c05e0af73142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:16.171229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b184f744-ed8a-43dc-a7db-c05e0af73142 None None] MFA Rules not processed for user `bf5d2aea5199493fa56b25f6a5253b30`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:16.172837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b184f744-ed8a-43dc-a7db-c05e0af73142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:16.296154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1081/2184] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:16 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:16.308356 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0740178-fc57-4ee5-ad48-f1f89ea72f47 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:16.310378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a0740178-fc57-4ee5-ad48-f1f89ea72f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:16.376097 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0740178-fc57-4ee5-ad48-f1f89ea72f47 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:16.392479 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5991e-fad3-4963-b6bd-7da03d5fd776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:16.397184 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5991e-fad3-4963-b6bd-7da03d5fd776 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:16.397764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5991e-fad3-4963-b6bd-7da03d5fd776 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:16.398200 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5991e-fad3-4963-b6bd-7da03d5fd776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:16.410304 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5991e-fad3-4963-b6bd-7da03d5fd776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:16.412137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5991e-fad3-4963-b6bd-7da03d5fd776 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:16.423961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1104/2185] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:16 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:16.483410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184f744-ed8a-43dc-a7db-c05e0af73142 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:16.486734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b184f744-ed8a-43dc-a7db-c05e0af73142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:16.506373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184f744-ed8a-43dc-a7db-c05e0af73142 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:16.519520 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a017ae1-34e7-4163-818d-52684c7d65dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:16.522564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a017ae1-34e7-4163-818d-52684c7d65dd service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:16.522564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a017ae1-34e7-4163-818d-52684c7d65dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:16.522564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a017ae1-34e7-4163-818d-52684c7d65dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:16.589122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a017ae1-34e7-4163-818d-52684c7d65dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:16.590862 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a017ae1-34e7-4163-818d-52684c7d65dd service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:16.602244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1082/2186] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:16 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:18.931165 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e98e8-23a8-4c2d-9cea-8adadf06d4f6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:18.931647 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e98e8-23a8-4c2d-9cea-8adadf06d4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:18.931753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e98e8-23a8-4c2d-9cea-8adadf06d4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:18.980876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-053e98e8-23a8-4c2d-9cea-8adadf06d4f6 None None] MFA Rules not processed for user `7c3f5deff55f44dba5420c97469c2c09`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:18.983761 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-053e98e8-23a8-4c2d-9cea-8adadf06d4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:19.069197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1105/2187] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:19.073773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a017ae1-34e7-4163-818d-52684c7d65dd service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:19.075310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6a017ae1-34e7-4163-818d-52684c7d65dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:19.161733 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a017ae1-34e7-4163-818d-52684c7d65dd service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:19.166406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c9c54-4b96-4261-a3e3-a5ec0b665858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:19.167068 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c9c54-4b96-4261-a3e3-a5ec0b665858 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:19.167350 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c9c54-4b96-4261-a3e3-a5ec0b665858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:19.167627 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c9c54-4b96-4261-a3e3-a5ec0b665858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:19.168319 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c9c54-4b96-4261-a3e3-a5ec0b665858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:19.170275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c9c54-4b96-4261-a3e3-a5ec0b665858 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:19.193516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:19.206690 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1083/2188] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:11:19 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:19.210678 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e98e8-23a8-4c2d-9cea-8adadf06d4f6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:19.223861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e98e8-23a8-4c2d-9cea-8adadf06d4f6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:19.268732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:19.287271 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c460925-5257-4464-9dbe-857db09925ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:19.288243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c460925-5257-4464-9dbe-857db09925ab admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:19.288551 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c460925-5257-4464-9dbe-857db09925ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:19.288825 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c460925-5257-4464-9dbe-857db09925ab admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:19.289543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c460925-5257-4464-9dbe-857db09925ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:19.291470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c460925-5257-4464-9dbe-857db09925ab admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:19.313307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1106/2189] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:11:19 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:19.317292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c9c54-4b96-4261-a3e3-a5ec0b665858 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:19.328553 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c9c54-4b96-4261-a3e3-a5ec0b665858 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:19.333144 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80811a-da94-4be3-8609-b0dfd1be8ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:19.333848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80811a-da94-4be3-8609-b0dfd1be8ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:19.334128 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80811a-da94-4be3-8609-b0dfd1be8ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:19.334398 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80811a-da94-4be3-8609-b0dfd1be8ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:19.335116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80811a-da94-4be3-8609-b0dfd1be8ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:19.336703 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80811a-da94-4be3-8609-b0dfd1be8ffe admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:19.349389 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1084/2190] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:19.354620 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c460925-5257-4464-9dbe-857db09925ab admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:19.366813 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c460925-5257-4464-9dbe-857db09925ab admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:19.371913 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709e959-7cb3-431b-ba70-8a23b00dc18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:19.372870 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709e959-7cb3-431b-ba70-8a23b00dc18e admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:19.373103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709e959-7cb3-431b-ba70-8a23b00dc18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:19.373403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709e959-7cb3-431b-ba70-8a23b00dc18e admin admin] PATH_INFO: `/v3/projects/a0db519ff6624290ac6da100f8495464/users/6ce04d2d5a59474fa449140cbf24e52c/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:19.390894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709e959-7cb3-431b-ba70-8a23b00dc18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0db519ff6624290ac6da100f8495464, user_id=6ce04d2d5a59474fa449140cbf24e52c, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:19.393904 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709e959-7cb3-431b-ba70-8a23b00dc18e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:19.408763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1107/2191] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:19 2022] PUT /identity/v3/projects/a0db519ff6624290ac6da100f8495464/users/6ce04d2d5a59474fa449140cbf24e52c/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:19.413343 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80811a-da94-4be3-8609-b0dfd1be8ffe admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:19.423469 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80811a-da94-4be3-8609-b0dfd1be8ffe admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:19.479823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f6fef-67d4-47e7-82a4-b81975aa89d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:19.480483 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f6fef-67d4-47e7-82a4-b81975aa89d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:19.480763 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f6fef-67d4-47e7-82a4-b81975aa89d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:19.481034 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f6fef-67d4-47e7-82a4-b81975aa89d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:19.481790 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f6fef-67d4-47e7-82a4-b81975aa89d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:19.483373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f6fef-67d4-47e7-82a4-b81975aa89d2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:19.493545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1085/2192] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:19.497647 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709e959-7cb3-431b-ba70-8a23b00dc18e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:19.508471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709e959-7cb3-431b-ba70-8a23b00dc18e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:19.513316 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee100a22-fde1-426c-9beb-67f880938e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:19.514257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee100a22-fde1-426c-9beb-67f880938e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:19.514536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee100a22-fde1-426c-9beb-67f880938e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:19.514828 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee100a22-fde1-426c-9beb-67f880938e9b admin admin] PATH_INFO: `/v3/projects/a0db519ff6624290ac6da100f8495464/users/6ce04d2d5a59474fa449140cbf24e52c/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:19.517027 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee100a22-fde1-426c-9beb-67f880938e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0db519ff6624290ac6da100f8495464, user_id=6ce04d2d5a59474fa449140cbf24e52c, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:19.520272 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee100a22-fde1-426c-9beb-67f880938e9b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:19.530887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1108/2193] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:19 2022] PUT /identity/v3/projects/a0db519ff6624290ac6da100f8495464/users/6ce04d2d5a59474fa449140cbf24e52c/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:11:20.544681 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f6fef-67d4-47e7-82a4-b81975aa89d2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:20.557826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f6fef-67d4-47e7-82a4-b81975aa89d2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:20.680226 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88204314-8c67-453c-b9b4-6a2b152ab25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:20.681147 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88204314-8c67-453c-b9b4-6a2b152ab25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:20.681679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88204314-8c67-453c-b9b4-6a2b152ab25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:20.681988 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88204314-8c67-453c-b9b4-6a2b152ab25b admin admin] PATH_INFO: `/v3/users/ca56a34b5e7f4749bc81519ecf70e42f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:20.684781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88204314-8c67-453c-b9b4-6a2b152ab25b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca56a34b5e7f4749bc81519ecf70e42f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:20.687415 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88204314-8c67-453c-b9b4-6a2b152ab25b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:20.786255 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-88204314-8c67-453c-b9b4-6a2b152ab25b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca56a34b5e7f4749bc81519ecf70e42f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:20.804444 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-88204314-8c67-453c-b9b4-6a2b152ab25b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca56a34b5e7f4749bc81519ecf70e42f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:20.805583 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-88204314-8c67-453c-b9b4-6a2b152ab25b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca56a34b5e7f4749bc81519ecf70e42f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:20.806465 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-88204314-8c67-453c-b9b4-6a2b152ab25b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca56a34b5e7f4749bc81519ecf70e42f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:20.824375 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-88204314-8c67-453c-b9b4-6a2b152ab25b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca56a34b5e7f4749bc81519ecf70e42f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:20.847213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1086/2194] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:11:20 2022] DELETE /identity/v3/users/ca56a34b5e7f4749bc81519ecf70e42f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:20.848538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1137d5-6534-4d09-a802-4c0ffc945e46 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:20.848999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1137d5-6534-4d09-a802-4c0ffc945e46 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:20.849127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1137d5-6534-4d09-a802-4c0ffc945e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:20.886331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9e1137d5-6534-4d09-a802-4c0ffc945e46 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:20.888185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9e1137d5-6534-4d09-a802-4c0ffc945e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:20.971456 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1109/2195] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:20.981008 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88204314-8c67-453c-b9b4-6a2b152ab25b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:20.982913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-88204314-8c67-453c-b9b4-6a2b152ab25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:20.993382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:21.103782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88204314-8c67-453c-b9b4-6a2b152ab25b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:21.111060 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda68be-4ac0-42b7-8609-9f100d51828e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:21.112598 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda68be-4ac0-42b7-8609-9f100d51828e service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:21.113061 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda68be-4ac0-42b7-8609-9f100d51828e service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:21.114029 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda68be-4ac0-42b7-8609-9f100d51828e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:21.143881 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda68be-4ac0-42b7-8609-9f100d51828e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:21.145966 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda68be-4ac0-42b7-8609-9f100d51828e service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:21.168615 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1087/2196] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:21.605161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1137d5-6534-4d09-a802-4c0ffc945e46 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:21.607345 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9e1137d5-6534-4d09-a802-4c0ffc945e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:21.638958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1137d5-6534-4d09-a802-4c0ffc945e46 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:21.656083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca97e9-c755-4e5c-b767-0b646b899a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:21.661025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca97e9-c755-4e5c-b767-0b646b899a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:21.662552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca97e9-c755-4e5c-b767-0b646b899a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:21.663606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca97e9-c755-4e5c-b767-0b646b899a63 admin admin] PATH_INFO: `/v3/projects/6536244395c643f48742030962c0fd4d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:21.670480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca97e9-c755-4e5c-b767-0b646b899a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6536244395c643f48742030962c0fd4d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:21.678674 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca97e9-c755-4e5c-b767-0b646b899a63 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:21.762135 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e8ca97e9-c755-4e5c-b767-0b646b899a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6536244395c643f48742030962c0fd4d', 'request_id': 'req-e8ca97e9-c755-4e5c-b767-0b646b899a63'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:21.779046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e8ca97e9-c755-4e5c-b767-0b646b899a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6536244395c643f48742030962c0fd4d', 'request_id': 'req-e8ca97e9-c755-4e5c-b767-0b646b899a63'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:21.791045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e8ca97e9-c755-4e5c-b767-0b646b899a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6536244395c643f48742030962c0fd4d', 'request_id': 'req-e8ca97e9-c755-4e5c-b767-0b646b899a63'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:21.840585 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e8ca97e9-c755-4e5c-b767-0b646b899a63 admin admin] The token cache is being invalidate because project 6536244395c643f48742030962c0fd4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:11:21.841003 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e8ca97e9-c755-4e5c-b767-0b646b899a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:21.842620 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e8ca97e9-c755-4e5c-b767-0b646b899a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:21.852936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1110/2197] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:11:21 2022] DELETE /identity/v3/projects/6536244395c643f48742030962c0fd4d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:21.854478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda68be-4ac0-42b7-8609-9f100d51828e service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:21.867915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda68be-4ac0-42b7-8609-9f100d51828e service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:22.024264 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bfbf5-0397-41fe-a02c-d0f00d46fc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:22.025259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bfbf5-0397-41fe-a02c-d0f00d46fc08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:22.025634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bfbf5-0397-41fe-a02c-d0f00d46fc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:22.025921 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bfbf5-0397-41fe-a02c-d0f00d46fc08 admin admin] PATH_INFO: `/v3/users/bf5d2aea5199493fa56b25f6a5253b30` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:22.027953 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bfbf5-0397-41fe-a02c-d0f00d46fc08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5d2aea5199493fa56b25f6a5253b30)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:22.031146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bfbf5-0397-41fe-a02c-d0f00d46fc08 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:22.121768 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-638bfbf5-0397-41fe-a02c-d0f00d46fc08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5d2aea5199493fa56b25f6a5253b30'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:22.137101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-638bfbf5-0397-41fe-a02c-d0f00d46fc08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5d2aea5199493fa56b25f6a5253b30'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:22.154362 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-638bfbf5-0397-41fe-a02c-d0f00d46fc08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5d2aea5199493fa56b25f6a5253b30'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:22.155444 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-638bfbf5-0397-41fe-a02c-d0f00d46fc08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5d2aea5199493fa56b25f6a5253b30'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:22.177015 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-638bfbf5-0397-41fe-a02c-d0f00d46fc08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5d2aea5199493fa56b25f6a5253b30'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:22.195654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1088/2198] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:11:21 2022] DELETE /identity/v3/users/bf5d2aea5199493fa56b25f6a5253b30 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:11:23.242711 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca97e9-c755-4e5c-b767-0b646b899a63 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:23.244157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e8ca97e9-c755-4e5c-b767-0b646b899a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:23.268271 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca97e9-c755-4e5c-b767-0b646b899a63 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:23.286892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:23.348674 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689564e-0141-481a-b9e6-0b2d95df4f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:23.349589 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689564e-0141-481a-b9e6-0b2d95df4f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:23.350037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689564e-0141-481a-b9e6-0b2d95df4f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:23.350477 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689564e-0141-481a-b9e6-0b2d95df4f41 admin admin] PATH_INFO: `/v3/projects/c14b0086027d4ae9af8af42e0189379c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:23.351966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689564e-0141-481a-b9e6-0b2d95df4f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c14b0086027d4ae9af8af42e0189379c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:23.355053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689564e-0141-481a-b9e6-0b2d95df4f41 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:23.420270 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e689564e-0141-481a-b9e6-0b2d95df4f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c14b0086027d4ae9af8af42e0189379c', 'request_id': 'req-e689564e-0141-481a-b9e6-0b2d95df4f41'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:23.435510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e689564e-0141-481a-b9e6-0b2d95df4f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c14b0086027d4ae9af8af42e0189379c', 'request_id': 'req-e689564e-0141-481a-b9e6-0b2d95df4f41'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:23.444919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e689564e-0141-481a-b9e6-0b2d95df4f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c14b0086027d4ae9af8af42e0189379c', 'request_id': 'req-e689564e-0141-481a-b9e6-0b2d95df4f41'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:23.463096 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e689564e-0141-481a-b9e6-0b2d95df4f41 admin admin] The token cache is being invalidate because project c14b0086027d4ae9af8af42e0189379c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:11:23.463672 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e689564e-0141-481a-b9e6-0b2d95df4f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:23.465636 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e689564e-0141-481a-b9e6-0b2d95df4f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:23.470105 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1111/2199] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:11:23 2022] DELETE /identity/v3/projects/c14b0086027d4ae9af8af42e0189379c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:23.475508 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada56b5-3559-4a8f-91fa-d9167645970f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:23.476074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada56b5-3559-4a8f-91fa-d9167645970f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:23.476171 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada56b5-3559-4a8f-91fa-d9167645970f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:23.508223 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2ada56b5-3559-4a8f-91fa-d9167645970f None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:23.509498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2ada56b5-3559-4a8f-91fa-d9167645970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:23.549513 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:23.654951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1089/2200] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:11:23.661645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21976c0-66b1-4e2b-a3f9-8853c8ff9739 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:23.662114 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21976c0-66b1-4e2b-a3f9-8853c8ff9739 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:23.662656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21976c0-66b1-4e2b-a3f9-8853c8ff9739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:23.706830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b21976c0-66b1-4e2b-a3f9-8853c8ff9739 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:23.711758 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b21976c0-66b1-4e2b-a3f9-8853c8ff9739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:23.729310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1112/2201] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:23.733065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada56b5-3559-4a8f-91fa-d9167645970f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:23.747265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada56b5-3559-4a8f-91fa-d9167645970f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:23.756066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d359800-e5ce-41d7-bf6c-075284ca1d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:23.756821 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359800-e5ce-41d7-bf6c-075284ca1d43 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:23.757184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359800-e5ce-41d7-bf6c-075284ca1d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:23.757492 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359800-e5ce-41d7-bf6c-075284ca1d43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:23.758699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d359800-e5ce-41d7-bf6c-075284ca1d43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:11:23.759008 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d359800-e5ce-41d7-bf6c-075284ca1d43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:23.762573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d359800-e5ce-41d7-bf6c-075284ca1d43 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:23.789075 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1090/2202] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:11:23.790396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21976c0-66b1-4e2b-a3f9-8853c8ff9739 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:23.801210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21976c0-66b1-4e2b-a3f9-8853c8ff9739 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:23.813897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa8811-5aa0-4b31-ae3c-a194fe5f5a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:23.815064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa8811-5aa0-4b31-ae3c-a194fe5f5a3a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:23.824045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa8811-5aa0-4b31-ae3c-a194fe5f5a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:23.824459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa8811-5aa0-4b31-ae3c-a194fe5f5a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:23.825395 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa8811-5aa0-4b31-ae3c-a194fe5f5a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:23.827510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa8811-5aa0-4b31-ae3c-a194fe5f5a3a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:23.874267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1113/2203] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:11:23 2022] POST /identity/v3/projects => generated 393 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:23.881930 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d359800-e5ce-41d7-bf6c-075284ca1d43 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:23.901383 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d359800-e5ce-41d7-bf6c-075284ca1d43 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:23.992213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec90eec-ade6-421d-946e-ac4cd8681e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:23.992945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec90eec-ade6-421d-946e-ac4cd8681e1f admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:23.993230 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec90eec-ade6-421d-946e-ac4cd8681e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:23.993624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec90eec-ade6-421d-946e-ac4cd8681e1f admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:23.994307 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec90eec-ade6-421d-946e-ac4cd8681e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:24.001581 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec90eec-ade6-421d-946e-ac4cd8681e1f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:24.038681 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1091/2204] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:11:23 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:24.040451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa8811-5aa0-4b31-ae3c-a194fe5f5a3a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:24.063574 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa8811-5aa0-4b31-ae3c-a194fe5f5a3a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:24.072522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fefa5e-ba7e-41f1-a18a-78714c79ac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:24.073409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fefa5e-ba7e-41f1-a18a-78714c79ac56 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:24.073825 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fefa5e-ba7e-41f1-a18a-78714c79ac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:24.074435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fefa5e-ba7e-41f1-a18a-78714c79ac56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:24.075658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fefa5e-ba7e-41f1-a18a-78714c79ac56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:24.076888 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fefa5e-ba7e-41f1-a18a-78714c79ac56 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:24.089446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1114/2205] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:24.092586 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec90eec-ade6-421d-946e-ac4cd8681e1f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:24.104050 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec90eec-ade6-421d-946e-ac4cd8681e1f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:24.124620 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69d312-5fec-4e42-9e2a-85fb03968ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:24.125533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d312-5fec-4e42-9e2a-85fb03968ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:24.125888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d312-5fec-4e42-9e2a-85fb03968ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:24.126234 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d312-5fec-4e42-9e2a-85fb03968ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:24.127297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69d312-5fec-4e42-9e2a-85fb03968ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:24.128730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69d312-5fec-4e42-9e2a-85fb03968ee8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:24.150786 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1092/2206] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:24.151171 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fefa5e-ba7e-41f1-a18a-78714c79ac56 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:24.164043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fefa5e-ba7e-41f1-a18a-78714c79ac56 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:24.170822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0c564-d2a1-4703-b42b-3b0fde240bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:24.172016 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0c564-d2a1-4703-b42b-3b0fde240bea admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:24.172301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0c564-d2a1-4703-b42b-3b0fde240bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:24.173493 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0c564-d2a1-4703-b42b-3b0fde240bea admin admin] PATH_INFO: `/v3/projects/b642865791ef4faeb97fec54464eed88/users/efa82bd278a24ffbbd5dfbf59aea1789/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:24.191248 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0c564-d2a1-4703-b42b-3b0fde240bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b642865791ef4faeb97fec54464eed88, user_id=efa82bd278a24ffbbd5dfbf59aea1789, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:24.194447 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0c564-d2a1-4703-b42b-3b0fde240bea admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:24.217434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1115/2207] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:24 2022] PUT /identity/v3/projects/b642865791ef4faeb97fec54464eed88/users/efa82bd278a24ffbbd5dfbf59aea1789/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:11:24.225679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cd4aa-5d8c-4bab-893a-8afdb60320e8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:24.226240 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cd4aa-5d8c-4bab-893a-8afdb60320e8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:24.227213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cd4aa-5d8c-4bab-893a-8afdb60320e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:24.271559 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-360cd4aa-5d8c-4bab-893a-8afdb60320e8 None None] MFA Rules not processed for user `efa82bd278a24ffbbd5dfbf59aea1789`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:24.272773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-360cd4aa-5d8c-4bab-893a-8afdb60320e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:24.353567 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1093/2208] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:11:24.358022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0c564-d2a1-4703-b42b-3b0fde240bea admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:24.430270 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:24.450773 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0c564-d2a1-4703-b42b-3b0fde240bea admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:24.457834 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a008b6a-9bfa-4fe6-89bb-1957fae99d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:24.458813 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a008b6a-9bfa-4fe6-89bb-1957fae99d24 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:24.459407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a008b6a-9bfa-4fe6-89bb-1957fae99d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:24.460012 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a008b6a-9bfa-4fe6-89bb-1957fae99d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:24.460979 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a008b6a-9bfa-4fe6-89bb-1957fae99d24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:24.463712 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a008b6a-9bfa-4fe6-89bb-1957fae99d24 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:24.503134 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1116/2209] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:11:24 2022] POST /identity/v3/projects => generated 391 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:11:24.507285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cd4aa-5d8c-4bab-893a-8afdb60320e8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:24.538530 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cd4aa-5d8c-4bab-893a-8afdb60320e8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:24.569646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:24.627326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24113782-611a-421a-8134-a7d6e2b79506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:24.628396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24113782-611a-421a-8134-a7d6e2b79506 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:24.628396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24113782-611a-421a-8134-a7d6e2b79506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:24.628803 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24113782-611a-421a-8134-a7d6e2b79506 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:24.630110 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24113782-611a-421a-8134-a7d6e2b79506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:24.632170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24113782-611a-421a-8134-a7d6e2b79506 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:24.670567 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1094/2210] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:11:24 2022] POST /identity/v3/users => generated 302 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:24.670860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a008b6a-9bfa-4fe6-89bb-1957fae99d24 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:24.687642 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a008b6a-9bfa-4fe6-89bb-1957fae99d24 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:24.695183 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1c802-eafd-4413-8cb5-2d5a4bd78218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:24.696279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1c802-eafd-4413-8cb5-2d5a4bd78218 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:24.696774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1c802-eafd-4413-8cb5-2d5a4bd78218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:24.697302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1c802-eafd-4413-8cb5-2d5a4bd78218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:24.698470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1c802-eafd-4413-8cb5-2d5a4bd78218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:24.700183 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1c802-eafd-4413-8cb5-2d5a4bd78218 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:24.724004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1117/2211] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:24.729596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24113782-611a-421a-8134-a7d6e2b79506 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:24.743582 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24113782-611a-421a-8134-a7d6e2b79506 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:24.748352 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb023b-f81e-43da-bbf8-2b7808063ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:24.749303 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb023b-f81e-43da-bbf8-2b7808063ef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:24.749684 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb023b-f81e-43da-bbf8-2b7808063ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:24.749966 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb023b-f81e-43da-bbf8-2b7808063ef9 admin admin] PATH_INFO: `/v3/projects/9edbd4707c594d9fb958650fadbf6eca/users/7098aa64b1464fc9a55a16acfb1fcccf/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:24.770086 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb023b-f81e-43da-bbf8-2b7808063ef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edbd4707c594d9fb958650fadbf6eca, user_id=7098aa64b1464fc9a55a16acfb1fcccf, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:24.775278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb023b-f81e-43da-bbf8-2b7808063ef9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:24.799732 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1095/2212] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:24 2022] PUT /identity/v3/projects/9edbd4707c594d9fb958650fadbf6eca/users/7098aa64b1464fc9a55a16acfb1fcccf/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:24.804256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1c802-eafd-4413-8cb5-2d5a4bd78218 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:24.815387 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1c802-eafd-4413-8cb5-2d5a4bd78218 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:24.895873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30c2fa-6863-479d-824d-6ef95b75e88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:24.897143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30c2fa-6863-479d-824d-6ef95b75e88c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:24.897523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30c2fa-6863-479d-824d-6ef95b75e88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:24.897865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30c2fa-6863-479d-824d-6ef95b75e88c admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:24.898817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30c2fa-6863-479d-824d-6ef95b75e88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:24.900513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30c2fa-6863-479d-824d-6ef95b75e88c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:24.921525 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb023b-f81e-43da-bbf8-2b7808063ef9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:24.935053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1118/2213] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:24.937316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb023b-f81e-43da-bbf8-2b7808063ef9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:24.942784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e939-8de7-4e0d-8a84-17f12373f01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:24.943786 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e939-8de7-4e0d-8a84-17f12373f01d admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:24.944142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e939-8de7-4e0d-8a84-17f12373f01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:24.944501 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e939-8de7-4e0d-8a84-17f12373f01d admin admin] PATH_INFO: `/v3/projects/9edbd4707c594d9fb958650fadbf6eca/users/7098aa64b1464fc9a55a16acfb1fcccf/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:24.946987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3e939-8de7-4e0d-8a84-17f12373f01d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edbd4707c594d9fb958650fadbf6eca, user_id=7098aa64b1464fc9a55a16acfb1fcccf, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:24.950777 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3e939-8de7-4e0d-8a84-17f12373f01d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:24.965533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1096/2214] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:24 2022] PUT /identity/v3/projects/9edbd4707c594d9fb958650fadbf6eca/users/7098aa64b1464fc9a55a16acfb1fcccf/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:24.977408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d460d0-2802-42b7-97a7-16a1cefa9745 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:24.977408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d460d0-2802-42b7-97a7-16a1cefa9745 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:24.977408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d460d0-2802-42b7-97a7-16a1cefa9745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:25.015615 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-09d460d0-2802-42b7-97a7-16a1cefa9745 None None] MFA Rules not processed for user `7098aa64b1464fc9a55a16acfb1fcccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:25.017147 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-09d460d0-2802-42b7-97a7-16a1cefa9745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:25.195566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1119/2215] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:25.208498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e939-8de7-4e0d-8a84-17f12373f01d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:25.211240 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e6c3e939-8de7-4e0d-8a84-17f12373f01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:25.298110 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e939-8de7-4e0d-8a84-17f12373f01d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:25.303114 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ee734-172a-491d-bfef-2f133517cd44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:25.304415 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ee734-172a-491d-bfef-2f133517cd44 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:25.304772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ee734-172a-491d-bfef-2f133517cd44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:25.305130 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ee734-172a-491d-bfef-2f133517cd44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:25.321977 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ee734-172a-491d-bfef-2f133517cd44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:25.324157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ee734-172a-491d-bfef-2f133517cd44 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:25.340746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1097/2216] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:25.413736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d460d0-2802-42b7-97a7-16a1cefa9745 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:25.415668 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-09d460d0-2802-42b7-97a7-16a1cefa9745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:25.474734 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d460d0-2802-42b7-97a7-16a1cefa9745 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:25.480881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34ddcf-3668-4c21-9f3c-1b0b22f1cb7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:25.488630 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34ddcf-3668-4c21-9f3c-1b0b22f1cb7c service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:25.489085 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34ddcf-3668-4c21-9f3c-1b0b22f1cb7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:25.489652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34ddcf-3668-4c21-9f3c-1b0b22f1cb7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:25.564024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:25.592926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34ddcf-3668-4c21-9f3c-1b0b22f1cb7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:25.600818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34ddcf-3668-4c21-9f3c-1b0b22f1cb7c service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:25.615982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1120/2217] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:25.816221 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b90cd7-8941-44ae-9899-11726e13c01a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:25.817272 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b90cd7-8941-44ae-9899-11726e13c01a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:25.818279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b90cd7-8941-44ae-9899-11726e13c01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:25.852216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-91b90cd7-8941-44ae-9899-11726e13c01a None None] MFA Rules not processed for user `6ce04d2d5a59474fa449140cbf24e52c`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:25.853792 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-91b90cd7-8941-44ae-9899-11726e13c01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:25.976686 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1098/2218] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:25.987325 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34ddcf-3668-4c21-9f3c-1b0b22f1cb7c service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:25.990031 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bf34ddcf-3668-4c21-9f3c-1b0b22f1cb7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:26.088411 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34ddcf-3668-4c21-9f3c-1b0b22f1cb7c service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:26.105399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2354080-6362-4c38-bdd1-61f4f223836f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b6436fdd7a4977a2e02c0e1b8be2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:26.105399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2354080-6362-4c38-bdd1-61f4f223836f service glance] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:26.105399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2354080-6362-4c38-bdd1-61f4f223836f service glance] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:26.105399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2354080-6362-4c38-bdd1-61f4f223836f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:26.105755 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d2354080-6362-4c38-bdd1-61f4f223836f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:26.211541 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2354080-6362-4c38-bdd1-61f4f223836f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:26.216497 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2354080-6362-4c38-bdd1-61f4f223836f service glance] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:26.249467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1121/2219] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:11:26.438157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434aea5-3121-4065-b416-5775fefdb312 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:26.438267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434aea5-3121-4065-b416-5775fefdb312 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:26.438474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434aea5-3121-4065-b416-5775fefdb312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:26.447462 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:26.466818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b434aea5-3121-4065-b416-5775fefdb312 None None] MFA Rules not processed for user `40c6739db5404d59a6799b2ace1c7982`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:26.471506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b434aea5-3121-4065-b416-5775fefdb312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:26.569411 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1099/2220] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jun 27 11:11:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:26.629819 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2354080-6362-4c38-bdd1-61f4f223836f service glance] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:26.631491 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d2354080-6362-4c38-bdd1-61f4f223836f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:26.706669 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2354080-6362-4c38-bdd1-61f4f223836f service glance] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:26.712347 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7be416-1577-4deb-8888-c0fbb23e4b5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189af68908944b5e9a7cb35fde0e1bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:26.713006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7be416-1577-4deb-8888-c0fbb23e4b5d service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:26.713290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7be416-1577-4deb-8888-c0fbb23e4b5d service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:26.713602 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7be416-1577-4deb-8888-c0fbb23e4b5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:26.722629 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7be416-1577-4deb-8888-c0fbb23e4b5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:26.724562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7be416-1577-4deb-8888-c0fbb23e4b5d service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:26.733937 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1122/2221] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jun 27 11:11:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 11:11:30.727749 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434aea5-3121-4065-b416-5775fefdb312 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:30.862588 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434aea5-3121-4065-b416-5775fefdb312 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:30.868179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a142f-d237-4035-ba6a-7618a831643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:30.869395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a142f-d237-4035-ba6a-7618a831643f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:30.870050 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a142f-d237-4035-ba6a-7618a831643f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:30.870479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a142f-d237-4035-ba6a-7618a831643f admin admin] PATH_INFO: `/v3/users/efa82bd278a24ffbbd5dfbf59aea1789` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:30.871963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a142f-d237-4035-ba6a-7618a831643f admin admin] RBAC: Authorizing `identity:delete_user(user_id=efa82bd278a24ffbbd5dfbf59aea1789)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:30.874164 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a142f-d237-4035-ba6a-7618a831643f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:30.928068 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6c9a142f-d237-4035-ba6a-7618a831643f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efa82bd278a24ffbbd5dfbf59aea1789'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:30.942360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6c9a142f-d237-4035-ba6a-7618a831643f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efa82bd278a24ffbbd5dfbf59aea1789'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:30.943718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6c9a142f-d237-4035-ba6a-7618a831643f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efa82bd278a24ffbbd5dfbf59aea1789'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:30.944503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6c9a142f-d237-4035-ba6a-7618a831643f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efa82bd278a24ffbbd5dfbf59aea1789'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:30.955797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6c9a142f-d237-4035-ba6a-7618a831643f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efa82bd278a24ffbbd5dfbf59aea1789'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:30.975646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1100/2222] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:11:30 2022] DELETE /identity/v3/users/efa82bd278a24ffbbd5dfbf59aea1789 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:30.978509 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c1e2-b402-4832-a83c-9ee345c9bef5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:30.979476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c1e2-b402-4832-a83c-9ee345c9bef5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:30.980251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c1e2-b402-4832-a83c-9ee345c9bef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:30.999865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3ee8c1e2-b402-4832-a83c-9ee345c9bef5 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:31.001706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3ee8c1e2-b402-4832-a83c-9ee345c9bef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:31.024762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:31.107597 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1123/2223] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:31.114888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a142f-d237-4035-ba6a-7618a831643f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:31.117410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6c9a142f-d237-4035-ba6a-7618a831643f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:31.150920 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:31.205740 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a142f-d237-4035-ba6a-7618a831643f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:31.210834 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782247f7-770d-4494-9238-34371145d0d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:31.211633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782247f7-770d-4494-9238-34371145d0d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:31.211992 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782247f7-770d-4494-9238-34371145d0d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:31.212360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782247f7-770d-4494-9238-34371145d0d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:31.223065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782247f7-770d-4494-9238-34371145d0d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:31.224639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782247f7-770d-4494-9238-34371145d0d8 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:31.238005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1101/2224] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:32.248929 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8c1e2-b402-4832-a83c-9ee345c9bef5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:32.251677 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3ee8c1e2-b402-4832-a83c-9ee345c9bef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:32.275817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8c1e2-b402-4832-a83c-9ee345c9bef5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:32.292689 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376f396-7171-47e4-b356-a8439dc4aabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:32.293627 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376f396-7171-47e4-b356-a8439dc4aabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:32.293910 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376f396-7171-47e4-b356-a8439dc4aabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:32.294185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376f396-7171-47e4-b356-a8439dc4aabc admin admin] PATH_INFO: `/v3/projects/b642865791ef4faeb97fec54464eed88` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:32.295450 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376f396-7171-47e4-b356-a8439dc4aabc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b642865791ef4faeb97fec54464eed88)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:32.297425 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376f396-7171-47e4-b356-a8439dc4aabc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:32.404481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e376f396-7171-47e4-b356-a8439dc4aabc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b642865791ef4faeb97fec54464eed88', 'request_id': 'req-e376f396-7171-47e4-b356-a8439dc4aabc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:32.420684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e376f396-7171-47e4-b356-a8439dc4aabc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b642865791ef4faeb97fec54464eed88', 'request_id': 'req-e376f396-7171-47e4-b356-a8439dc4aabc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:32.431342 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e376f396-7171-47e4-b356-a8439dc4aabc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b642865791ef4faeb97fec54464eed88', 'request_id': 'req-e376f396-7171-47e4-b356-a8439dc4aabc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:32.462990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e376f396-7171-47e4-b356-a8439dc4aabc admin admin] The token cache is being invalidate because project b642865791ef4faeb97fec54464eed88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:11:32.463563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e376f396-7171-47e4-b356-a8439dc4aabc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:32.465116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e376f396-7171-47e4-b356-a8439dc4aabc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:32.471066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782247f7-770d-4494-9238-34371145d0d8 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:32.471617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1124/2225] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:11:32 2022] DELETE /identity/v3/projects/b642865791ef4faeb97fec54464eed88 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:32.485699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782247f7-770d-4494-9238-34371145d0d8 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:32.627189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144af10c-9d8f-47cf-bdb6-7dce8e8fff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:32.628073 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144af10c-9d8f-47cf-bdb6-7dce8e8fff78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:32.628353 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144af10c-9d8f-47cf-bdb6-7dce8e8fff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:32.628628 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144af10c-9d8f-47cf-bdb6-7dce8e8fff78 admin admin] PATH_INFO: `/v3/users/7098aa64b1464fc9a55a16acfb1fcccf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:32.630676 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144af10c-9d8f-47cf-bdb6-7dce8e8fff78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7098aa64b1464fc9a55a16acfb1fcccf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:32.634267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144af10c-9d8f-47cf-bdb6-7dce8e8fff78 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:32.754672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-144af10c-9d8f-47cf-bdb6-7dce8e8fff78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7098aa64b1464fc9a55a16acfb1fcccf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:32.796280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-144af10c-9d8f-47cf-bdb6-7dce8e8fff78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7098aa64b1464fc9a55a16acfb1fcccf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:32.797981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-144af10c-9d8f-47cf-bdb6-7dce8e8fff78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7098aa64b1464fc9a55a16acfb1fcccf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:32.798609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-144af10c-9d8f-47cf-bdb6-7dce8e8fff78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7098aa64b1464fc9a55a16acfb1fcccf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:32.810615 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-144af10c-9d8f-47cf-bdb6-7dce8e8fff78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7098aa64b1464fc9a55a16acfb1fcccf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:32.851477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1102/2226] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:11:32 2022] DELETE /identity/v3/users/7098aa64b1464fc9a55a16acfb1fcccf => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:11:33.311348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376f396-7171-47e4-b356-a8439dc4aabc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:33.313316 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e376f396-7171-47e4-b356-a8439dc4aabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:33.353879 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376f396-7171-47e4-b356-a8439dc4aabc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:33.468327 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8850e-81a7-4734-8b6d-ff9d5207af61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:33.469264 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8850e-81a7-4734-8b6d-ff9d5207af61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:33.469848 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8850e-81a7-4734-8b6d-ff9d5207af61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:33.470288 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8850e-81a7-4734-8b6d-ff9d5207af61 admin admin] PATH_INFO: `/v3/projects/9edbd4707c594d9fb958650fadbf6eca` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:33.471677 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8850e-81a7-4734-8b6d-ff9d5207af61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9edbd4707c594d9fb958650fadbf6eca)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:33.474505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8850e-81a7-4734-8b6d-ff9d5207af61 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:33.547940 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:33.553854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c5b8850e-81a7-4734-8b6d-ff9d5207af61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9edbd4707c594d9fb958650fadbf6eca', 'request_id': 'req-c5b8850e-81a7-4734-8b6d-ff9d5207af61'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:33.566206 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c5b8850e-81a7-4734-8b6d-ff9d5207af61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9edbd4707c594d9fb958650fadbf6eca', 'request_id': 'req-c5b8850e-81a7-4734-8b6d-ff9d5207af61'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:33.579566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c5b8850e-81a7-4734-8b6d-ff9d5207af61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9edbd4707c594d9fb958650fadbf6eca', 'request_id': 'req-c5b8850e-81a7-4734-8b6d-ff9d5207af61'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:33.592817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c5b8850e-81a7-4734-8b6d-ff9d5207af61 admin admin] The token cache is being invalidate because project 9edbd4707c594d9fb958650fadbf6eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:11:33.593079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c5b8850e-81a7-4734-8b6d-ff9d5207af61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:33.593736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c5b8850e-81a7-4734-8b6d-ff9d5207af61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:33.595435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1125/2227] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:11:33 2022] DELETE /identity/v3/projects/9edbd4707c594d9fb958650fadbf6eca => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:33.601155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b031fb8-4bb5-48b7-ae12-52739918793d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:33.601700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b031fb8-4bb5-48b7-ae12-52739918793d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:33.601781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b031fb8-4bb5-48b7-ae12-52739918793d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:33.624444 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9b031fb8-4bb5-48b7-ae12-52739918793d None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:33.624758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9b031fb8-4bb5-48b7-ae12-52739918793d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:33.689177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:33.712465 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1103/2228] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:33.721213 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d68abb-17f3-4eb9-a01f-99c98b6cf6a1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:33.721789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d68abb-17f3-4eb9-a01f-99c98b6cf6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:33.722285 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d68abb-17f3-4eb9-a01f-99c98b6cf6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:33.746728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-71d68abb-17f3-4eb9-a01f-99c98b6cf6a1 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:33.750167 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-71d68abb-17f3-4eb9-a01f-99c98b6cf6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:33.764656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1126/2229] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:33.765876 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b031fb8-4bb5-48b7-ae12-52739918793d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:33.780145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b031fb8-4bb5-48b7-ae12-52739918793d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:33.787096 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b84e6-a6f0-4718-b11e-c670f125f956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:33.787913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b84e6-a6f0-4718-b11e-c670f125f956 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:33.788297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b84e6-a6f0-4718-b11e-c670f125f956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:33.788672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b84e6-a6f0-4718-b11e-c670f125f956 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:33.789557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b84e6-a6f0-4718-b11e-c670f125f956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:11:33.790103 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b84e6-a6f0-4718-b11e-c670f125f956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:33.791912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b84e6-a6f0-4718-b11e-c670f125f956 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:33.814365 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1104/2230] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:11:33.815546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d68abb-17f3-4eb9-a01f-99c98b6cf6a1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:33.838181 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d68abb-17f3-4eb9-a01f-99c98b6cf6a1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:33.844094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aa0e8-6d56-4f43-bf25-046ca2096e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:33.847018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aa0e8-6d56-4f43-bf25-046ca2096e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:33.848111 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aa0e8-6d56-4f43-bf25-046ca2096e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:33.848386 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aa0e8-6d56-4f43-bf25-046ca2096e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:33.849101 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421aa0e8-6d56-4f43-bf25-046ca2096e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:33.851074 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421aa0e8-6d56-4f43-bf25-046ca2096e92 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:33.885205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1127/2231] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:11:33 2022] POST /identity/v3/projects => generated 401 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:33.889195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b84e6-a6f0-4718-b11e-c670f125f956 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:33.902517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b84e6-a6f0-4718-b11e-c670f125f956 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:34.027975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241e3eb-da1f-4ce6-ac38-a7934339acfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:34.027975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241e3eb-da1f-4ce6-ac38-a7934339acfb admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:34.027975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241e3eb-da1f-4ce6-ac38-a7934339acfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:34.027975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241e3eb-da1f-4ce6-ac38-a7934339acfb admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:34.028486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241e3eb-da1f-4ce6-ac38-a7934339acfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:34.028486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241e3eb-da1f-4ce6-ac38-a7934339acfb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:34.060628 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1105/2232] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:11:33 2022] POST /identity/v3/users => generated 301 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:34.064822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aa0e8-6d56-4f43-bf25-046ca2096e92 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:34.122546 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aa0e8-6d56-4f43-bf25-046ca2096e92 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:34.145160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53898930-0d6a-4cb1-9a79-08a1184df620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:34.145160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53898930-0d6a-4cb1-9a79-08a1184df620 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:34.145160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53898930-0d6a-4cb1-9a79-08a1184df620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:34.145160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53898930-0d6a-4cb1-9a79-08a1184df620 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:34.145612 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53898930-0d6a-4cb1-9a79-08a1184df620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:34.145612 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53898930-0d6a-4cb1-9a79-08a1184df620 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:34.154208 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1128/2233] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:34.163734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241e3eb-da1f-4ce6-ac38-a7934339acfb admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:34.181758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241e3eb-da1f-4ce6-ac38-a7934339acfb admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:34.216640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b5177-6103-494a-a876-fbfc08ba7397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:34.217401 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b5177-6103-494a-a876-fbfc08ba7397 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:34.217709 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b5177-6103-494a-a876-fbfc08ba7397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:34.217989 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b5177-6103-494a-a876-fbfc08ba7397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:34.218726 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b5177-6103-494a-a876-fbfc08ba7397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:34.222256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b5177-6103-494a-a876-fbfc08ba7397 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:34.258241 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1106/2234] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:34.262451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53898930-0d6a-4cb1-9a79-08a1184df620 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:34.275495 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53898930-0d6a-4cb1-9a79-08a1184df620 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:34.281385 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846864b4-6692-4008-b3e6-908f04ccba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:34.282235 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846864b4-6692-4008-b3e6-908f04ccba1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:34.282519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846864b4-6692-4008-b3e6-908f04ccba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:34.282808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846864b4-6692-4008-b3e6-908f04ccba1e admin admin] PATH_INFO: `/v3/projects/20554630c2374234aa63565c52551d39/users/e2d2e22f955f477b8dd622c66d604696/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:34.303530 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846864b4-6692-4008-b3e6-908f04ccba1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=20554630c2374234aa63565c52551d39, user_id=e2d2e22f955f477b8dd622c66d604696, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:34.306610 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846864b4-6692-4008-b3e6-908f04ccba1e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:34.341692 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1129/2235] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:34 2022] PUT /identity/v3/projects/20554630c2374234aa63565c52551d39/users/e2d2e22f955f477b8dd622c66d604696/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:34.353395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc72af0-4ad4-480a-ad2f-29962cdf1580 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:34.354008 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc72af0-4ad4-480a-ad2f-29962cdf1580 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:34.354380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc72af0-4ad4-480a-ad2f-29962cdf1580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:34.386619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b78c8-ab51-4cf9-878b-53dc021ee61a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:34.387283 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b78c8-ab51-4cf9-878b-53dc021ee61a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:34.387735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b78c8-ab51-4cf9-878b-53dc021ee61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:34.407349 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5fc72af0-4ad4-480a-ad2f-29962cdf1580 None None] MFA Rules not processed for user `e2d2e22f955f477b8dd622c66d604696`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:34.409797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5fc72af0-4ad4-480a-ad2f-29962cdf1580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:34.411353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-978b78c8-ab51-4cf9-878b-53dc021ee61a None None] MFA Rules not processed for user `40c6739db5404d59a6799b2ace1c7982`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:34.412739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-978b78c8-ab51-4cf9-878b-53dc021ee61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:34.497967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1130/2236] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jun 27 11:11:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:11:34.512379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b78c8-ab51-4cf9-878b-53dc021ee61a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:34.513814 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-978b78c8-ab51-4cf9-878b-53dc021ee61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:34.526488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1107/2237] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:34.531405 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc72af0-4ad4-480a-ad2f-29962cdf1580 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:34.601017 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b78c8-ab51-4cf9-878b-53dc021ee61a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:34.606409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56a7c1-9272-4bd8-8bcc-f18c4da1307a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189af68908944b5e9a7cb35fde0e1bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:34.607301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56a7c1-9272-4bd8-8bcc-f18c4da1307a service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:34.607301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56a7c1-9272-4bd8-8bcc-f18c4da1307a service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:34.607743 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56a7c1-9272-4bd8-8bcc-f18c4da1307a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:34.614289 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:34.618628 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56a7c1-9272-4bd8-8bcc-f18c4da1307a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:34.621333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56a7c1-9272-4bd8-8bcc-f18c4da1307a service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:34.631712 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1131/2238] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jun 27 11:11:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 11:11:34.640525 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc72af0-4ad4-480a-ad2f-29962cdf1580 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:34.648510 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b1dd1-7acd-4960-837d-7fb04750e378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:34.649265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b1dd1-7acd-4960-837d-7fb04750e378 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:34.649647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b1dd1-7acd-4960-837d-7fb04750e378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:34.649987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b1dd1-7acd-4960-837d-7fb04750e378 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:34.650745 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b1dd1-7acd-4960-837d-7fb04750e378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:34.652742 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b1dd1-7acd-4960-837d-7fb04750e378 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:34.688419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1108/2239] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:11:34 2022] POST /identity/v3/projects => generated 401 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:34.692732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56a7c1-9272-4bd8-8bcc-f18c4da1307a service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:34.703940 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56a7c1-9272-4bd8-8bcc-f18c4da1307a service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:34.708595 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:34.792512 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321d8c0-10bb-40bd-93d1-2616bc964aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:34.793271 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321d8c0-10bb-40bd-93d1-2616bc964aaa admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:34.793592 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321d8c0-10bb-40bd-93d1-2616bc964aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:34.793894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321d8c0-10bb-40bd-93d1-2616bc964aaa admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:34.794556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321d8c0-10bb-40bd-93d1-2616bc964aaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:34.796505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321d8c0-10bb-40bd-93d1-2616bc964aaa admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:34.825022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1132/2240] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:11:34 2022] POST /identity/v3/users => generated 307 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:34.828994 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b1dd1-7acd-4960-837d-7fb04750e378 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:34.842920 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b1dd1-7acd-4960-837d-7fb04750e378 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:34.848256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7597cd-4316-4741-8758-42083bedc8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:34.849007 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7597cd-4316-4741-8758-42083bedc8ec admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:34.849431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7597cd-4316-4741-8758-42083bedc8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:34.849797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7597cd-4316-4741-8758-42083bedc8ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:34.850647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7597cd-4316-4741-8758-42083bedc8ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:34.852354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7597cd-4316-4741-8758-42083bedc8ec admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:34.868460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1109/2241] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:11:34.872108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321d8c0-10bb-40bd-93d1-2616bc964aaa admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:34.896736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321d8c0-10bb-40bd-93d1-2616bc964aaa admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:34.896736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5fd2b-f4a7-4dff-a5c7-64217b0487fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:34.897522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5fd2b-f4a7-4dff-a5c7-64217b0487fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:34.897961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5fd2b-f4a7-4dff-a5c7-64217b0487fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:34.898687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5fd2b-f4a7-4dff-a5c7-64217b0487fc admin admin] PATH_INFO: `/v3/projects/e7b53e7a3ede4f19b0703537f2d771eb/users/4cb5b84fd2bf4dc4b3f22137195768b8/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:34.919463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5fd2b-f4a7-4dff-a5c7-64217b0487fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b53e7a3ede4f19b0703537f2d771eb, user_id=4cb5b84fd2bf4dc4b3f22137195768b8, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:34.922408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5fd2b-f4a7-4dff-a5c7-64217b0487fc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:34.945183 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1133/2242] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:34 2022] PUT /identity/v3/projects/e7b53e7a3ede4f19b0703537f2d771eb/users/4cb5b84fd2bf4dc4b3f22137195768b8/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:34.948933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7597cd-4316-4741-8758-42083bedc8ec admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:34.965847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18669b1f-4645-4eb8-b22a-6fa775932634 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:34.966292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18669b1f-4645-4eb8-b22a-6fa775932634 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:34.966669 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18669b1f-4645-4eb8-b22a-6fa775932634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:34.968021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7597cd-4316-4741-8758-42083bedc8ec admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:35.013292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-18669b1f-4645-4eb8-b22a-6fa775932634 None None] MFA Rules not processed for user `3ce30513dcc846fc82ec79a1d68ad4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:35.019037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-18669b1f-4645-4eb8-b22a-6fa775932634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:35.072707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7cbca-60af-4d29-8437-68a19133050b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:35.073677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7cbca-60af-4d29-8437-68a19133050b admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:35.073963 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7cbca-60af-4d29-8437-68a19133050b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:35.074231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7cbca-60af-4d29-8437-68a19133050b admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:35.074958 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7cbca-60af-4d29-8437-68a19133050b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:35.076564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7cbca-60af-4d29-8437-68a19133050b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:35.104835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1110/2243] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:35.105757 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7cbca-60af-4d29-8437-68a19133050b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:35.116801 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7cbca-60af-4d29-8437-68a19133050b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:35.121977 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b2f93-3e5b-4c31-a09b-d4fd36167abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:35.122861 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b2f93-3e5b-4c31-a09b-d4fd36167abe admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:35.123141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b2f93-3e5b-4c31-a09b-d4fd36167abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:35.123412 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b2f93-3e5b-4c31-a09b-d4fd36167abe admin admin] PATH_INFO: `/v3/projects/e7b53e7a3ede4f19b0703537f2d771eb/users/4cb5b84fd2bf4dc4b3f22137195768b8/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:35.125426 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b2f93-3e5b-4c31-a09b-d4fd36167abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b53e7a3ede4f19b0703537f2d771eb, user_id=4cb5b84fd2bf4dc4b3f22137195768b8, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:35.128098 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b2f93-3e5b-4c31-a09b-d4fd36167abe admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:35.139564 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1134/2244] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:35.145326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1111/2245] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:35 2022] PUT /identity/v3/projects/e7b53e7a3ede4f19b0703537f2d771eb/users/4cb5b84fd2bf4dc4b3f22137195768b8/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:35.155752 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b470645-8c8e-4bd7-8b77-f3546c7dd2c2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:35.155939 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b470645-8c8e-4bd7-8b77-f3546c7dd2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:35.156464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b470645-8c8e-4bd7-8b77-f3546c7dd2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:35.192899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2b470645-8c8e-4bd7-8b77-f3546c7dd2c2 None None] MFA Rules not processed for user `4cb5b84fd2bf4dc4b3f22137195768b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:35.194339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2b470645-8c8e-4bd7-8b77-f3546c7dd2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:35.302794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1135/2246] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:35 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:35.316964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b2f93-3e5b-4c31-a09b-d4fd36167abe admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:35.319056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b88b2f93-3e5b-4c31-a09b-d4fd36167abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:35.411992 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b2f93-3e5b-4c31-a09b-d4fd36167abe admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:35.416105 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0397f6-835d-4f61-a388-8472cf64b05c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:35.416826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0397f6-835d-4f61-a388-8472cf64b05c service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:35.417145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0397f6-835d-4f61-a388-8472cf64b05c service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:35.417520 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0397f6-835d-4f61-a388-8472cf64b05c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:35.432372 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0397f6-835d-4f61-a388-8472cf64b05c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:35.434072 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0397f6-835d-4f61-a388-8472cf64b05c service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:35.449283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1112/2247] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:35 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:35.522041 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394afa6c-706a-49dd-897a-dc54a68a47b9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:35.522598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394afa6c-706a-49dd-897a-dc54a68a47b9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:35.522746 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394afa6c-706a-49dd-897a-dc54a68a47b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:35.530794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:35.556163 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-394afa6c-706a-49dd-897a-dc54a68a47b9 None None] MFA Rules not processed for user `40c6739db5404d59a6799b2ace1c7982`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:35.557787 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-394afa6c-706a-49dd-897a-dc54a68a47b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:35.561530 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0397f6-835d-4f61-a388-8472cf64b05c service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:35.574999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0397f6-835d-4f61-a388-8472cf64b05c service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:35.587651 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b025d6-08bc-4805-b2f5-ba5b906a6b3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:35.588321 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b025d6-08bc-4805-b2f5-ba5b906a6b3c service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:35.588795 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b025d6-08bc-4805-b2f5-ba5b906a6b3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:35.589076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b025d6-08bc-4805-b2f5-ba5b906a6b3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:35.649441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1136/2248] 10.222.0.18 () {58 vars in 967 bytes} [Mon Jun 27 11:11:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:35.676709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394afa6c-706a-49dd-897a-dc54a68a47b9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:35.710354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:35.735503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b025d6-08bc-4805-b2f5-ba5b906a6b3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:35.738031 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b025d6-08bc-4805-b2f5-ba5b906a6b3c service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:35.752072 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1113/2249] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:11:35.851820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394afa6c-706a-49dd-897a-dc54a68a47b9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:35.859553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63b913-b6d5-4f40-9fab-ee743321c3fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189af68908944b5e9a7cb35fde0e1bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:35.860210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63b913-b6d5-4f40-9fab-ee743321c3fe service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:35.860495 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63b913-b6d5-4f40-9fab-ee743321c3fe service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:35.860774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63b913-b6d5-4f40-9fab-ee743321c3fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:35.872587 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63b913-b6d5-4f40-9fab-ee743321c3fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:35.874736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63b913-b6d5-4f40-9fab-ee743321c3fe service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:35.887806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1137/2250] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jun 27 11:11:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 11:11:36.286135 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d722915-274c-44c7-8ece-bfe1a0d887d5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:36.286734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d722915-274c-44c7-8ece-bfe1a0d887d5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:36.287435 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d722915-274c-44c7-8ece-bfe1a0d887d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:36.305976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0d722915-274c-44c7-8ece-bfe1a0d887d5 None None] MFA Rules not processed for user `40c6739db5404d59a6799b2ace1c7982`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:36.307254 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0d722915-274c-44c7-8ece-bfe1a0d887d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:36.325586 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1114/2251] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jun 27 11:11:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:36.332463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63b913-b6d5-4f40-9fab-ee743321c3fe service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:36.343072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63b913-b6d5-4f40-9fab-ee743321c3fe service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:36.351567 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc6562-80f2-4133-931c-3cbad15b84d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189af68908944b5e9a7cb35fde0e1bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:36.352223 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc6562-80f2-4133-931c-3cbad15b84d7 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:36.352508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc6562-80f2-4133-931c-3cbad15b84d7 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:36.352787 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc6562-80f2-4133-931c-3cbad15b84d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:36.363531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc6562-80f2-4133-931c-3cbad15b84d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:36.365140 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc6562-80f2-4133-931c-3cbad15b84d7 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:36.384119 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1138/2252] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jun 27 11:11:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 11:11:36.825552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312636d-40e8-4c5e-bc93-043edc4e9146 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:36.826532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312636d-40e8-4c5e-bc93-043edc4e9146 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:36.827031 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312636d-40e8-4c5e-bc93-043edc4e9146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:36.851174 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6312636d-40e8-4c5e-bc93-043edc4e9146 None None] MFA Rules not processed for user `40c6739db5404d59a6799b2ace1c7982`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:36.852805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6312636d-40e8-4c5e-bc93-043edc4e9146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:36.867426 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1115/2253] 10.222.0.18 () {58 vars in 967 bytes} [Mon Jun 27 11:11:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:36.874244 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc6562-80f2-4133-931c-3cbad15b84d7 service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:36.893145 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc6562-80f2-4133-931c-3cbad15b84d7 service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:36.900513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb59876-7930-4f01-a5d6-cded4ed4cfc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189af68908944b5e9a7cb35fde0e1bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:36.901255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb59876-7930-4f01-a5d6-cded4ed4cfc4 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:36.901658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb59876-7930-4f01-a5d6-cded4ed4cfc4 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:36.901942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb59876-7930-4f01-a5d6-cded4ed4cfc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:36.914614 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb59876-7930-4f01-a5d6-cded4ed4cfc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:36.916369 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb59876-7930-4f01-a5d6-cded4ed4cfc4 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:36.929411 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1139/2254] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jun 27 11:11:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 11:11:39.460173 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d7b19-1593-4899-9226-e271d26b7d2e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:39.460749 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d7b19-1593-4899-9226-e271d26b7d2e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:39.460852 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d7b19-1593-4899-9226-e271d26b7d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:39.478490 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-403d7b19-1593-4899-9226-e271d26b7d2e None None] MFA Rules not processed for user `7c3f5deff55f44dba5420c97469c2c09`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:39.479668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-403d7b19-1593-4899-9226-e271d26b7d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:39.526897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb59876-7930-4f01-a5d6-cded4ed4cfc4 service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:39.528783 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2fb59876-7930-4f01-a5d6-cded4ed4cfc4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:39.551445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1116/2255] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:39.621676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb59876-7930-4f01-a5d6-cded4ed4cfc4 service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:39.626410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac87e1-0f0b-426c-9a56-ac40ee69120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:39.627282 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac87e1-0f0b-426c-9a56-ac40ee69120e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:39.627568 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac87e1-0f0b-426c-9a56-ac40ee69120e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:39.627847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac87e1-0f0b-426c-9a56-ac40ee69120e admin admin] PATH_INFO: `/v3/users/fe9f5cfe16304e12a99b29d9e0cf94ee` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:39.629070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac87e1-0f0b-426c-9a56-ac40ee69120e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9f5cfe16304e12a99b29d9e0cf94ee)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:39.631075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac87e1-0f0b-426c-9a56-ac40ee69120e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:39.645330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:39.697011 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c9ac87e1-0f0b-426c-9a56-ac40ee69120e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9f5cfe16304e12a99b29d9e0cf94ee'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:39.712680 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c9ac87e1-0f0b-426c-9a56-ac40ee69120e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9f5cfe16304e12a99b29d9e0cf94ee'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:39.714141 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c9ac87e1-0f0b-426c-9a56-ac40ee69120e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9f5cfe16304e12a99b29d9e0cf94ee'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:39.714751 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c9ac87e1-0f0b-426c-9a56-ac40ee69120e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9f5cfe16304e12a99b29d9e0cf94ee'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:39.726415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c9ac87e1-0f0b-426c-9a56-ac40ee69120e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9f5cfe16304e12a99b29d9e0cf94ee'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:39.742674 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1140/2256] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:11:39 2022] DELETE /identity/v3/users/fe9f5cfe16304e12a99b29d9e0cf94ee => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:39.747160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e219d5c-b3f4-4bab-b830-07d2ee0ebf87 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:39.747669 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e219d5c-b3f4-4bab-b830-07d2ee0ebf87 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:39.748097 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e219d5c-b3f4-4bab-b830-07d2ee0ebf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:39.770784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5e219d5c-b3f4-4bab-b830-07d2ee0ebf87 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:39.772157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5e219d5c-b3f4-4bab-b830-07d2ee0ebf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:39.874393 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1117/2257] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:11:39.887390 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac87e1-0f0b-426c-9a56-ac40ee69120e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:39.888996 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c9ac87e1-0f0b-426c-9a56-ac40ee69120e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:39.973339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac87e1-0f0b-426c-9a56-ac40ee69120e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:39.986362 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81945445-a6a7-4e09-b785-6436565064bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:39.987057 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81945445-a6a7-4e09-b785-6436565064bb service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:39.987698 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81945445-a6a7-4e09-b785-6436565064bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:39.987827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81945445-a6a7-4e09-b785-6436565064bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:40.002447 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81945445-a6a7-4e09-b785-6436565064bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:40.005871 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81945445-a6a7-4e09-b785-6436565064bb service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:40.016618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1141/2258] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:40.399974 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e219d5c-b3f4-4bab-b830-07d2ee0ebf87 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:40.401987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5e219d5c-b3f4-4bab-b830-07d2ee0ebf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:40.414374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e219d5c-b3f4-4bab-b830-07d2ee0ebf87 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:40.420033 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff7da7-697f-477b-844c-b4ea1412f8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:40.421022 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff7da7-697f-477b-844c-b4ea1412f8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:40.421409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff7da7-697f-477b-844c-b4ea1412f8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:40.421755 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff7da7-697f-477b-844c-b4ea1412f8a8 admin admin] PATH_INFO: `/v3/users/e2d2e22f955f477b8dd622c66d604696` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:40.423094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff7da7-697f-477b-844c-b4ea1412f8a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2d2e22f955f477b8dd622c66d604696)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:40.425505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff7da7-697f-477b-844c-b4ea1412f8a8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:40.480893 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-87ff7da7-697f-477b-844c-b4ea1412f8a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2d2e22f955f477b8dd622c66d604696'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:40.504780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-87ff7da7-697f-477b-844c-b4ea1412f8a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2d2e22f955f477b8dd622c66d604696'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:40.505691 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-87ff7da7-697f-477b-844c-b4ea1412f8a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2d2e22f955f477b8dd622c66d604696'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:40.506820 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-87ff7da7-697f-477b-844c-b4ea1412f8a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2d2e22f955f477b8dd622c66d604696'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:40.510877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:40.518373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-87ff7da7-697f-477b-844c-b4ea1412f8a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2d2e22f955f477b8dd622c66d604696'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:40.544450 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1118/2259] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:11:40 2022] DELETE /identity/v3/users/e2d2e22f955f477b8dd622c66d604696 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:40.548824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831391dd-e032-4a4b-a078-308a501620f4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:40.549921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831391dd-e032-4a4b-a078-308a501620f4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:40.550928 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831391dd-e032-4a4b-a078-308a501620f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:40.570430 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-831391dd-e032-4a4b-a078-308a501620f4 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:40.571625 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-831391dd-e032-4a4b-a078-308a501620f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:40.583321 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff7da7-697f-477b-844c-b4ea1412f8a8 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:40.585506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-87ff7da7-697f-477b-844c-b4ea1412f8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:40.690329 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1142/2260] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:11:40.700028 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831391dd-e032-4a4b-a078-308a501620f4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:40.701687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-831391dd-e032-4a4b-a078-308a501620f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:40.717049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff7da7-697f-477b-844c-b4ea1412f8a8 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:40.723912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221da38-4ba7-4bf0-9d27-3785e7e5c0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:40.725721 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221da38-4ba7-4bf0-9d27-3785e7e5c0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:40.726172 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221da38-4ba7-4bf0-9d27-3785e7e5c0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:40.727316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221da38-4ba7-4bf0-9d27-3785e7e5c0f9 admin admin] PATH_INFO: `/v3/projects/9f75b4226ffa41afb397d83a095aded7` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:40.728641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221da38-4ba7-4bf0-9d27-3785e7e5c0f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f75b4226ffa41afb397d83a095aded7)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:40.731033 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221da38-4ba7-4bf0-9d27-3785e7e5c0f9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:40.747416 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:40.787526 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831391dd-e032-4a4b-a078-308a501620f4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:40.795150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9871471-315f-4389-92b9-fc4d952a7075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:40.805739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9871471-315f-4389-92b9-fc4d952a7075 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:40.806027 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9871471-315f-4389-92b9-fc4d952a7075 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:40.806478 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9871471-315f-4389-92b9-fc4d952a7075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:40.814875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3221da38-4ba7-4bf0-9d27-3785e7e5c0f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f75b4226ffa41afb397d83a095aded7', 'request_id': 'req-3221da38-4ba7-4bf0-9d27-3785e7e5c0f9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:40.822562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9871471-315f-4389-92b9-fc4d952a7075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:40.823782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3221da38-4ba7-4bf0-9d27-3785e7e5c0f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f75b4226ffa41afb397d83a095aded7', 'request_id': 'req-3221da38-4ba7-4bf0-9d27-3785e7e5c0f9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:40.824038 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9871471-315f-4389-92b9-fc4d952a7075 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:40.833490 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3221da38-4ba7-4bf0-9d27-3785e7e5c0f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f75b4226ffa41afb397d83a095aded7', 'request_id': 'req-3221da38-4ba7-4bf0-9d27-3785e7e5c0f9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:40.850128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1143/2261] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:11:40.866142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3221da38-4ba7-4bf0-9d27-3785e7e5c0f9 admin admin] The token cache is being invalidate because project 9f75b4226ffa41afb397d83a095aded7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:11:40.866684 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3221da38-4ba7-4bf0-9d27-3785e7e5c0f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:40.867631 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3221da38-4ba7-4bf0-9d27-3785e7e5c0f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:40.869737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1119/2262] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:11:40 2022] DELETE /identity/v3/projects/9f75b4226ffa41afb397d83a095aded7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:11:40.876681 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe31811-6bac-46ec-b1b6-64089e6e4591 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:40.877070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe31811-6bac-46ec-b1b6-64089e6e4591 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:40.877355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe31811-6bac-46ec-b1b6-64089e6e4591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:40.907436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cfe31811-6bac-46ec-b1b6-64089e6e4591 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:40.909642 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cfe31811-6bac-46ec-b1b6-64089e6e4591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:40.990067 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1144/2263] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:40.998219 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee2ab9-13e5-4121-beec-afdda88d167b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:40.998888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee2ab9-13e5-4121-beec-afdda88d167b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:40.998888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee2ab9-13e5-4121-beec-afdda88d167b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:41.018616 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0bee2ab9-13e5-4121-beec-afdda88d167b None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:41.021259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0bee2ab9-13e5-4121-beec-afdda88d167b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:41.031375 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1120/2264] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:41.036026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe31811-6bac-46ec-b1b6-64089e6e4591 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:41.046180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe31811-6bac-46ec-b1b6-64089e6e4591 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:41.051743 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0fc28-d2ed-49d3-8e50-4815a44d54ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:41.052469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0fc28-d2ed-49d3-8e50-4815a44d54ed admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:41.052814 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0fc28-d2ed-49d3-8e50-4815a44d54ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:41.053153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0fc28-d2ed-49d3-8e50-4815a44d54ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:41.053997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0fc28-d2ed-49d3-8e50-4815a44d54ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:11:41.054366 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0fc28-d2ed-49d3-8e50-4815a44d54ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:41.056024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0fc28-d2ed-49d3-8e50-4815a44d54ed admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:41.068667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1145/2265] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:11:41.073045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee2ab9-13e5-4121-beec-afdda88d167b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:41.082282 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee2ab9-13e5-4121-beec-afdda88d167b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:41.087029 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f86ce-781c-462c-8557-d7e8d32ee16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:41.087682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f86ce-781c-462c-8557-d7e8d32ee16a admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:41.087966 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f86ce-781c-462c-8557-d7e8d32ee16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:41.088251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f86ce-781c-462c-8557-d7e8d32ee16a admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:41.088945 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f86ce-781c-462c-8557-d7e8d32ee16a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:41.090877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f86ce-781c-462c-8557-d7e8d32ee16a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:41.118941 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1121/2266] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:11:41 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:41.123033 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0fc28-d2ed-49d3-8e50-4815a44d54ed admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:41.133349 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0fc28-d2ed-49d3-8e50-4815a44d54ed admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:41.151454 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f86ce-781c-462c-8557-d7e8d32ee16a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:41.153202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ca7f86ce-781c-462c-8557-d7e8d32ee16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:41.207019 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f71a1-90d7-4bcb-888a-8ac59ef2e300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:41.207702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f71a1-90d7-4bcb-888a-8ac59ef2e300 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:41.207993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f71a1-90d7-4bcb-888a-8ac59ef2e300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:41.208275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f71a1-90d7-4bcb-888a-8ac59ef2e300 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:41.208980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f71a1-90d7-4bcb-888a-8ac59ef2e300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:41.210953 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f71a1-90d7-4bcb-888a-8ac59ef2e300 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:41.211419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:41.228725 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f86ce-781c-462c-8557-d7e8d32ee16a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:41.232398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1146/2267] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:11:41 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:41.233803 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79070e6d-f4cb-431d-b359-9552481be2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:41.234650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79070e6d-f4cb-431d-b359-9552481be2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:41.234929 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79070e6d-f4cb-431d-b359-9552481be2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:41.235220 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79070e6d-f4cb-431d-b359-9552481be2d9 admin admin] PATH_INFO: `/v3/projects/20554630c2374234aa63565c52551d39` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:41.236186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f71a1-90d7-4bcb-888a-8ac59ef2e300 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:41.236382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79070e6d-f4cb-431d-b359-9552481be2d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20554630c2374234aa63565c52551d39)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:41.238921 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79070e6d-f4cb-431d-b359-9552481be2d9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:41.246572 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f71a1-90d7-4bcb-888a-8ac59ef2e300 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:41.251304 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e37aea-2d99-4b47-b0a4-4f2b610bfb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:41.251958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e37aea-2d99-4b47-b0a4-4f2b610bfb1b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:41.252270 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e37aea-2d99-4b47-b0a4-4f2b610bfb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:41.252548 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e37aea-2d99-4b47-b0a4-4f2b610bfb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:41.253275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e37aea-2d99-4b47-b0a4-4f2b610bfb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:41.254922 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e37aea-2d99-4b47-b0a4-4f2b610bfb1b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:41.265137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1147/2268] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:41.269918 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e37aea-2d99-4b47-b0a4-4f2b610bfb1b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:41.279446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e37aea-2d99-4b47-b0a4-4f2b610bfb1b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:41.288504 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-79070e6d-f4cb-431d-b359-9552481be2d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20554630c2374234aa63565c52551d39', 'request_id': 'req-79070e6d-f4cb-431d-b359-9552481be2d9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:41.294655 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-79070e6d-f4cb-431d-b359-9552481be2d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20554630c2374234aa63565c52551d39', 'request_id': 'req-79070e6d-f4cb-431d-b359-9552481be2d9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:41.300151 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-79070e6d-f4cb-431d-b359-9552481be2d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20554630c2374234aa63565c52551d39', 'request_id': 'req-79070e6d-f4cb-431d-b359-9552481be2d9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:41.313413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-79070e6d-f4cb-431d-b359-9552481be2d9 admin admin] The token cache is being invalidate because project 20554630c2374234aa63565c52551d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:11:41.313714 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-79070e6d-f4cb-431d-b359-9552481be2d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:41.314356 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-79070e6d-f4cb-431d-b359-9552481be2d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:41.315951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1122/2269] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:11:41 2022] DELETE /identity/v3/projects/20554630c2374234aa63565c52551d39 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:11:41.320445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79070e6d-f4cb-431d-b359-9552481be2d9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:41.322421 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-79070e6d-f4cb-431d-b359-9552481be2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:41.323709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:41.340812 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55be35f-5334-4e54-8689-92526d0e33d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:41.341516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55be35f-5334-4e54-8689-92526d0e33d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:41.341800 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55be35f-5334-4e54-8689-92526d0e33d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:41.342079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55be35f-5334-4e54-8689-92526d0e33d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:41.342807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55be35f-5334-4e54-8689-92526d0e33d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:41.345991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55be35f-5334-4e54-8689-92526d0e33d5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:41.356151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1148/2270] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:11:41.359945 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55be35f-5334-4e54-8689-92526d0e33d5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:41.361711 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f55be35f-5334-4e54-8689-92526d0e33d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:41.374626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55be35f-5334-4e54-8689-92526d0e33d5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:41.380485 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b04b4-a68a-4751-8005-1a7d80196ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:41.381409 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b04b4-a68a-4751-8005-1a7d80196ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:41.382411 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b04b4-a68a-4751-8005-1a7d80196ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:41.382411 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b04b4-a68a-4751-8005-1a7d80196ac6 admin admin] PATH_INFO: `/v3/projects/edc2913f0ca44359bf4fbf085d4aecfd/users/307f1a7c4e1e43aebfdcb65ed7bd99a0/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:41.396572 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79070e6d-f4cb-431d-b359-9552481be2d9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:41.400220 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b04b4-a68a-4751-8005-1a7d80196ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc2913f0ca44359bf4fbf085d4aecfd, user_id=307f1a7c4e1e43aebfdcb65ed7bd99a0, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:41.402793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250450e-b143-4c81-a8c7-ac93f3390aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:41.403203 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b04b4-a68a-4751-8005-1a7d80196ac6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:41.403729 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250450e-b143-4c81-a8c7-ac93f3390aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:41.404012 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250450e-b143-4c81-a8c7-ac93f3390aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:41.404285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250450e-b143-4c81-a8c7-ac93f3390aab admin admin] PATH_INFO: `/v3/users/4cb5b84fd2bf4dc4b3f22137195768b8` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:41.405651 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250450e-b143-4c81-a8c7-ac93f3390aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb5b84fd2bf4dc4b3f22137195768b8)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:41.410743 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250450e-b143-4c81-a8c7-ac93f3390aab admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:41.424798 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1149/2271] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:41 2022] PUT /identity/v3/projects/edc2913f0ca44359bf4fbf085d4aecfd/users/307f1a7c4e1e43aebfdcb65ed7bd99a0/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:11:41.435319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e4edf-7e2b-4bd0-9966-47bff35a9534 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:41.435734 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e4edf-7e2b-4bd0-9966-47bff35a9534 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:41.435938 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e4edf-7e2b-4bd0-9966-47bff35a9534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:41.464508 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d250450e-b143-4c81-a8c7-ac93f3390aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb5b84fd2bf4dc4b3f22137195768b8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:41.466419 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b99e4edf-7e2b-4bd0-9966-47bff35a9534 None None] MFA Rules not processed for user `307f1a7c4e1e43aebfdcb65ed7bd99a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:41.467637 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b99e4edf-7e2b-4bd0-9966-47bff35a9534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:41.478657 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d250450e-b143-4c81-a8c7-ac93f3390aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb5b84fd2bf4dc4b3f22137195768b8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:41.479341 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d250450e-b143-4c81-a8c7-ac93f3390aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb5b84fd2bf4dc4b3f22137195768b8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:41.479981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d250450e-b143-4c81-a8c7-ac93f3390aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb5b84fd2bf4dc4b3f22137195768b8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:41.489190 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d250450e-b143-4c81-a8c7-ac93f3390aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb5b84fd2bf4dc4b3f22137195768b8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:41.498699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:41.505145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1123/2272] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:11:41 2022] DELETE /identity/v3/users/4cb5b84fd2bf4dc4b3f22137195768b8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:11:41.569094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1150/2273] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:11:41.580187 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250450e-b143-4c81-a8c7-ac93f3390aab admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:41.582310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d250450e-b143-4c81-a8c7-ac93f3390aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:41.643293 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250450e-b143-4c81-a8c7-ac93f3390aab admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:41.648147 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca24f2f-b59f-494b-a031-726cb82c2f85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:41.648791 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca24f2f-b59f-494b-a031-726cb82c2f85 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:41.649068 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca24f2f-b59f-494b-a031-726cb82c2f85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:41.649381 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca24f2f-b59f-494b-a031-726cb82c2f85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:41.711149 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca24f2f-b59f-494b-a031-726cb82c2f85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:41.712676 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca24f2f-b59f-494b-a031-726cb82c2f85 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:41.722091 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1124/2274] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:41.827999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e4edf-7e2b-4bd0-9966-47bff35a9534 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:41.830285 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b99e4edf-7e2b-4bd0-9966-47bff35a9534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:41.913197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e4edf-7e2b-4bd0-9966-47bff35a9534 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:41.980984 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:42.006415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914478f-1050-4d6c-8f9e-33091281cbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:42.007485 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914478f-1050-4d6c-8f9e-33091281cbae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:42.007769 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914478f-1050-4d6c-8f9e-33091281cbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:42.008572 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914478f-1050-4d6c-8f9e-33091281cbae admin admin] PATH_INFO: `/v3/projects/e7b53e7a3ede4f19b0703537f2d771eb` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:42.010635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914478f-1050-4d6c-8f9e-33091281cbae admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7b53e7a3ede4f19b0703537f2d771eb)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:42.012760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914478f-1050-4d6c-8f9e-33091281cbae admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:42.115607 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d914478f-1050-4d6c-8f9e-33091281cbae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7b53e7a3ede4f19b0703537f2d771eb', 'request_id': 'req-d914478f-1050-4d6c-8f9e-33091281cbae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:42.127088 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d914478f-1050-4d6c-8f9e-33091281cbae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7b53e7a3ede4f19b0703537f2d771eb', 'request_id': 'req-d914478f-1050-4d6c-8f9e-33091281cbae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:42.133768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d914478f-1050-4d6c-8f9e-33091281cbae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7b53e7a3ede4f19b0703537f2d771eb', 'request_id': 'req-d914478f-1050-4d6c-8f9e-33091281cbae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:42.149725 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d914478f-1050-4d6c-8f9e-33091281cbae admin admin] The token cache is being invalidate because project e7b53e7a3ede4f19b0703537f2d771eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:11:42.150013 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d914478f-1050-4d6c-8f9e-33091281cbae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:42.150662 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d914478f-1050-4d6c-8f9e-33091281cbae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:42.152551 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1151/2275] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:11:41 2022] DELETE /identity/v3/projects/e7b53e7a3ede4f19b0703537f2d771eb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:42.157626 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcee585-59ce-4894-84bf-96ff4a4cb2f8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:42.157919 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcee585-59ce-4894-84bf-96ff4a4cb2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:42.158200 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcee585-59ce-4894-84bf-96ff4a4cb2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:42.176117 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2fcee585-59ce-4894-84bf-96ff4a4cb2f8 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:42.177385 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2fcee585-59ce-4894-84bf-96ff4a4cb2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:42.241046 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1125/2276] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:42.248924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6a72d-b844-4dd8-bef1-066c4ff3d332 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:42.249224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6a72d-b844-4dd8-bef1-066c4ff3d332 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:42.249528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6a72d-b844-4dd8-bef1-066c4ff3d332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:42.268048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-dad6a72d-b844-4dd8-bef1-066c4ff3d332 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:42.269792 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dad6a72d-b844-4dd8-bef1-066c4ff3d332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:42.277996 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1152/2277] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:42.282240 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcee585-59ce-4894-84bf-96ff4a4cb2f8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:42.292797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcee585-59ce-4894-84bf-96ff4a4cb2f8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:42.297535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94d831-6457-4822-9399-f54d60cc3080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:42.298127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94d831-6457-4822-9399-f54d60cc3080 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:42.298411 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94d831-6457-4822-9399-f54d60cc3080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:42.298691 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94d831-6457-4822-9399-f54d60cc3080 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:42.299420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94d831-6457-4822-9399-f54d60cc3080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:11:42.299726 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94d831-6457-4822-9399-f54d60cc3080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:42.301333 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94d831-6457-4822-9399-f54d60cc3080 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:42.313141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1126/2278] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:11:42.317590 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6a72d-b844-4dd8-bef1-066c4ff3d332 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:42.327499 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6a72d-b844-4dd8-bef1-066c4ff3d332 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:42.332690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c061f05-40ee-4933-856b-597d78af6941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:42.333349 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c061f05-40ee-4933-856b-597d78af6941 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:42.333665 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c061f05-40ee-4933-856b-597d78af6941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:42.333966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c061f05-40ee-4933-856b-597d78af6941 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:42.334708 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c061f05-40ee-4933-856b-597d78af6941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:42.336559 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c061f05-40ee-4933-856b-597d78af6941 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:42.366244 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1153/2279] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:11:42 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:42.367436 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94d831-6457-4822-9399-f54d60cc3080 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:42.377635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94d831-6457-4822-9399-f54d60cc3080 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:42.421096 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:42.440854 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bb1b4-71c7-47dd-b6ea-c13d941dd7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:42.442227 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bb1b4-71c7-47dd-b6ea-c13d941dd7aa admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:42.442381 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bb1b4-71c7-47dd-b6ea-c13d941dd7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:42.442654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bb1b4-71c7-47dd-b6ea-c13d941dd7aa admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:42.443353 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bb1b4-71c7-47dd-b6ea-c13d941dd7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:42.445393 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bb1b4-71c7-47dd-b6ea-c13d941dd7aa admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:42.468145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1127/2280] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:11:42 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:42.472859 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c061f05-40ee-4933-856b-597d78af6941 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:42.483198 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c061f05-40ee-4933-856b-597d78af6941 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:42.487864 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dacf8-c2a6-4cdc-991d-e390f72d8197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:42.489023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dacf8-c2a6-4cdc-991d-e390f72d8197 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:42.489308 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dacf8-c2a6-4cdc-991d-e390f72d8197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:42.489634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dacf8-c2a6-4cdc-991d-e390f72d8197 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:42.490371 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dacf8-c2a6-4cdc-991d-e390f72d8197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:42.491968 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dacf8-c2a6-4cdc-991d-e390f72d8197 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:42.505190 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1154/2281] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:42.514265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bb1b4-71c7-47dd-b6ea-c13d941dd7aa admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:42.526111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bb1b4-71c7-47dd-b6ea-c13d941dd7aa admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:42.531528 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c36eb-e0a6-4b3a-88bf-20fbb54288e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:42.532407 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c36eb-e0a6-4b3a-88bf-20fbb54288e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:42.532824 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c36eb-e0a6-4b3a-88bf-20fbb54288e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:42.533276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c36eb-e0a6-4b3a-88bf-20fbb54288e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:42.534318 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c36eb-e0a6-4b3a-88bf-20fbb54288e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:42.537501 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c36eb-e0a6-4b3a-88bf-20fbb54288e5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:42.556089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1128/2282] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:42.559946 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dacf8-c2a6-4cdc-991d-e390f72d8197 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:42.577097 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dacf8-c2a6-4cdc-991d-e390f72d8197 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:42.583007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41728eb-d87b-426a-9091-9948427dd3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:42.585813 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41728eb-d87b-426a-9091-9948427dd3aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:42.586157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41728eb-d87b-426a-9091-9948427dd3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:42.586623 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41728eb-d87b-426a-9091-9948427dd3aa admin admin] PATH_INFO: `/v3/projects/4c4b4a35f27c438db902d2773ad2fc93/users/e3b2167d283640a0ac1e5653ef55c1ad/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:42.608179 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41728eb-d87b-426a-9091-9948427dd3aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4b4a35f27c438db902d2773ad2fc93, user_id=e3b2167d283640a0ac1e5653ef55c1ad, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:42.612498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41728eb-d87b-426a-9091-9948427dd3aa admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:42.652257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1155/2283] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:42 2022] PUT /identity/v3/projects/4c4b4a35f27c438db902d2773ad2fc93/users/e3b2167d283640a0ac1e5653ef55c1ad/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:42.663321 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432ad4f-ca26-4e8a-86ad-92fd22c6b1ef None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:42.663889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432ad4f-ca26-4e8a-86ad-92fd22c6b1ef None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:42.664279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432ad4f-ca26-4e8a-86ad-92fd22c6b1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:42.710133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b432ad4f-ca26-4e8a-86ad-92fd22c6b1ef None None] MFA Rules not processed for user `e3b2167d283640a0ac1e5653ef55c1ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:42.711721 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b432ad4f-ca26-4e8a-86ad-92fd22c6b1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:42.793329 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1129/2284] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:42.797763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41728eb-d87b-426a-9091-9948427dd3aa admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:42.872214 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41728eb-d87b-426a-9091-9948427dd3aa admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:42.878110 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ff609-6d51-4b7a-af44-88eafc50b791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:42.879129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff609-6d51-4b7a-af44-88eafc50b791 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:42.879517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff609-6d51-4b7a-af44-88eafc50b791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:42.879898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff609-6d51-4b7a-af44-88eafc50b791 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:42.880723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ff609-6d51-4b7a-af44-88eafc50b791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:42.882822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ff609-6d51-4b7a-af44-88eafc50b791 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:42.902876 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d002b-fea3-4392-a628-17f85e5dc866 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:42.903162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d002b-fea3-4392-a628-17f85e5dc866 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:42.903441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d002b-fea3-4392-a628-17f85e5dc866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:42.919299 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1156/2285] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:11:42 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:11:42.923944 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ff609-6d51-4b7a-af44-88eafc50b791 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:42.929320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:42.932480 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d72d002b-fea3-4392-a628-17f85e5dc866 None None] MFA Rules not processed for user `40c6739db5404d59a6799b2ace1c7982`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:42.934614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d72d002b-fea3-4392-a628-17f85e5dc866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:43.028259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ff609-6d51-4b7a-af44-88eafc50b791 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:43.032924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1130/2286] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jun 27 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:11:43.034780 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5881f-6f42-4372-ac10-8e37ccd820cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:43.035664 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5881f-6f42-4372-ac10-8e37ccd820cb admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:43.035999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5881f-6f42-4372-ac10-8e37ccd820cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:43.036905 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5881f-6f42-4372-ac10-8e37ccd820cb admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:43.037328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5881f-6f42-4372-ac10-8e37ccd820cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:43.039886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5881f-6f42-4372-ac10-8e37ccd820cb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:43.043571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d002b-fea3-4392-a628-17f85e5dc866 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:43.045134 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d72d002b-fea3-4392-a628-17f85e5dc866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:43.066654 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1157/2287] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:11:42 2022] POST /identity/v3/users => generated 298 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:43.067763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5881f-6f42-4372-ac10-8e37ccd820cb admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:43.077767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5881f-6f42-4372-ac10-8e37ccd820cb admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:43.084290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79a447-53fb-4604-b700-39de6f9d1fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:43.085271 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79a447-53fb-4604-b700-39de6f9d1fdb admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:43.089862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79a447-53fb-4604-b700-39de6f9d1fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:43.089862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79a447-53fb-4604-b700-39de6f9d1fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:43.090412 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79a447-53fb-4604-b700-39de6f9d1fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:43.092047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79a447-53fb-4604-b700-39de6f9d1fdb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:43.114991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1158/2288] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:11:43.118996 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79a447-53fb-4604-b700-39de6f9d1fdb admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:43.120450 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:43.130851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79a447-53fb-4604-b700-39de6f9d1fdb admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:43.135768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302558b1-050a-4ea5-9a65-c61097fc6fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:43.136768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302558b1-050a-4ea5-9a65-c61097fc6fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:43.137155 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302558b1-050a-4ea5-9a65-c61097fc6fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:43.137572 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302558b1-050a-4ea5-9a65-c61097fc6fc1 admin admin] PATH_INFO: `/v3/projects/4ef3397763244200af31afa905c76737/users/d1715e9322dd472ca231dbfc95f14972/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:43.158608 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302558b1-050a-4ea5-9a65-c61097fc6fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef3397763244200af31afa905c76737, user_id=d1715e9322dd472ca231dbfc95f14972, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:43.162003 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302558b1-050a-4ea5-9a65-c61097fc6fc1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:43.162258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d002b-fea3-4392-a628-17f85e5dc866 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:43.173000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b5661-42fe-4471-b8ce-05ac74e9be03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189af68908944b5e9a7cb35fde0e1bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:43.173859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b5661-42fe-4471-b8ce-05ac74e9be03 service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:43.174306 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b5661-42fe-4471-b8ce-05ac74e9be03 service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:43.174651 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b5661-42fe-4471-b8ce-05ac74e9be03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:43.188358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1159/2289] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:43 2022] PUT /identity/v3/projects/4ef3397763244200af31afa905c76737/users/d1715e9322dd472ca231dbfc95f14972/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:43.192427 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302558b1-050a-4ea5-9a65-c61097fc6fc1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:43.196765 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b5661-42fe-4471-b8ce-05ac74e9be03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:43.198924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b5661-42fe-4471-b8ce-05ac74e9be03 service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:43.223335 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1131/2290] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jun 27 11:11:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 11:11:43.322357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302558b1-050a-4ea5-9a65-c61097fc6fc1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:43.328487 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddfcea-75c5-472d-804c-e6ce4de047df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:43.329226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddfcea-75c5-472d-804c-e6ce4de047df admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:43.329551 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddfcea-75c5-472d-804c-e6ce4de047df admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:43.331088 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddfcea-75c5-472d-804c-e6ce4de047df admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:43.331885 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddfcea-75c5-472d-804c-e6ce4de047df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:43.333596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddfcea-75c5-472d-804c-e6ce4de047df admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:43.348069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1160/2291] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:11:43.352307 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b5661-42fe-4471-b8ce-05ac74e9be03 service swift] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:43.369924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b5661-42fe-4471-b8ce-05ac74e9be03 service swift] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:43.378397 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce33d5-642e-4cb0-b43c-976328f43e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:43.379590 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce33d5-642e-4cb0-b43c-976328f43e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:43.379856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce33d5-642e-4cb0-b43c-976328f43e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:43.380200 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce33d5-642e-4cb0-b43c-976328f43e5d admin admin] PATH_INFO: `/v3/projects/4ef3397763244200af31afa905c76737/users/d1715e9322dd472ca231dbfc95f14972/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:43.385736 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce33d5-642e-4cb0-b43c-976328f43e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef3397763244200af31afa905c76737, user_id=d1715e9322dd472ca231dbfc95f14972, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:43.392457 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce33d5-642e-4cb0-b43c-976328f43e5d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:43.435666 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1132/2292] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:43 2022] PUT /identity/v3/projects/4ef3397763244200af31afa905c76737/users/d1715e9322dd472ca231dbfc95f14972/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:43.449344 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bcb01-7ec6-4a43-8039-b726a63a99f5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:43.449840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bcb01-7ec6-4a43-8039-b726a63a99f5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:43.450211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bcb01-7ec6-4a43-8039-b726a63a99f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:43.497952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d72bcb01-7ec6-4a43-8039-b726a63a99f5 None None] MFA Rules not processed for user `d1715e9322dd472ca231dbfc95f14972`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:43.499337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d72bcb01-7ec6-4a43-8039-b726a63a99f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:43.545638 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:43.576079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1161/2293] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:43.588056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce33d5-642e-4cb0-b43c-976328f43e5d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:43.589926 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3fce33d5-642e-4cb0-b43c-976328f43e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:43.654197 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce33d5-642e-4cb0-b43c-976328f43e5d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:43.658463 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d6212-bed0-438f-80af-30f2cfacc740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:43.659122 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d6212-bed0-438f-80af-30f2cfacc740 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:43.659589 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d6212-bed0-438f-80af-30f2cfacc740 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:43.660705 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d6212-bed0-438f-80af-30f2cfacc740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:43.670748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d6212-bed0-438f-80af-30f2cfacc740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:43.672283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d6212-bed0-438f-80af-30f2cfacc740 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:43.684161 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1133/2294] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:43.788242 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bcb01-7ec6-4a43-8039-b726a63a99f5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:43.798302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bcb01-7ec6-4a43-8039-b726a63a99f5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:43.802067 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe602a9-9dad-4681-aeb7-cc20df2d0eaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:43.802721 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe602a9-9dad-4681-aeb7-cc20df2d0eaa service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:43.803007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe602a9-9dad-4681-aeb7-cc20df2d0eaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:43.803280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe602a9-9dad-4681-aeb7-cc20df2d0eaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:43.870986 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe602a9-9dad-4681-aeb7-cc20df2d0eaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:43.872631 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe602a9-9dad-4681-aeb7-cc20df2d0eaa service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:43.883802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1162/2295] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:53.679924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:53.878632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=38 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:56.951396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d6212-bed0-438f-80af-30f2cfacc740 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:57.059879 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d6212-bed0-438f-80af-30f2cfacc740 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:57.064463 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d7ec8-20b2-4738-b39a-00d75a394135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:57.065324 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d7ec8-20b2-4738-b39a-00d75a394135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:57.065635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d7ec8-20b2-4738-b39a-00d75a394135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:57.065907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d7ec8-20b2-4738-b39a-00d75a394135 admin admin] PATH_INFO: `/v3/users/e3b2167d283640a0ac1e5653ef55c1ad` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:57.067101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d7ec8-20b2-4738-b39a-00d75a394135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b2167d283640a0ac1e5653ef55c1ad)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:57.069611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d7ec8-20b2-4738-b39a-00d75a394135 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:57.140604 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-733d7ec8-20b2-4738-b39a-00d75a394135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b2167d283640a0ac1e5653ef55c1ad'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:57.163667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-733d7ec8-20b2-4738-b39a-00d75a394135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b2167d283640a0ac1e5653ef55c1ad'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:57.164560 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-733d7ec8-20b2-4738-b39a-00d75a394135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b2167d283640a0ac1e5653ef55c1ad'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:57.165355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-733d7ec8-20b2-4738-b39a-00d75a394135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b2167d283640a0ac1e5653ef55c1ad'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:57.176645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-733d7ec8-20b2-4738-b39a-00d75a394135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b2167d283640a0ac1e5653ef55c1ad'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:57.209850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1134/2296] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:11:56 2022] DELETE /identity/v3/users/e3b2167d283640a0ac1e5653ef55c1ad => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:57.219150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817d5ba-5969-4f87-b5c7-23ea62125f2b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:57.219150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817d5ba-5969-4f87-b5c7-23ea62125f2b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:57.219150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817d5ba-5969-4f87-b5c7-23ea62125f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:57.279783 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6817d5ba-5969-4f87-b5c7-23ea62125f2b None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:57.281569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6817d5ba-5969-4f87-b5c7-23ea62125f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:57.362405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1163/2297] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:57.372398 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d7ec8-20b2-4738-b39a-00d75a394135 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:57.373838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-733d7ec8-20b2-4738-b39a-00d75a394135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:57.418197 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:57.476360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d7ec8-20b2-4738-b39a-00d75a394135 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:57.479969 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584b375-581d-4a8f-8271-a1d2bd466f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:57.480607 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584b375-581d-4a8f-8271-a1d2bd466f82 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:57.480885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584b375-581d-4a8f-8271-a1d2bd466f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:57.481153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584b375-581d-4a8f-8271-a1d2bd466f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:57.490783 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584b375-581d-4a8f-8271-a1d2bd466f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:57.492191 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584b375-581d-4a8f-8271-a1d2bd466f82 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:57.501532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1135/2298] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:57.775802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817d5ba-5969-4f87-b5c7-23ea62125f2b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:57.777204 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6817d5ba-5969-4f87-b5c7-23ea62125f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:57.789702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817d5ba-5969-4f87-b5c7-23ea62125f2b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:57.794606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f17b2d-ad5e-4e6d-bdde-064506ee8668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:57.795463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f17b2d-ad5e-4e6d-bdde-064506ee8668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:57.795745 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f17b2d-ad5e-4e6d-bdde-064506ee8668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:57.796024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f17b2d-ad5e-4e6d-bdde-064506ee8668 admin admin] PATH_INFO: `/v3/projects/4c4b4a35f27c438db902d2773ad2fc93` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:57.797217 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f17b2d-ad5e-4e6d-bdde-064506ee8668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4b4a35f27c438db902d2773ad2fc93)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:57.799191 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f17b2d-ad5e-4e6d-bdde-064506ee8668 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:57.848588 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-08f17b2d-ad5e-4e6d-bdde-064506ee8668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4b4a35f27c438db902d2773ad2fc93', 'request_id': 'req-08f17b2d-ad5e-4e6d-bdde-064506ee8668'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:57.856761 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-08f17b2d-ad5e-4e6d-bdde-064506ee8668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4b4a35f27c438db902d2773ad2fc93', 'request_id': 'req-08f17b2d-ad5e-4e6d-bdde-064506ee8668'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:57.862869 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-08f17b2d-ad5e-4e6d-bdde-064506ee8668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4b4a35f27c438db902d2773ad2fc93', 'request_id': 'req-08f17b2d-ad5e-4e6d-bdde-064506ee8668'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:57.873878 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-08f17b2d-ad5e-4e6d-bdde-064506ee8668 admin admin] The token cache is being invalidate because project 4c4b4a35f27c438db902d2773ad2fc93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:11:57.874168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-08f17b2d-ad5e-4e6d-bdde-064506ee8668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:57.874809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-08f17b2d-ad5e-4e6d-bdde-064506ee8668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:57.876354 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1164/2299] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:11:57 2022] DELETE /identity/v3/projects/4c4b4a35f27c438db902d2773ad2fc93 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:57.880274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584b375-581d-4a8f-8271-a1d2bd466f82 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:57.890105 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584b375-581d-4a8f-8271-a1d2bd466f82 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:57.948891 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82180009-9be8-4892-a00c-c43f694c1a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:57.949798 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82180009-9be8-4892-a00c-c43f694c1a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:57.950083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82180009-9be8-4892-a00c-c43f694c1a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:57.950366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82180009-9be8-4892-a00c-c43f694c1a7c admin admin] PATH_INFO: `/v3/users/d1715e9322dd472ca231dbfc95f14972` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:57.951641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82180009-9be8-4892-a00c-c43f694c1a7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1715e9322dd472ca231dbfc95f14972)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:57.953654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82180009-9be8-4892-a00c-c43f694c1a7c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:58.001864 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-82180009-9be8-4892-a00c-c43f694c1a7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1715e9322dd472ca231dbfc95f14972'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:58.014009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-82180009-9be8-4892-a00c-c43f694c1a7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1715e9322dd472ca231dbfc95f14972'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:58.014698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-82180009-9be8-4892-a00c-c43f694c1a7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1715e9322dd472ca231dbfc95f14972'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:58.015310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-82180009-9be8-4892-a00c-c43f694c1a7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1715e9322dd472ca231dbfc95f14972'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:58.022586 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-82180009-9be8-4892-a00c-c43f694c1a7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1715e9322dd472ca231dbfc95f14972'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:58.035215 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1136/2300] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:11:57 2022] DELETE /identity/v3/users/d1715e9322dd472ca231dbfc95f14972 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:58.389270 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f17b2d-ad5e-4e6d-bdde-064506ee8668 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:58.390827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-08f17b2d-ad5e-4e6d-bdde-064506ee8668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:58.404349 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f17b2d-ad5e-4e6d-bdde-064506ee8668 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:58.472831 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:58.489197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0c01a-cbe9-46fe-b20d-0ed2ff57549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:58.490193 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0c01a-cbe9-46fe-b20d-0ed2ff57549d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:58.490538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0c01a-cbe9-46fe-b20d-0ed2ff57549d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:58.490965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0c01a-cbe9-46fe-b20d-0ed2ff57549d admin admin] PATH_INFO: `/v3/projects/4ef3397763244200af31afa905c76737` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:58.492870 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0c01a-cbe9-46fe-b20d-0ed2ff57549d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef3397763244200af31afa905c76737)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:58.494947 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0c01a-cbe9-46fe-b20d-0ed2ff57549d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:58.559317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-79b0c01a-cbe9-46fe-b20d-0ed2ff57549d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef3397763244200af31afa905c76737', 'request_id': 'req-79b0c01a-cbe9-46fe-b20d-0ed2ff57549d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:58.568030 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-79b0c01a-cbe9-46fe-b20d-0ed2ff57549d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef3397763244200af31afa905c76737', 'request_id': 'req-79b0c01a-cbe9-46fe-b20d-0ed2ff57549d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:58.574374 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-79b0c01a-cbe9-46fe-b20d-0ed2ff57549d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef3397763244200af31afa905c76737', 'request_id': 'req-79b0c01a-cbe9-46fe-b20d-0ed2ff57549d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:58.586594 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-79b0c01a-cbe9-46fe-b20d-0ed2ff57549d admin admin] The token cache is being invalidate because project 4ef3397763244200af31afa905c76737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:11:58.586888 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-79b0c01a-cbe9-46fe-b20d-0ed2ff57549d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:58.587540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-79b0c01a-cbe9-46fe-b20d-0ed2ff57549d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:58.589303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1165/2301] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:11:58 2022] DELETE /identity/v3/projects/4ef3397763244200af31afa905c76737 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:58.594628 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab843cac-5def-408c-a97e-83eb8395e33c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:58.594921 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab843cac-5def-408c-a97e-83eb8395e33c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:58.595202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab843cac-5def-408c-a97e-83eb8395e33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:58.633258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ab843cac-5def-408c-a97e-83eb8395e33c None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:58.634595 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ab843cac-5def-408c-a97e-83eb8395e33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:58.638871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:58.706681 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1137/2302] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:58.715187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bdaac-513c-4644-8747-8c7ea40d4f94 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:58.715486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bdaac-513c-4644-8747-8c7ea40d4f94 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:58.715770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bdaac-513c-4644-8747-8c7ea40d4f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:58.734848 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a68bdaac-513c-4644-8747-8c7ea40d4f94 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:58.736050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a68bdaac-513c-4644-8747-8c7ea40d4f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:58.744193 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1166/2303] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:58.748560 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab843cac-5def-408c-a97e-83eb8395e33c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:58.758227 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab843cac-5def-408c-a97e-83eb8395e33c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:58.762672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f6e5d-18be-4e4b-956e-1d194236f0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:58.763312 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f6e5d-18be-4e4b-956e-1d194236f0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:58.763594 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f6e5d-18be-4e4b-956e-1d194236f0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:58.763870 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f6e5d-18be-4e4b-956e-1d194236f0f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:58.764585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f6e5d-18be-4e4b-956e-1d194236f0f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:11:58.764888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f6e5d-18be-4e4b-956e-1d194236f0f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:58.766499 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f6e5d-18be-4e4b-956e-1d194236f0f2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:58.778489 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1138/2304] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:11:58.782741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bdaac-513c-4644-8747-8c7ea40d4f94 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:58.792614 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bdaac-513c-4644-8747-8c7ea40d4f94 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:58.797236 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9d664-e678-4d10-934e-b0411b3d59b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:58.797905 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9d664-e678-4d10-934e-b0411b3d59b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:58.798188 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9d664-e678-4d10-934e-b0411b3d59b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:58.798462 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9d664-e678-4d10-934e-b0411b3d59b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:58.799151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9d664-e678-4d10-934e-b0411b3d59b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:58.801037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9d664-e678-4d10-934e-b0411b3d59b7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:58.826530 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1167/2305] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:11:58 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:58.830714 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f6e5d-18be-4e4b-956e-1d194236f0f2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:58.841421 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f6e5d-18be-4e4b-956e-1d194236f0f2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:58.895096 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066ac0e-f4da-4bd5-8ef0-d87008eeb7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:58.895747 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066ac0e-f4da-4bd5-8ef0-d87008eeb7fb admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:58.896568 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066ac0e-f4da-4bd5-8ef0-d87008eeb7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:58.896842 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066ac0e-f4da-4bd5-8ef0-d87008eeb7fb admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:58.897560 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066ac0e-f4da-4bd5-8ef0-d87008eeb7fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:58.899456 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066ac0e-f4da-4bd5-8ef0-d87008eeb7fb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:58.918414 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1139/2306] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:11:58 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:11:58.922549 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9d664-e678-4d10-934e-b0411b3d59b7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:58.932909 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9d664-e678-4d10-934e-b0411b3d59b7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:58.937650 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304506d-3f89-4019-973a-3c4b6acd4de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:58.938301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304506d-3f89-4019-973a-3c4b6acd4de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:58.938586 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304506d-3f89-4019-973a-3c4b6acd4de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:58.938861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304506d-3f89-4019-973a-3c4b6acd4de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:58.939581 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304506d-3f89-4019-973a-3c4b6acd4de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:58.941174 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304506d-3f89-4019-973a-3c4b6acd4de1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:58.952930 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1168/2307] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:58.956692 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066ac0e-f4da-4bd5-8ef0-d87008eeb7fb admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:58.967624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066ac0e-f4da-4bd5-8ef0-d87008eeb7fb admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:58.972258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc746e5-dfad-4cd9-a220-f8d9424c3f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:58.972911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc746e5-dfad-4cd9-a220-f8d9424c3f14 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:58.973193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc746e5-dfad-4cd9-a220-f8d9424c3f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:58.973539 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc746e5-dfad-4cd9-a220-f8d9424c3f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:58.974296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc746e5-dfad-4cd9-a220-f8d9424c3f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:58.975883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc746e5-dfad-4cd9-a220-f8d9424c3f14 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:58.988824 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1140/2308] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:11:58.990021 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304506d-3f89-4019-973a-3c4b6acd4de1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:59.000458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304506d-3f89-4019-973a-3c4b6acd4de1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:59.006077 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290e59b-f235-4037-8254-0cac78b1da2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:59.006961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290e59b-f235-4037-8254-0cac78b1da2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:59.007238 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290e59b-f235-4037-8254-0cac78b1da2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:59.007514 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290e59b-f235-4037-8254-0cac78b1da2c admin admin] PATH_INFO: `/v3/projects/676e35d5d83046d6be0f66fa0cda4dcd/users/4293ae470c1940b39114e3f6e3bc20cc/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:59.023836 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290e59b-f235-4037-8254-0cac78b1da2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=676e35d5d83046d6be0f66fa0cda4dcd, user_id=4293ae470c1940b39114e3f6e3bc20cc, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:59.035318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290e59b-f235-4037-8254-0cac78b1da2c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:59.059185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1169/2309] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:11:58 2022] PUT /identity/v3/projects/676e35d5d83046d6be0f66fa0cda4dcd/users/4293ae470c1940b39114e3f6e3bc20cc/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:59.077318 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb9f35-03b0-43dd-ac4a-e156ca925cd3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:59.077883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb9f35-03b0-43dd-ac4a-e156ca925cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:59.078379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb9f35-03b0-43dd-ac4a-e156ca925cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:59.121857 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8ddb9f35-03b0-43dd-ac4a-e156ca925cd3 None None] MFA Rules not processed for user `4293ae470c1940b39114e3f6e3bc20cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:59.123331 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8ddb9f35-03b0-43dd-ac4a-e156ca925cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:59.206587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1141/2310] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:59.222070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290e59b-f235-4037-8254-0cac78b1da2c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:59.223842 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c290e59b-f235-4037-8254-0cac78b1da2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:59.296295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290e59b-f235-4037-8254-0cac78b1da2c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:59.300010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2066d-4728-4fbb-8653-4b089c007394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:59.300654 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2066d-4728-4fbb-8653-4b089c007394 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:59.300940 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2066d-4728-4fbb-8653-4b089c007394 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:59.301216 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2066d-4728-4fbb-8653-4b089c007394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:59.309972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2066d-4728-4fbb-8653-4b089c007394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:59.311402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2066d-4728-4fbb-8653-4b089c007394 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:59.320752 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1170/2311] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:11:59.339436 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb9f35-03b0-43dd-ac4a-e156ca925cd3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:59.345041 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:59.403829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb9f35-03b0-43dd-ac4a-e156ca925cd3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:59.408777 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fc308-c8d1-4c55-9581-9ea7d87d8093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:59.409668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fc308-c8d1-4c55-9581-9ea7d87d8093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:59.409946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fc308-c8d1-4c55-9581-9ea7d87d8093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:59.410260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fc308-c8d1-4c55-9581-9ea7d87d8093 admin admin] PATH_INFO: `/v3/users/4293ae470c1940b39114e3f6e3bc20cc` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:59.411399 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fc308-c8d1-4c55-9581-9ea7d87d8093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4293ae470c1940b39114e3f6e3bc20cc)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:59.413313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fc308-c8d1-4c55-9581-9ea7d87d8093 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:59.464569 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8d7fc308-c8d1-4c55-9581-9ea7d87d8093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4293ae470c1940b39114e3f6e3bc20cc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:59.477214 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8d7fc308-c8d1-4c55-9581-9ea7d87d8093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4293ae470c1940b39114e3f6e3bc20cc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:59.478419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8d7fc308-c8d1-4c55-9581-9ea7d87d8093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4293ae470c1940b39114e3f6e3bc20cc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:59.479032 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8d7fc308-c8d1-4c55-9581-9ea7d87d8093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4293ae470c1940b39114e3f6e3bc20cc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:59.486261 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8d7fc308-c8d1-4c55-9581-9ea7d87d8093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4293ae470c1940b39114e3f6e3bc20cc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:11:59.499274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1142/2312] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:11:59 2022] DELETE /identity/v3/users/4293ae470c1940b39114e3f6e3bc20cc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:11:59.504236 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b7bd-e6c0-44e1-b0a6-5480dc8bb38e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:59.504765 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b7bd-e6c0-44e1-b0a6-5480dc8bb38e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:59.504865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b7bd-e6c0-44e1-b0a6-5480dc8bb38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:59.522987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cd08b7bd-e6c0-44e1-b0a6-5480dc8bb38e None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:11:59.524569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cd08b7bd-e6c0-44e1-b0a6-5480dc8bb38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:59.546896 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:11:59.592462 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1171/2313] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:11:59.602556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fc308-c8d1-4c55-9581-9ea7d87d8093 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:11:59.603955 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8d7fc308-c8d1-4c55-9581-9ea7d87d8093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:11:59.659741 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fc308-c8d1-4c55-9581-9ea7d87d8093 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:11:59.663943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7ebc5-95cd-4feb-abd0-93148865e6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:11:59.664665 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7ebc5-95cd-4feb-abd0-93148865e6ca service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:11:59.664944 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7ebc5-95cd-4feb-abd0-93148865e6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:11:59.665532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7ebc5-95cd-4feb-abd0-93148865e6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:11:59.674406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7ebc5-95cd-4feb-abd0-93148865e6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:11:59.675826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7ebc5-95cd-4feb-abd0-93148865e6ca service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:11:59.686399 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1143/2314] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:12:00.014368 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08b7bd-e6c0-44e1-b0a6-5480dc8bb38e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:00.015998 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cd08b7bd-e6c0-44e1-b0a6-5480dc8bb38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:00.028980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08b7bd-e6c0-44e1-b0a6-5480dc8bb38e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:00.033783 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bfd71-c34d-494e-b447-8f2e80554f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:00.034673 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bfd71-c34d-494e-b447-8f2e80554f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:00.034996 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bfd71-c34d-494e-b447-8f2e80554f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:00.035421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bfd71-c34d-494e-b447-8f2e80554f8b admin admin] PATH_INFO: `/v3/projects/676e35d5d83046d6be0f66fa0cda4dcd` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:00.037967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bfd71-c34d-494e-b447-8f2e80554f8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=676e35d5d83046d6be0f66fa0cda4dcd)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:00.040535 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bfd71-c34d-494e-b447-8f2e80554f8b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:00.096851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9e0bfd71-c34d-494e-b447-8f2e80554f8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '676e35d5d83046d6be0f66fa0cda4dcd', 'request_id': 'req-9e0bfd71-c34d-494e-b447-8f2e80554f8b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:00.106741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9e0bfd71-c34d-494e-b447-8f2e80554f8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '676e35d5d83046d6be0f66fa0cda4dcd', 'request_id': 'req-9e0bfd71-c34d-494e-b447-8f2e80554f8b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:00.114352 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9e0bfd71-c34d-494e-b447-8f2e80554f8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '676e35d5d83046d6be0f66fa0cda4dcd', 'request_id': 'req-9e0bfd71-c34d-494e-b447-8f2e80554f8b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:00.127499 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9e0bfd71-c34d-494e-b447-8f2e80554f8b admin admin] The token cache is being invalidate because project 676e35d5d83046d6be0f66fa0cda4dcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:12:00.128040 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9e0bfd71-c34d-494e-b447-8f2e80554f8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:00.128781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9e0bfd71-c34d-494e-b447-8f2e80554f8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:00.133969 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1172/2315] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:12:00 2022] DELETE /identity/v3/projects/676e35d5d83046d6be0f66fa0cda4dcd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:12:00.135704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832caccb-55a9-4b8a-a474-a09be40551cb None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:00.136260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832caccb-55a9-4b8a-a474-a09be40551cb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:00.136260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832caccb-55a9-4b8a-a474-a09be40551cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:00.161082 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-832caccb-55a9-4b8a-a474-a09be40551cb None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:12:00.163374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-832caccb-55a9-4b8a-a474-a09be40551cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:00.196749 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:12:00.255749 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1144/2316] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:12:00.257483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c231e16-4432-4f83-8a8f-ee13fb6bf7b9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:00.257777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c231e16-4432-4f83-8a8f-ee13fb6bf7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:00.258053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c231e16-4432-4f83-8a8f-ee13fb6bf7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:00.277027 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8c231e16-4432-4f83-8a8f-ee13fb6bf7b9 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:12:00.278363 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8c231e16-4432-4f83-8a8f-ee13fb6bf7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:00.287727 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1173/2317] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:12:00.295699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832caccb-55a9-4b8a-a474-a09be40551cb None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:00.306114 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832caccb-55a9-4b8a-a474-a09be40551cb None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:00.310910 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521a278-e9ef-465e-a318-4c52a4d1bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:00.311562 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521a278-e9ef-465e-a318-4c52a4d1bd5c admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:00.311843 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521a278-e9ef-465e-a318-4c52a4d1bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:00.312114 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521a278-e9ef-465e-a318-4c52a4d1bd5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:00.312838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521a278-e9ef-465e-a318-4c52a4d1bd5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:12:00.313136 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521a278-e9ef-465e-a318-4c52a4d1bd5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:00.314768 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521a278-e9ef-465e-a318-4c52a4d1bd5c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:00.328687 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1145/2318] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:12:00.332628 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c231e16-4432-4f83-8a8f-ee13fb6bf7b9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:00.342754 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c231e16-4432-4f83-8a8f-ee13fb6bf7b9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:00.347486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83462a-a159-4bee-9d73-19f832c827be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:00.348150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83462a-a159-4bee-9d73-19f832c827be admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:00.348439 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83462a-a159-4bee-9d73-19f832c827be admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:00.348718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83462a-a159-4bee-9d73-19f832c827be admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:00.350858 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83462a-a159-4bee-9d73-19f832c827be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:00.352458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83462a-a159-4bee-9d73-19f832c827be admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:00.379665 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1174/2319] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:12:00 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:12:00.383903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521a278-e9ef-465e-a318-4c52a4d1bd5c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:00.394034 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521a278-e9ef-465e-a318-4c52a4d1bd5c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:00.447798 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e34428-1422-4dab-b3eb-5b0e9764ff60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:00.448452 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e34428-1422-4dab-b3eb-5b0e9764ff60 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:00.448730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e34428-1422-4dab-b3eb-5b0e9764ff60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:00.449002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e34428-1422-4dab-b3eb-5b0e9764ff60 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:00.449706 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e34428-1422-4dab-b3eb-5b0e9764ff60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:00.451593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e34428-1422-4dab-b3eb-5b0e9764ff60 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:00.470286 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1146/2320] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:12:00 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:12:00.474853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83462a-a159-4bee-9d73-19f832c827be admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:00.485007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83462a-a159-4bee-9d73-19f832c827be admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:00.489624 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9deac6-a440-4256-9358-42798283ee53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:00.490870 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9deac6-a440-4256-9358-42798283ee53 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:00.491152 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9deac6-a440-4256-9358-42798283ee53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:00.491426 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9deac6-a440-4256-9358-42798283ee53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:00.492146 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9deac6-a440-4256-9358-42798283ee53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:00.493778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9deac6-a440-4256-9358-42798283ee53 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:00.504102 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1175/2321] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:12:00.507817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e34428-1422-4dab-b3eb-5b0e9764ff60 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:00.517738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e34428-1422-4dab-b3eb-5b0e9764ff60 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:00.522351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da12cb-b39c-4219-99e2-45d2d05a1b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:00.522995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da12cb-b39c-4219-99e2-45d2d05a1b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:00.523278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da12cb-b39c-4219-99e2-45d2d05a1b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:00.523555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da12cb-b39c-4219-99e2-45d2d05a1b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:00.524268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da12cb-b39c-4219-99e2-45d2d05a1b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:00.525884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da12cb-b39c-4219-99e2-45d2d05a1b2b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:00.535602 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1147/2322] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:12:00.539956 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9deac6-a440-4256-9358-42798283ee53 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:00.549899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9deac6-a440-4256-9358-42798283ee53 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:00.555133 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08fc17-6f41-42f2-9ee4-5b9ab9727485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:00.555993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08fc17-6f41-42f2-9ee4-5b9ab9727485 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:00.556271 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08fc17-6f41-42f2-9ee4-5b9ab9727485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:00.556547 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08fc17-6f41-42f2-9ee4-5b9ab9727485 admin admin] PATH_INFO: `/v3/projects/f6cc6859c7a04965b555861e378c3d81/users/d23530d4cc2c4d50a35575f078c23c0a/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:00.592516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08fc17-6f41-42f2-9ee4-5b9ab9727485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6cc6859c7a04965b555861e378c3d81, user_id=d23530d4cc2c4d50a35575f078c23c0a, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:00.599859 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08fc17-6f41-42f2-9ee4-5b9ab9727485 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:00.645774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1176/2323] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:12:00 2022] PUT /identity/v3/projects/f6cc6859c7a04965b555861e378c3d81/users/d23530d4cc2c4d50a35575f078c23c0a/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:12:00.655724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118fdee-71f7-4a4f-8f94-1c9f40c69700 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:00.656069 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118fdee-71f7-4a4f-8f94-1c9f40c69700 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:00.656341 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118fdee-71f7-4a4f-8f94-1c9f40c69700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:00.711190 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4118fdee-71f7-4a4f-8f94-1c9f40c69700 None None] MFA Rules not processed for user `d23530d4cc2c4d50a35575f078c23c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:12:00.712480 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4118fdee-71f7-4a4f-8f94-1c9f40c69700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:00.778626 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1148/2324] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:12:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:12:00.789145 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08fc17-6f41-42f2-9ee4-5b9ab9727485 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:00.790881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4e08fc17-6f41-42f2-9ee4-5b9ab9727485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:00.840700 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:12:00.846830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08fc17-6f41-42f2-9ee4-5b9ab9727485 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:00.851197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff1c43-54f1-418d-baff-4c3997aebca4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b6436fdd7a4977a2e02c0e1b8be2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:00.851765 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff1c43-54f1-418d-baff-4c3997aebca4 service glance] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:00.852044 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff1c43-54f1-418d-baff-4c3997aebca4 service glance] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:00.852315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff1c43-54f1-418d-baff-4c3997aebca4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:00.860756 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff1c43-54f1-418d-baff-4c3997aebca4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:00.862201 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff1c43-54f1-418d-baff-4c3997aebca4 service glance] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:00.873491 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1177/2325] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:12:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:12:09.648160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118fdee-71f7-4a4f-8f94-1c9f40c69700 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:09.650230 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4118fdee-71f7-4a4f-8f94-1c9f40c69700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:09.685068 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:12:09.730727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118fdee-71f7-4a4f-8f94-1c9f40c69700 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:09.735191 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cdcd9-b0d5-40b0-987d-b7ef8246190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:09.736082 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cdcd9-b0d5-40b0-987d-b7ef8246190a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:09.736362 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cdcd9-b0d5-40b0-987d-b7ef8246190a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:09.736636 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cdcd9-b0d5-40b0-987d-b7ef8246190a admin admin] PATH_INFO: `/v3/users/307f1a7c4e1e43aebfdcb65ed7bd99a0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:09.738154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669cdcd9-b0d5-40b0-987d-b7ef8246190a admin admin] RBAC: Authorizing `identity:delete_user(user_id=307f1a7c4e1e43aebfdcb65ed7bd99a0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:09.740429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669cdcd9-b0d5-40b0-987d-b7ef8246190a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:09.798779 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-669cdcd9-b0d5-40b0-987d-b7ef8246190a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '307f1a7c4e1e43aebfdcb65ed7bd99a0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:09.810548 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-669cdcd9-b0d5-40b0-987d-b7ef8246190a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '307f1a7c4e1e43aebfdcb65ed7bd99a0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:09.811248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-669cdcd9-b0d5-40b0-987d-b7ef8246190a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '307f1a7c4e1e43aebfdcb65ed7bd99a0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:09.811853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-669cdcd9-b0d5-40b0-987d-b7ef8246190a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '307f1a7c4e1e43aebfdcb65ed7bd99a0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:09.819594 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-669cdcd9-b0d5-40b0-987d-b7ef8246190a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '307f1a7c4e1e43aebfdcb65ed7bd99a0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:09.839076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1149/2326] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:12:09 2022] DELETE /identity/v3/users/307f1a7c4e1e43aebfdcb65ed7bd99a0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:12:09.843464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6351593-05da-4995-9b5a-85a445d729d3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:09.843974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6351593-05da-4995-9b5a-85a445d729d3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:09.844075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6351593-05da-4995-9b5a-85a445d729d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:09.862419 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a6351593-05da-4995-9b5a-85a445d729d3 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:12:09.863673 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a6351593-05da-4995-9b5a-85a445d729d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:09.930630 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1178/2327] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:12:09.940021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cdcd9-b0d5-40b0-987d-b7ef8246190a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:09.941567 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-669cdcd9-b0d5-40b0-987d-b7ef8246190a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:10.012896 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cdcd9-b0d5-40b0-987d-b7ef8246190a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:10.016728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c788c0e-3984-4a71-b4e9-bc4fbdef88f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:10.017659 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c788c0e-3984-4a71-b4e9-bc4fbdef88f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:10.017940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c788c0e-3984-4a71-b4e9-bc4fbdef88f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:10.018213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c788c0e-3984-4a71-b4e9-bc4fbdef88f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:10.028416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c788c0e-3984-4a71-b4e9-bc4fbdef88f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:10.029984 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c788c0e-3984-4a71-b4e9-bc4fbdef88f7 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:10.043704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1150/2328] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:12:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:12:10.359005 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6351593-05da-4995-9b5a-85a445d729d3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:10.360461 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a6351593-05da-4995-9b5a-85a445d729d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:10.373374 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6351593-05da-4995-9b5a-85a445d729d3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:10.377889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:10.378747 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:10.379024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:10.379298 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8 admin admin] PATH_INFO: `/v3/projects/edc2913f0ca44359bf4fbf085d4aecfd` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:10.380686 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edc2913f0ca44359bf4fbf085d4aecfd)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:10.382747 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:10.434934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc2913f0ca44359bf4fbf085d4aecfd', 'request_id': 'req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:10.442960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc2913f0ca44359bf4fbf085d4aecfd', 'request_id': 'req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:10.453475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc2913f0ca44359bf4fbf085d4aecfd', 'request_id': 'req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:10.466334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8 admin admin] The token cache is being invalidate because project edc2913f0ca44359bf4fbf085d4aecfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:12:10.466630 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:10.467293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:10.468930 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1179/2329] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:12:10 2022] DELETE /identity/v3/projects/edc2913f0ca44359bf4fbf085d4aecfd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:12:20.035814 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=69,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:12:20.082647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c788c0e-3984-4a71-b4e9-bc4fbdef88f7 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:20.091330 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c788c0e-3984-4a71-b4e9-bc4fbdef88f7 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:20.138600 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faad53-268c-4bc8-9cd5-a663a1261592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:20.139234 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faad53-268c-4bc8-9cd5-a663a1261592 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:20.139513 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faad53-268c-4bc8-9cd5-a663a1261592 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:20.139789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faad53-268c-4bc8-9cd5-a663a1261592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:20.141587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-06faad53-268c-4bc8-9cd5-a663a1261592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:20.206250 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faad53-268c-4bc8-9cd5-a663a1261592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:20.207700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faad53-268c-4bc8-9cd5-a663a1261592 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:20.218084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1151/2330] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:12:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:12:20.462697 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=59,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:12:23.348909 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:23.350346 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:23.467402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bcdf8-8cf1-4f83-9351-0ab0ee9f05f8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:23.473253 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928e329-c83f-453f-8ba5-39e712fc8c7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8673c91abf14c0b9a237f0499fdf20e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:23.473940 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e329-c83f-453f-8ba5-39e712fc8c7c service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:23.474229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e329-c83f-453f-8ba5-39e712fc8c7c service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:23.474576 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e329-c83f-453f-8ba5-39e712fc8c7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:23.476611 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7928e329-c83f-453f-8ba5-39e712fc8c7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:23.489672 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928e329-c83f-453f-8ba5-39e712fc8c7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:23.491916 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928e329-c83f-453f-8ba5-39e712fc8c7c service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:23.507667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1180/2331] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:12:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:12:24.299705 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69b8f0-f19b-4ea6-bcc5-2a63f7cb4e02 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:24.300198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69b8f0-f19b-4ea6-bcc5-2a63f7cb4e02 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:24.300291 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69b8f0-f19b-4ea6-bcc5-2a63f7cb4e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:24.316968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8d69b8f0-f19b-4ea6-bcc5-2a63f7cb4e02 None None] MFA Rules not processed for user `38dde6fe09ca4266af31f3e1bc19e18c`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:12:24.318709 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8d69b8f0-f19b-4ea6-bcc5-2a63f7cb4e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:24.383009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1152/2332] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:12:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:12:29.159905 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928e329-c83f-453f-8ba5-39e712fc8c7c service placement] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:29.161350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7928e329-c83f-453f-8ba5-39e712fc8c7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:29.224782 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928e329-c83f-453f-8ba5-39e712fc8c7c service placement] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:29.229263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ef27-6258-4993-9f4a-b85cd4984a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:29.230144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ef27-6258-4993-9f4a-b85cd4984a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:29.230424 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ef27-6258-4993-9f4a-b85cd4984a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:29.230696 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ef27-6258-4993-9f4a-b85cd4984a94 admin admin] PATH_INFO: `/v3/users/d23530d4cc2c4d50a35575f078c23c0a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:29.231892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953ef27-6258-4993-9f4a-b85cd4984a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23530d4cc2c4d50a35575f078c23c0a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:29.233868 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953ef27-6258-4993-9f4a-b85cd4984a94 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:29.280114 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c953ef27-6258-4993-9f4a-b85cd4984a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23530d4cc2c4d50a35575f078c23c0a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:29.291974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c953ef27-6258-4993-9f4a-b85cd4984a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23530d4cc2c4d50a35575f078c23c0a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:29.292645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c953ef27-6258-4993-9f4a-b85cd4984a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23530d4cc2c4d50a35575f078c23c0a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:29.293244 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c953ef27-6258-4993-9f4a-b85cd4984a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23530d4cc2c4d50a35575f078c23c0a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:29.300454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c953ef27-6258-4993-9f4a-b85cd4984a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23530d4cc2c4d50a35575f078c23c0a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:29.301690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:12:29.316009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1181/2333] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:12:29 2022] DELETE /identity/v3/users/d23530d4cc2c4d50a35575f078c23c0a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:12:29.321101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ee0e1-46f0-40df-9569-35dedb6a6c01 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:29.321580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ee0e1-46f0-40df-9569-35dedb6a6c01 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:29.321672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ee0e1-46f0-40df-9569-35dedb6a6c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:29.339146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8e6ee0e1-46f0-40df-9569-35dedb6a6c01 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:12:29.340324 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8e6ee0e1-46f0-40df-9569-35dedb6a6c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:29.386547 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:12:29.397994 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1153/2334] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:12:29.407371 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ef27-6258-4993-9f4a-b85cd4984a94 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:29.408748 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c953ef27-6258-4993-9f4a-b85cd4984a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:29.465513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ef27-6258-4993-9f4a-b85cd4984a94 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:29.468069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8dd9f-cb93-4a5b-a2eb-6fb8a576783c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:29.468715 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8dd9f-cb93-4a5b-a2eb-6fb8a576783c service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:29.469000 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8dd9f-cb93-4a5b-a2eb-6fb8a576783c service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:29.469271 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8dd9f-cb93-4a5b-a2eb-6fb8a576783c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:29.478480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8dd9f-cb93-4a5b-a2eb-6fb8a576783c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:29.479912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8dd9f-cb93-4a5b-a2eb-6fb8a576783c service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:29.489391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1182/2335] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:12:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:12:29.810494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ee0e1-46f0-40df-9569-35dedb6a6c01 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:29.811978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8e6ee0e1-46f0-40df-9569-35dedb6a6c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:29.824821 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ee0e1-46f0-40df-9569-35dedb6a6c01 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:29.830536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db22e6a-ebeb-4e38-ac24-43131030f3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:29.831488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db22e6a-ebeb-4e38-ac24-43131030f3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:29.831838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db22e6a-ebeb-4e38-ac24-43131030f3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:29.832202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db22e6a-ebeb-4e38-ac24-43131030f3e5 admin admin] PATH_INFO: `/v3/projects/f6cc6859c7a04965b555861e378c3d81` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:29.833419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db22e6a-ebeb-4e38-ac24-43131030f3e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6cc6859c7a04965b555861e378c3d81)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:29.835377 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db22e6a-ebeb-4e38-ac24-43131030f3e5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:29.884329 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9db22e6a-ebeb-4e38-ac24-43131030f3e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6cc6859c7a04965b555861e378c3d81', 'request_id': 'req-9db22e6a-ebeb-4e38-ac24-43131030f3e5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:29.890442 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9db22e6a-ebeb-4e38-ac24-43131030f3e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6cc6859c7a04965b555861e378c3d81', 'request_id': 'req-9db22e6a-ebeb-4e38-ac24-43131030f3e5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:29.896291 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9db22e6a-ebeb-4e38-ac24-43131030f3e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6cc6859c7a04965b555861e378c3d81', 'request_id': 'req-9db22e6a-ebeb-4e38-ac24-43131030f3e5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:29.908567 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9db22e6a-ebeb-4e38-ac24-43131030f3e5 admin admin] The token cache is being invalidate because project f6cc6859c7a04965b555861e378c3d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:12:29.908798 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9db22e6a-ebeb-4e38-ac24-43131030f3e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:29.909435 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9db22e6a-ebeb-4e38-ac24-43131030f3e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:29.910966 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1154/2336] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:12:29 2022] DELETE /identity/v3/projects/f6cc6859c7a04965b555861e378c3d81 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:12:29.915812 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935471fd-f922-4537-8622-e54aaf1f6cf8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:29.916109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935471fd-f922-4537-8622-e54aaf1f6cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:29.916394 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935471fd-f922-4537-8622-e54aaf1f6cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:29.945518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-935471fd-f922-4537-8622-e54aaf1f6cf8 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:12:29.946709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-935471fd-f922-4537-8622-e54aaf1f6cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:30.003887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1183/2337] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:12:30.011646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777b22f-08ca-4671-9a10-2526a941ffac None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:30.011933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777b22f-08ca-4671-9a10-2526a941ffac None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:30.012211 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777b22f-08ca-4671-9a10-2526a941ffac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:30.030435 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b777b22f-08ca-4671-9a10-2526a941ffac None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:12:30.031624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b777b22f-08ca-4671-9a10-2526a941ffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:30.040689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1155/2338] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:12:30.045079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935471fd-f922-4537-8622-e54aaf1f6cf8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:30.055398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935471fd-f922-4537-8622-e54aaf1f6cf8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:30.059971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa400f-7668-484b-811d-fa90c7b3464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:30.060616 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa400f-7668-484b-811d-fa90c7b3464c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:30.060899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa400f-7668-484b-811d-fa90c7b3464c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:30.061174 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa400f-7668-484b-811d-fa90c7b3464c admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:30.061938 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa400f-7668-484b-811d-fa90c7b3464c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:12:30.062243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa400f-7668-484b-811d-fa90c7b3464c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:30.063837 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa400f-7668-484b-811d-fa90c7b3464c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:30.076021 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1184/2339] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:12:30.080140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777b22f-08ca-4671-9a10-2526a941ffac None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:30.089985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777b22f-08ca-4671-9a10-2526a941ffac None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:30.094639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a30aa0-95e7-418f-a66f-29f85698d405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:30.095274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a30aa0-95e7-418f-a66f-29f85698d405 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:30.095554 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a30aa0-95e7-418f-a66f-29f85698d405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:30.095826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a30aa0-95e7-418f-a66f-29f85698d405 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:30.096520 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a30aa0-95e7-418f-a66f-29f85698d405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:30.098450 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a30aa0-95e7-418f-a66f-29f85698d405 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:30.123910 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1156/2340] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:12:30 2022] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:12:30.128061 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa400f-7668-484b-811d-fa90c7b3464c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:30.138950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa400f-7668-484b-811d-fa90c7b3464c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:30.195121 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3cbcc-a2ad-4c8a-8804-747c44042b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:30.195726 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3cbcc-a2ad-4c8a-8804-747c44042b91 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:30.196004 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3cbcc-a2ad-4c8a-8804-747c44042b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:30.196279 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3cbcc-a2ad-4c8a-8804-747c44042b91 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:30.196996 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3cbcc-a2ad-4c8a-8804-747c44042b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:30.199021 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3cbcc-a2ad-4c8a-8804-747c44042b91 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:30.214463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:12:30.220028 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1185/2341] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:12:30 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:12:30.223805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a30aa0-95e7-418f-a66f-29f85698d405 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:30.234195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a30aa0-95e7-418f-a66f-29f85698d405 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:30.239187 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fd59a-7795-428e-b904-da0ff988dbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:30.239832 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fd59a-7795-428e-b904-da0ff988dbab admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:30.240108 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fd59a-7795-428e-b904-da0ff988dbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:30.240377 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fd59a-7795-428e-b904-da0ff988dbab admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:30.241141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fd59a-7795-428e-b904-da0ff988dbab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:30.242747 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fd59a-7795-428e-b904-da0ff988dbab admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:30.252877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1157/2342] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:12:30.257261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3cbcc-a2ad-4c8a-8804-747c44042b91 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:30.267672 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3cbcc-a2ad-4c8a-8804-747c44042b91 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:30.272911 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46448a-29f4-491c-b957-7917fc61ff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:30.273587 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46448a-29f4-491c-b957-7917fc61ff5e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:30.273867 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46448a-29f4-491c-b957-7917fc61ff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:30.274135 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46448a-29f4-491c-b957-7917fc61ff5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:30.274853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46448a-29f4-491c-b957-7917fc61ff5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:30.276426 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46448a-29f4-491c-b957-7917fc61ff5e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:30.286087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1186/2343] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:12:30.290815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fd59a-7795-428e-b904-da0ff988dbab admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:30.300710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fd59a-7795-428e-b904-da0ff988dbab admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:30.305874 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dda60-c528-4a5f-a13b-1a611879b29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:30.306734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dda60-c528-4a5f-a13b-1a611879b29d admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:30.307012 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dda60-c528-4a5f-a13b-1a611879b29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:30.307282 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dda60-c528-4a5f-a13b-1a611879b29d admin admin] PATH_INFO: `/v3/projects/6468a14c6ef74cceb906fb85c8968125/users/288eb65321244ada89b3d3d00837f0f7/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:30.321229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1dda60-c528-4a5f-a13b-1a611879b29d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6468a14c6ef74cceb906fb85c8968125, user_id=288eb65321244ada89b3d3d00837f0f7, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:30.323878 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1dda60-c528-4a5f-a13b-1a611879b29d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:30.336634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1158/2344] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:12:30 2022] PUT /identity/v3/projects/6468a14c6ef74cceb906fb85c8968125/users/288eb65321244ada89b3d3d00837f0f7/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:12:30.347475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f7edc-2cfb-47fa-93e9-838bcd5402e9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:30.347769 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f7edc-2cfb-47fa-93e9-838bcd5402e9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:30.348051 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f7edc-2cfb-47fa-93e9-838bcd5402e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:30.374635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0c5f7edc-2cfb-47fa-93e9-838bcd5402e9 None None] MFA Rules not processed for user `288eb65321244ada89b3d3d00837f0f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:12:30.375823 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0c5f7edc-2cfb-47fa-93e9-838bcd5402e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:30.442029 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1187/2345] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:12:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:12:30.457809 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dda60-c528-4a5f-a13b-1a611879b29d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:30.459503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2e1dda60-c528-4a5f-a13b-1a611879b29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:30.534813 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dda60-c528-4a5f-a13b-1a611879b29d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:30.539102 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6f83a-40b5-4ba4-b565-c5f2f4ac5f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:30.539728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6f83a-40b5-4ba4-b565-c5f2f4ac5f6e service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:30.540006 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6f83a-40b5-4ba4-b565-c5f2f4ac5f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:30.540275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6f83a-40b5-4ba4-b565-c5f2f4ac5f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:30.549808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6f83a-40b5-4ba4-b565-c5f2f4ac5f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:30.551243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6f83a-40b5-4ba4-b565-c5f2f4ac5f6e service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:30.554709 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:12:30.561806 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1159/2346] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:12:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:12:39.465395 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f7edc-2cfb-47fa-93e9-838bcd5402e9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:39.466847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0c5f7edc-2cfb-47fa-93e9-838bcd5402e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:39.525617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f7edc-2cfb-47fa-93e9-838bcd5402e9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:39.529130 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a189e-133a-452c-82b3-eb7740da1bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:39.529802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a189e-133a-452c-82b3-eb7740da1bcb service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:39.530160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a189e-133a-452c-82b3-eb7740da1bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:39.530340 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a189e-133a-452c-82b3-eb7740da1bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:39.532111 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c32a189e-133a-452c-82b3-eb7740da1bcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:39.602324 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a189e-133a-452c-82b3-eb7740da1bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:39.603769 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a189e-133a-452c-82b3-eb7740da1bcb service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:39.613915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1188/2347] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:12:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:12:40.564638 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:12:40.661833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6f83a-40b5-4ba4-b565-c5f2f4ac5f6e service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:40.731270 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6f83a-40b5-4ba4-b565-c5f2f4ac5f6e service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:40.735934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b31178-d34b-4c74-8ec6-74fa78d34a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:40.736804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b31178-d34b-4c74-8ec6-74fa78d34a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:40.737078 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b31178-d34b-4c74-8ec6-74fa78d34a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:40.737347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b31178-d34b-4c74-8ec6-74fa78d34a7b admin admin] PATH_INFO: `/v3/users/288eb65321244ada89b3d3d00837f0f7` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:40.738553 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b31178-d34b-4c74-8ec6-74fa78d34a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=288eb65321244ada89b3d3d00837f0f7)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:40.740468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b31178-d34b-4c74-8ec6-74fa78d34a7b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:40.787059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d4b31178-d34b-4c74-8ec6-74fa78d34a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '288eb65321244ada89b3d3d00837f0f7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:40.798933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d4b31178-d34b-4c74-8ec6-74fa78d34a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '288eb65321244ada89b3d3d00837f0f7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:40.799633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d4b31178-d34b-4c74-8ec6-74fa78d34a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '288eb65321244ada89b3d3d00837f0f7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:40.800241 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d4b31178-d34b-4c74-8ec6-74fa78d34a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '288eb65321244ada89b3d3d00837f0f7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:40.808935 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d4b31178-d34b-4c74-8ec6-74fa78d34a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '288eb65321244ada89b3d3d00837f0f7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:40.823918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1160/2348] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:12:40 2022] DELETE /identity/v3/users/288eb65321244ada89b3d3d00837f0f7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:12:40.828303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3c9f9-5684-43e3-9795-dc2a5cf9434a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:40.828802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3c9f9-5684-43e3-9795-dc2a5cf9434a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:40.828985 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3c9f9-5684-43e3-9795-dc2a5cf9434a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:40.845871 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-93f3c9f9-5684-43e3-9795-dc2a5cf9434a None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:12:40.847196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-93f3c9f9-5684-43e3-9795-dc2a5cf9434a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:40.872675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:12:40.910414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1189/2349] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:12:40.919981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b31178-d34b-4c74-8ec6-74fa78d34a7b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:40.921430 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d4b31178-d34b-4c74-8ec6-74fa78d34a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:40.986891 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b31178-d34b-4c74-8ec6-74fa78d34a7b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:40.991136 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfd6c1-8794-4d3d-a32d-4cac7de13a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:40.991787 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfd6c1-8794-4d3d-a32d-4cac7de13a6f service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:40.992067 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfd6c1-8794-4d3d-a32d-4cac7de13a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:40.992335 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfd6c1-8794-4d3d-a32d-4cac7de13a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:41.001752 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfd6c1-8794-4d3d-a32d-4cac7de13a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:41.003178 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfd6c1-8794-4d3d-a32d-4cac7de13a6f service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:41.013450 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1161/2350] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:12:41.305881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3c9f9-5684-43e3-9795-dc2a5cf9434a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:12:41.307495 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-93f3c9f9-5684-43e3-9795-dc2a5cf9434a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:12:41.338696 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3c9f9-5684-43e3-9795-dc2a5cf9434a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:12:41.343818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2e8bb-83c6-4f79-8168-fd5db1541206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:12:41.344700 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2e8bb-83c6-4f79-8168-fd5db1541206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:12:41.344967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2e8bb-83c6-4f79-8168-fd5db1541206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:12:41.345292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2e8bb-83c6-4f79-8168-fd5db1541206 admin admin] PATH_INFO: `/v3/projects/6468a14c6ef74cceb906fb85c8968125` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:12:41.346529 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2e8bb-83c6-4f79-8168-fd5db1541206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6468a14c6ef74cceb906fb85c8968125)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:12:41.348576 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2e8bb-83c6-4f79-8168-fd5db1541206 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:12:41.437717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-acc2e8bb-83c6-4f79-8168-fd5db1541206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6468a14c6ef74cceb906fb85c8968125', 'request_id': 'req-acc2e8bb-83c6-4f79-8168-fd5db1541206'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:41.447323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-acc2e8bb-83c6-4f79-8168-fd5db1541206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6468a14c6ef74cceb906fb85c8968125', 'request_id': 'req-acc2e8bb-83c6-4f79-8168-fd5db1541206'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:41.454200 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-acc2e8bb-83c6-4f79-8168-fd5db1541206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6468a14c6ef74cceb906fb85c8968125', 'request_id': 'req-acc2e8bb-83c6-4f79-8168-fd5db1541206'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:41.467605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-acc2e8bb-83c6-4f79-8168-fd5db1541206 admin admin] The token cache is being invalidate because project 6468a14c6ef74cceb906fb85c8968125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:12:41.467933 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-acc2e8bb-83c6-4f79-8168-fd5db1541206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:41.468532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-acc2e8bb-83c6-4f79-8168-fd5db1541206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:12:41.470592 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1190/2351] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:12:41 2022] DELETE /identity/v3/projects/6468a14c6ef74cceb906fb85c8968125 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:12:51.008922 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:12:51.464405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:13:14.737125 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c188d25-c6cf-4f0e-be89-b44fd393a78b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:13:14.737655 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c188d25-c6cf-4f0e-be89-b44fd393a78b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:13:14.737754 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c188d25-c6cf-4f0e-be89-b44fd393a78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:13:14.754417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7c188d25-c6cf-4f0e-be89-b44fd393a78b None None] MFA Rules not processed for user `fcbcaa64592b45d2a4db33a592ca3d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:13:14.755584 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7c188d25-c6cf-4f0e-be89-b44fd393a78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:13:14.809756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1162/2352] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:13:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:13:24.803205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=25 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:13:32.902006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ecb37-da04-445c-a312-35257f57bdbe None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:13:32.902495 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ecb37-da04-445c-a312-35257f57bdbe None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:13:32.902695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ecb37-da04-445c-a312-35257f57bdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:13:32.963153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ae0ecb37-da04-445c-a312-35257f57bdbe None None] MFA Rules not processed for user `40c6739db5404d59a6799b2ace1c7982`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:13:32.964365 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ae0ecb37-da04-445c-a312-35257f57bdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:13:33.037985 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1191/2353] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jun 27 11:13:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:13:33.079825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c188d25-c6cf-4f0e-be89-b44fd393a78b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:13:33.081217 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7c188d25-c6cf-4f0e-be89-b44fd393a78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:13:33.168689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c188d25-c6cf-4f0e-be89-b44fd393a78b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:13:33.173959 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b94613-8665-4bfb-bc87-9e656d78959b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189af68908944b5e9a7cb35fde0e1bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:13:33.174593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b94613-8665-4bfb-bc87-9e656d78959b service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:13:33.174875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b94613-8665-4bfb-bc87-9e656d78959b service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:13:33.175150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b94613-8665-4bfb-bc87-9e656d78959b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:13:33.184016 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b94613-8665-4bfb-bc87-9e656d78959b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:13:33.185625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b94613-8665-4bfb-bc87-9e656d78959b service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:13:33.193664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1163/2354] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jun 27 11:13:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 11:13:43.035106 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=47 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:13:43.190545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=41 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:13:48.877522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c9276-479d-46aa-b4af-2bb2d068d53b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:13:48.878118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c9276-479d-46aa-b4af-2bb2d068d53b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:13:48.878220 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c9276-479d-46aa-b4af-2bb2d068d53b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:13:48.880284 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1192/2355] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jun 27 11:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:13:48.886138 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7dcb0-469c-4151-8ef3-47383b47ab78 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:13:48.886647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7dcb0-469c-4151-8ef3-47383b47ab78 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:13:48.886749 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7dcb0-469c-4151-8ef3-47383b47ab78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:13:48.936703 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b0b7dcb0-469c-4151-8ef3-47383b47ab78 None None] MFA Rules not processed for user `ed08c367a3d34207a51914ff77a93898`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:13:48.937938 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b0b7dcb0-469c-4151-8ef3-47383b47ab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:13:49.016840 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1164/2356] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jun 27 11:13:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:13:49.029291 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c9276-479d-46aa-b4af-2bb2d068d53b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:13:49.031156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-228c9276-479d-46aa-b4af-2bb2d068d53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:13:49.114144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c9276-479d-46aa-b4af-2bb2d068d53b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:13:49.117859 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da736b5a-bd08-43f0-91fd-dd60cbc343e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b6436fdd7a4977a2e02c0e1b8be2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:13:49.118987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da736b5a-bd08-43f0-91fd-dd60cbc343e8 service glance] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:13:49.119269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da736b5a-bd08-43f0-91fd-dd60cbc343e8 service glance] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:13:49.119542 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da736b5a-bd08-43f0-91fd-dd60cbc343e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:13:49.129606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da736b5a-bd08-43f0-91fd-dd60cbc343e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:13:49.131032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da736b5a-bd08-43f0-91fd-dd60cbc343e8 service glance] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:13:49.142646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1193/2357] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:13:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:13:49.208000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97349640-d4c0-4f01-906c-bacea6a8eaac None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:13:49.208362 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97349640-d4c0-4f01-906c-bacea6a8eaac None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:13:49.208721 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97349640-d4c0-4f01-906c-bacea6a8eaac None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:13:49.210138 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1165/2358] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jun 27 11:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:13:49.214649 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a766ea7-b4b4-4937-adb5-de61773942df None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:13:49.214939 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a766ea7-b4b4-4937-adb5-de61773942df None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:13:49.215219 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a766ea7-b4b4-4937-adb5-de61773942df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:13:49.232847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6a766ea7-b4b4-4937-adb5-de61773942df None None] MFA Rules not processed for user `cb2d4050a05f4517ab165c74f9e6cae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:13:49.234099 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6a766ea7-b4b4-4937-adb5-de61773942df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:13:49.285917 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1194/2359] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jun 27 11:13:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:13:49.297477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97349640-d4c0-4f01-906c-bacea6a8eaac None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:13:49.299154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-97349640-d4c0-4f01-906c-bacea6a8eaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:13:49.312586 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97349640-d4c0-4f01-906c-bacea6a8eaac None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:13:49.316105 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33a865-fba3-4a16-9e46-cc01196e8837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:13:49.316740 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33a865-fba3-4a16-9e46-cc01196e8837 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:13:49.317025 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33a865-fba3-4a16-9e46-cc01196e8837 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:13:49.317304 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33a865-fba3-4a16-9e46-cc01196e8837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:13:49.324826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33a865-fba3-4a16-9e46-cc01196e8837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:13:49.326289 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33a865-fba3-4a16-9e46-cc01196e8837 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:13:49.334083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1166/2360] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:13:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:13:49.413821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509e5f3-03fc-4b0d-ab91-2e1fd4fe7fb0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:13:49.414120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509e5f3-03fc-4b0d-ab91-2e1fd4fe7fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:13:49.414434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509e5f3-03fc-4b0d-ab91-2e1fd4fe7fb0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:13:49.416369 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1195/2361] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jun 27 11:13:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:13:49.421442 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84936bf3-1fc4-4c3d-91d3-9df690d78061 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:13:49.421734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84936bf3-1fc4-4c3d-91d3-9df690d78061 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:13:49.422010 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84936bf3-1fc4-4c3d-91d3-9df690d78061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:13:49.440769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-84936bf3-1fc4-4c3d-91d3-9df690d78061 None None] MFA Rules not processed for user `ed08c367a3d34207a51914ff77a93898`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:13:49.441975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-84936bf3-1fc4-4c3d-91d3-9df690d78061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:13:49.450989 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1167/2362] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jun 27 11:13:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:13:49.461017 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509e5f3-03fc-4b0d-ab91-2e1fd4fe7fb0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:13:49.462758 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0509e5f3-03fc-4b0d-ab91-2e1fd4fe7fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:13:49.475733 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509e5f3-03fc-4b0d-ab91-2e1fd4fe7fb0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:13:49.479837 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c3c8a-5410-44d6-af0b-48094c04cf17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:13:49.480468 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c3c8a-5410-44d6-af0b-48094c04cf17 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:13:49.480754 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c3c8a-5410-44d6-af0b-48094c04cf17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:13:49.481033 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c3c8a-5410-44d6-af0b-48094c04cf17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:13:49.491189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c3c8a-5410-44d6-af0b-48094c04cf17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:13:49.492609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c3c8a-5410-44d6-af0b-48094c04cf17 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:13:49.503951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1196/2363] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:13:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:13:52.355346 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543772d-074b-4e12-a416-0eca819402b5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:13:52.355818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543772d-074b-4e12-a416-0eca819402b5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:13:52.356046 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543772d-074b-4e12-a416-0eca819402b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:13:52.374061 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e543772d-074b-4e12-a416-0eca819402b5 None None] MFA Rules not processed for user `40c6739db5404d59a6799b2ace1c7982`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:13:52.375179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e543772d-074b-4e12-a416-0eca819402b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:13:52.382329 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1168/2364] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jun 27 11:13:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:13:52.394131 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c3c8a-5410-44d6-af0b-48094c04cf17 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:13:52.405305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c3c8a-5410-44d6-af0b-48094c04cf17 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:13:52.411920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76200304-cd6f-48a7-afaa-3f1350ab8d97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189af68908944b5e9a7cb35fde0e1bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:13:52.412561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200304-cd6f-48a7-afaa-3f1350ab8d97 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:13:52.412841 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200304-cd6f-48a7-afaa-3f1350ab8d97 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:13:52.413114 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200304-cd6f-48a7-afaa-3f1350ab8d97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:13:52.421848 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76200304-cd6f-48a7-afaa-3f1350ab8d97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:13:52.423419 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76200304-cd6f-48a7-afaa-3f1350ab8d97 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:13:52.433123 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1197/2365] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jun 27 11:13:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 11:14:02.368663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=58 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:14:02.428785 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=70 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:14:07.799850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543772d-074b-4e12-a416-0eca819402b5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:14:07.809731 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543772d-074b-4e12-a416-0eca819402b5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:14:07.813343 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f070bd-dd98-4b23-93a7-ddbbda07da55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:14:07.814100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f070bd-dd98-4b23-93a7-ddbbda07da55 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:14:07.814472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f070bd-dd98-4b23-93a7-ddbbda07da55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:14:07.814887 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f070bd-dd98-4b23-93a7-ddbbda07da55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:14:07.816839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f8f070bd-dd98-4b23-93a7-ddbbda07da55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:14:07.830576 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f070bd-dd98-4b23-93a7-ddbbda07da55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:14:07.831981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f070bd-dd98-4b23-93a7-ddbbda07da55 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:14:07.842543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1169/2366] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:14:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:14:09.013744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76200304-cd6f-48a7-afaa-3f1350ab8d97 service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:14:09.023256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76200304-cd6f-48a7-afaa-3f1350ab8d97 service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:14:09.027423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda23993-0b00-41d5-a84c-1dae1cdc3f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:14:09.028052 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda23993-0b00-41d5-a84c-1dae1cdc3f35 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:14:09.028331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda23993-0b00-41d5-a84c-1dae1cdc3f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:14:09.028604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda23993-0b00-41d5-a84c-1dae1cdc3f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:14:09.030415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fda23993-0b00-41d5-a84c-1dae1cdc3f35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:14:09.043277 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda23993-0b00-41d5-a84c-1dae1cdc3f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:14:09.044681 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda23993-0b00-41d5-a84c-1dae1cdc3f35 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:14:09.056190 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1198/2367] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:14:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:14:17.838514 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=6 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:14:19.050984 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:14:21.173589 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959414b5-7527-42ab-b4d0-98ad34af2400 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:14:21.174058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959414b5-7527-42ab-b4d0-98ad34af2400 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:14:21.174172 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959414b5-7527-42ab-b4d0-98ad34af2400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:14:21.196184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-959414b5-7527-42ab-b4d0-98ad34af2400 None None] MFA Rules not processed for user `40c6739db5404d59a6799b2ace1c7982`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:14:21.198026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-959414b5-7527-42ab-b4d0-98ad34af2400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:14:21.205246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1170/2368] 10.222.0.18 () {58 vars in 967 bytes} [Mon Jun 27 11:14:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:14:21.218781 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda23993-0b00-41d5-a84c-1dae1cdc3f35 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:14:21.230773 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda23993-0b00-41d5-a84c-1dae1cdc3f35 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:14:21.235879 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1476f-fecf-4c15-94d1-7a2fa7ca9809 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189af68908944b5e9a7cb35fde0e1bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:14:21.236519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1476f-fecf-4c15-94d1-7a2fa7ca9809 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:14:21.236801 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1476f-fecf-4c15-94d1-7a2fa7ca9809 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:14:21.237076 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1476f-fecf-4c15-94d1-7a2fa7ca9809 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:14:21.246068 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1476f-fecf-4c15-94d1-7a2fa7ca9809 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:14:21.247654 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1476f-fecf-4c15-94d1-7a2fa7ca9809 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:14:21.255633 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1199/2369] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jun 27 11:14:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 11:14:26.082309 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959414b5-7527-42ab-b4d0-98ad34af2400 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:14:26.083768 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-959414b5-7527-42ab-b4d0-98ad34af2400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:14:26.099044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959414b5-7527-42ab-b4d0-98ad34af2400 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:14:26.105063 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94ae41-d631-44d4-9ce4-ac065a1075e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:14:26.105737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ae41-d631-44d4-9ce4-ac065a1075e9 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:14:26.105999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ae41-d631-44d4-9ce4-ac065a1075e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:14:26.106272 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ae41-d631-44d4-9ce4-ac065a1075e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:14:26.107950 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6d94ae41-d631-44d4-9ce4-ac065a1075e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:14:26.164766 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94ae41-d631-44d4-9ce4-ac065a1075e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:14:26.166944 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94ae41-d631-44d4-9ce4-ac065a1075e9 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:14:26.175913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1171/2370] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:14:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:14:31.252367 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:14:34.201128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1476f-fecf-4c15-94d1-7a2fa7ca9809 service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:14:34.210757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1476f-fecf-4c15-94d1-7a2fa7ca9809 service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:14:34.215068 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b88c6-1d34-4727-a9f5-ff0fd12e7b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:14:34.215704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b88c6-1d34-4727-a9f5-ff0fd12e7b65 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:14:34.215991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b88c6-1d34-4727-a9f5-ff0fd12e7b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:14:34.216267 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b88c6-1d34-4727-a9f5-ff0fd12e7b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:14:34.218071 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8f3b88c6-1d34-4727-a9f5-ff0fd12e7b65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:14:34.229142 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b88c6-1d34-4727-a9f5-ff0fd12e7b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:14:34.230671 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b88c6-1d34-4727-a9f5-ff0fd12e7b65 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:14:34.239034 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1200/2371] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:14:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:14:36.171703 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=31 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:14:44.235378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:14:55.221338 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb24cb5-3a03-449d-ae53-4badd401d7f7 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:14:55.221817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb24cb5-3a03-449d-ae53-4badd401d7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:14:55.221909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb24cb5-3a03-449d-ae53-4badd401d7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:14:55.239154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-deb24cb5-3a03-449d-ae53-4badd401d7f7 None None] MFA Rules not processed for user `38dde6fe09ca4266af31f3e1bc19e18c`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:14:55.240362 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-deb24cb5-3a03-449d-ae53-4badd401d7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:14:55.247203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1172/2372] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:14:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:15:00.427024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b88c6-1d34-4727-a9f5-ff0fd12e7b65 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:15:00.440197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b88c6-1d34-4727-a9f5-ff0fd12e7b65 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:15:00.445808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a166d-fc55-4419-8b34-786ab5c09adf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:15:00.446396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a166d-fc55-4419-8b34-786ab5c09adf service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:00.446679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a166d-fc55-4419-8b34-786ab5c09adf service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:00.446957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a166d-fc55-4419-8b34-786ab5c09adf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:00.448749 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6e3a166d-fc55-4419-8b34-786ab5c09adf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:15:00.459305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a166d-fc55-4419-8b34-786ab5c09adf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:15:00.460892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a166d-fc55-4419-8b34-786ab5c09adf service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:15:00.470589 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1201/2373] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:15:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:15:00.553834 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb24cb5-3a03-449d-ae53-4badd401d7f7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:15:00.578721 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb24cb5-3a03-449d-ae53-4badd401d7f7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:15:00.584870 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8787d2-741e-48a6-9d4b-9469970a805e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:15:00.585667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8787d2-741e-48a6-9d4b-9469970a805e service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:00.586061 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8787d2-741e-48a6-9d4b-9469970a805e service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:00.586432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8787d2-741e-48a6-9d4b-9469970a805e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:00.588886 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2f8787d2-741e-48a6-9d4b-9469970a805e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:15:00.601750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8787d2-741e-48a6-9d4b-9469970a805e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:15:00.603420 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8787d2-741e-48a6-9d4b-9469970a805e service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:15:00.615094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1173/2374] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:15:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:15:04.446143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a166d-fc55-4419-8b34-786ab5c09adf service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:15:04.462983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a166d-fc55-4419-8b34-786ab5c09adf service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:15:04.472909 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1250b-18d5-4cff-83b0-c47aed8dd541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:15:04.473977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1250b-18d5-4cff-83b0-c47aed8dd541 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:04.475183 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1250b-18d5-4cff-83b0-c47aed8dd541 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:04.475645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1250b-18d5-4cff-83b0-c47aed8dd541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:04.478108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d9f1250b-18d5-4cff-83b0-c47aed8dd541 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:15:04.494687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1250b-18d5-4cff-83b0-c47aed8dd541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:15:04.499071 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1250b-18d5-4cff-83b0-c47aed8dd541 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:15:04.526126 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1202/2375] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:15:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:15:07.034712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75a95-db2a-4c93-90e3-11b0cf75d3f4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:07.035222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75a95-db2a-4c93-90e3-11b0cf75d3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:07.035326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75a95-db2a-4c93-90e3-11b0cf75d3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:07.055592 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c4f75a95-db2a-4c93-90e3-11b0cf75d3f4 None None] MFA Rules not processed for user `3ce30513dcc846fc82ec79a1d68ad4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:15:07.057763 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c4f75a95-db2a-4c93-90e3-11b0cf75d3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:15:07.115874 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1174/2376] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:15:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:15:07.611177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1250b-18d5-4cff-83b0-c47aed8dd541 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:15:07.624719 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1250b-18d5-4cff-83b0-c47aed8dd541 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:15:07.628787 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd228a-ae56-4a67-91a2-2b00488e9d39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:15:07.629457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd228a-ae56-4a67-91a2-2b00488e9d39 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:07.629739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd228a-ae56-4a67-91a2-2b00488e9d39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:07.630017 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd228a-ae56-4a67-91a2-2b00488e9d39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:07.631747 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b1bd228a-ae56-4a67-91a2-2b00488e9d39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:15:07.641509 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd228a-ae56-4a67-91a2-2b00488e9d39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:15:07.643169 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd228a-ae56-4a67-91a2-2b00488e9d39 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:15:07.652046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1203/2377] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:15:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:15:08.122345 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f75a95-db2a-4c93-90e3-11b0cf75d3f4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:15:08.123836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c4f75a95-db2a-4c93-90e3-11b0cf75d3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:15:08.194339 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f75a95-db2a-4c93-90e3-11b0cf75d3f4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:15:08.199841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736f8fa-0b8d-48de-960b-5856a8f080da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8673c91abf14c0b9a237f0499fdf20e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:15:08.200491 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736f8fa-0b8d-48de-960b-5856a8f080da service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:08.200778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736f8fa-0b8d-48de-960b-5856a8f080da service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:08.201058 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736f8fa-0b8d-48de-960b-5856a8f080da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:08.202870 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f736f8fa-0b8d-48de-960b-5856a8f080da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:15:08.214798 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736f8fa-0b8d-48de-960b-5856a8f080da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:15:08.216374 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736f8fa-0b8d-48de-960b-5856a8f080da service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:15:08.226115 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1175/2378] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:15:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:15:17.230864 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bfbf0-42c4-4880-a165-adb8cf763850 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:17.231348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bfbf0-42c4-4880-a165-adb8cf763850 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:17.231443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bfbf0-42c4-4880-a165-adb8cf763850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:17.249086 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2b7bfbf0-42c4-4880-a165-adb8cf763850 None None] MFA Rules not processed for user `fcbcaa64592b45d2a4db33a592ca3d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:15:17.250294 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2b7bfbf0-42c4-4880-a165-adb8cf763850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:15:17.257017 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1204/2379] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:15:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:15:18.221992 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=66 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:15:24.652810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736f8fa-0b8d-48de-960b-5856a8f080da service placement] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:15:24.666856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736f8fa-0b8d-48de-960b-5856a8f080da service placement] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:15:24.672650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212eef6-43d2-4b0b-8ba3-091d34c904af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:15:24.673291 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212eef6-43d2-4b0b-8ba3-091d34c904af service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:24.673603 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212eef6-43d2-4b0b-8ba3-091d34c904af service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:24.673876 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212eef6-43d2-4b0b-8ba3-091d34c904af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:24.675625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c212eef6-43d2-4b0b-8ba3-091d34c904af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:15:24.688547 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212eef6-43d2-4b0b-8ba3-091d34c904af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:15:24.690221 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212eef6-43d2-4b0b-8ba3-091d34c904af service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:15:24.702111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1176/2380] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:15:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:15:27.244304 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=21 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:15:30.349144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bfbf0-42c4-4880-a165-adb8cf763850 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:15:30.363233 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bfbf0-42c4-4880-a165-adb8cf763850 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:15:30.368715 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747470e-5543-4216-8819-95a252971c46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:15:30.369386 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747470e-5543-4216-8819-95a252971c46 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:30.369695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747470e-5543-4216-8819-95a252971c46 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:30.369964 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747470e-5543-4216-8819-95a252971c46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:30.371784 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0747470e-5543-4216-8819-95a252971c46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:15:30.431386 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747470e-5543-4216-8819-95a252971c46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:15:30.432997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747470e-5543-4216-8819-95a252971c46 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:15:30.454483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1205/2381] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:15:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:15:34.696475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=6 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:15:40.450112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=28 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:15:41.281502 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc3345-a89d-4dec-9608-f994b3088d61 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:41.281958 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc3345-a89d-4dec-9608-f994b3088d61 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:41.282054 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc3345-a89d-4dec-9608-f994b3088d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:41.299936 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-88cc3345-a89d-4dec-9608-f994b3088d61 None None] MFA Rules not processed for user `40c6739db5404d59a6799b2ace1c7982`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:15:41.301133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-88cc3345-a89d-4dec-9608-f994b3088d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:15:41.308459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1177/2382] 10.222.0.18 () {58 vars in 967 bytes} [Mon Jun 27 11:15:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:15:41.360224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747470e-5543-4216-8819-95a252971c46 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:15:41.372182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747470e-5543-4216-8819-95a252971c46 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:15:41.377441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b76614-8315-4c6b-9074-833a9b5d54b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189af68908944b5e9a7cb35fde0e1bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:15:41.378343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b76614-8315-4c6b-9074-833a9b5d54b0 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:41.378343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b76614-8315-4c6b-9074-833a9b5d54b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:41.378627 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b76614-8315-4c6b-9074-833a9b5d54b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:41.388047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b76614-8315-4c6b-9074-833a9b5d54b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:15:41.389739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b76614-8315-4c6b-9074-833a9b5d54b0 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:15:41.401155 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1206/2383] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jun 27 11:15:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 11:15:42.207060 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de9cf2-c707-4917-b9b5-065ddfa5f796 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:42.207432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de9cf2-c707-4917-b9b5-065ddfa5f796 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:42.207771 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de9cf2-c707-4917-b9b5-065ddfa5f796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:42.227608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-88de9cf2-c707-4917-b9b5-065ddfa5f796 None None] MFA Rules not processed for user `1a6f74ad17db45bf8d2e4f0631d1a55e`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:15:42.229480 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-88de9cf2-c707-4917-b9b5-065ddfa5f796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:15:42.236407 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1178/2384] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:15:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:15:42.691967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b76614-8315-4c6b-9074-833a9b5d54b0 service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:15:42.704728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b76614-8315-4c6b-9074-833a9b5d54b0 service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:15:42.718550 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644204c-74c2-4421-9e13-dd4ea95402cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:15:42.719317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644204c-74c2-4421-9e13-dd4ea95402cc service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:42.719680 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644204c-74c2-4421-9e13-dd4ea95402cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:42.720015 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644204c-74c2-4421-9e13-dd4ea95402cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:42.721873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c644204c-74c2-4421-9e13-dd4ea95402cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:15:42.732185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644204c-74c2-4421-9e13-dd4ea95402cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:15:42.733654 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644204c-74c2-4421-9e13-dd4ea95402cc service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:15:42.741930 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1207/2385] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:15:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:15:45.862638 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de9cf2-c707-4917-b9b5-065ddfa5f796 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:15:45.878085 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de9cf2-c707-4917-b9b5-065ddfa5f796 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:15:45.885491 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee4f3b-acbc-43a5-afcc-b6179e2cf39e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8673c91abf14c0b9a237f0499fdf20e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:15:45.886449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee4f3b-acbc-43a5-afcc-b6179e2cf39e service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:45.886737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee4f3b-acbc-43a5-afcc-b6179e2cf39e service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:45.887039 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee4f3b-acbc-43a5-afcc-b6179e2cf39e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:45.889011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-00ee4f3b-acbc-43a5-afcc-b6179e2cf39e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:15:45.901946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee4f3b-acbc-43a5-afcc-b6179e2cf39e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:15:45.903551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee4f3b-acbc-43a5-afcc-b6179e2cf39e service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:15:45.914568 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1179/2386] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:15:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:15:49.311946 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644204c-74c2-4421-9e13-dd4ea95402cc service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:15:49.313761 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c644204c-74c2-4421-9e13-dd4ea95402cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:15:49.385670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644204c-74c2-4421-9e13-dd4ea95402cc service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:15:49.390483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f8820-fc8a-45f3-906d-3b1f17db353a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:15:49.391338 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f8820-fc8a-45f3-906d-3b1f17db353a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:49.391621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f8820-fc8a-45f3-906d-3b1f17db353a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:49.391899 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f8820-fc8a-45f3-906d-3b1f17db353a admin admin] PATH_INFO: `/v3/users/7c3f5deff55f44dba5420c97469c2c09` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:49.393389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f8820-fc8a-45f3-906d-3b1f17db353a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c3f5deff55f44dba5420c97469c2c09)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:15:49.395303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f8820-fc8a-45f3-906d-3b1f17db353a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:15:49.443150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b18f8820-fc8a-45f3-906d-3b1f17db353a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c3f5deff55f44dba5420c97469c2c09'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:49.456571 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b18f8820-fc8a-45f3-906d-3b1f17db353a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c3f5deff55f44dba5420c97469c2c09'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:49.457285 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b18f8820-fc8a-45f3-906d-3b1f17db353a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c3f5deff55f44dba5420c97469c2c09'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:49.457937 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b18f8820-fc8a-45f3-906d-3b1f17db353a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c3f5deff55f44dba5420c97469c2c09'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:49.467187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b18f8820-fc8a-45f3-906d-3b1f17db353a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c3f5deff55f44dba5420c97469c2c09'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:49.479946 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1208/2387] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:15:49 2022] DELETE /identity/v3/users/7c3f5deff55f44dba5420c97469c2c09 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:15:49.657507 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee4f3b-acbc-43a5-afcc-b6179e2cf39e service placement] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:15:49.669195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee4f3b-acbc-43a5-afcc-b6179e2cf39e service placement] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:15:49.727413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8400f6d-611d-4d74-b711-b8063be37d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:15:49.728263 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8400f6d-611d-4d74-b711-b8063be37d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:49.728548 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8400f6d-611d-4d74-b711-b8063be37d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:49.728825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8400f6d-611d-4d74-b711-b8063be37d8e admin admin] PATH_INFO: `/v3/projects/40ecdd796a2645a4b500b6fe7be09794` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:49.730007 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8400f6d-611d-4d74-b711-b8063be37d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=40ecdd796a2645a4b500b6fe7be09794)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:15:49.731937 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8400f6d-611d-4d74-b711-b8063be37d8e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:15:49.778972 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d8400f6d-611d-4d74-b711-b8063be37d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40ecdd796a2645a4b500b6fe7be09794', 'request_id': 'req-d8400f6d-611d-4d74-b711-b8063be37d8e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:49.785270 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d8400f6d-611d-4d74-b711-b8063be37d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40ecdd796a2645a4b500b6fe7be09794', 'request_id': 'req-d8400f6d-611d-4d74-b711-b8063be37d8e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:49.790765 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d8400f6d-611d-4d74-b711-b8063be37d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40ecdd796a2645a4b500b6fe7be09794', 'request_id': 'req-d8400f6d-611d-4d74-b711-b8063be37d8e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:49.802562 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d8400f6d-611d-4d74-b711-b8063be37d8e admin admin] The token cache is being invalidate because project 40ecdd796a2645a4b500b6fe7be09794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:15:49.802856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d8400f6d-611d-4d74-b711-b8063be37d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:49.803482 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d8400f6d-611d-4d74-b711-b8063be37d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:49.805033 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1180/2388] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:15:49 2022] DELETE /identity/v3/projects/40ecdd796a2645a4b500b6fe7be09794 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:15:49.809603 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f8820-fc8a-45f3-906d-3b1f17db353a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:15:49.811009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b18f8820-fc8a-45f3-906d-3b1f17db353a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:15:49.825010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f8820-fc8a-45f3-906d-3b1f17db353a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:15:49.873326 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:15:49.884645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcf21e-94cc-4337-977f-251e2283e679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:15:49.885563 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcf21e-94cc-4337-977f-251e2283e679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:49.885851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcf21e-94cc-4337-977f-251e2283e679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:49.886129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcf21e-94cc-4337-977f-251e2283e679 admin admin] PATH_INFO: `/v3/users/6ce04d2d5a59474fa449140cbf24e52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:49.887454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcf21e-94cc-4337-977f-251e2283e679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce04d2d5a59474fa449140cbf24e52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:15:49.889405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcf21e-94cc-4337-977f-251e2283e679 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:15:49.942247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a8dcf21e-94cc-4337-977f-251e2283e679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce04d2d5a59474fa449140cbf24e52c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:49.954561 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a8dcf21e-94cc-4337-977f-251e2283e679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce04d2d5a59474fa449140cbf24e52c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:49.955234 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a8dcf21e-94cc-4337-977f-251e2283e679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce04d2d5a59474fa449140cbf24e52c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:49.955830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a8dcf21e-94cc-4337-977f-251e2283e679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce04d2d5a59474fa449140cbf24e52c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:49.966033 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a8dcf21e-94cc-4337-977f-251e2283e679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce04d2d5a59474fa449140cbf24e52c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:49.980850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1209/2389] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:15:49 2022] DELETE /identity/v3/users/6ce04d2d5a59474fa449140cbf24e52c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:15:50.153677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8400f6d-611d-4d74-b711-b8063be37d8e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:15:50.155153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d8400f6d-611d-4d74-b711-b8063be37d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:15:50.171565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8400f6d-611d-4d74-b711-b8063be37d8e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:15:50.231661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:15:50.232473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:15:50.232746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:15:50.233013 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c admin admin] PATH_INFO: `/v3/projects/a0db519ff6624290ac6da100f8495464` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:15:50.234213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0db519ff6624290ac6da100f8495464)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:15:50.236094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:15:50.242427 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:15:50.283883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0db519ff6624290ac6da100f8495464', 'request_id': 'req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:50.289804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0db519ff6624290ac6da100f8495464', 'request_id': 'req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:50.295168 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0db519ff6624290ac6da100f8495464', 'request_id': 'req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:50.307792 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c admin admin] The token cache is being invalidate because project a0db519ff6624290ac6da100f8495464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:15:50.308087 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:50.308708 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:15:50.310450 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1181/2390] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:15:50 2022] DELETE /identity/v3/projects/a0db519ff6624290ac6da100f8495464 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:15:59.976747 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:16:00.304686 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:16:25.556964 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcf21e-94cc-4337-977f-251e2283e679 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:16:25.558406 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a8dcf21e-94cc-4337-977f-251e2283e679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:16:25.614161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcf21e-94cc-4337-977f-251e2283e679 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:16:25.664351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f2f36-69d9-46d2-a6c0-cdbf8efb1a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:16:25.664999 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f2f36-69d9-46d2-a6c0-cdbf8efb1a0d service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:16:25.665283 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f2f36-69d9-46d2-a6c0-cdbf8efb1a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:16:25.665593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f2f36-69d9-46d2-a6c0-cdbf8efb1a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:16:25.667359 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cf1f2f36-69d9-46d2-a6c0-cdbf8efb1a0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:16:25.727610 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f2f36-69d9-46d2-a6c0-cdbf8efb1a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:16:25.729046 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f2f36-69d9-46d2-a6c0-cdbf8efb1a0d service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:16:25.738649 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1210/2391] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:16:28.953120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:16:28.954599 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:16:29.024824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f2f36-69d9-46d2-a6c0-cdbf8efb1a0d service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:16:29.026327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b61f72-0294-4dd2-9200-eb9fc2a2be5c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:16:29.027339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cf1f2f36-69d9-46d2-a6c0-cdbf8efb1a0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:16:29.033067 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef5dae-215f-4ab2-bfe0-f369a38295c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8673c91abf14c0b9a237f0499fdf20e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:16:29.033828 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef5dae-215f-4ab2-bfe0-f369a38295c5 service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:16:29.034184 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef5dae-215f-4ab2-bfe0-f369a38295c5 service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:16:29.034531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef5dae-215f-4ab2-bfe0-f369a38295c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:16:29.036634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9eef5dae-215f-4ab2-bfe0-f369a38295c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:16:29.040679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f2f36-69d9-46d2-a6c0-cdbf8efb1a0d service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:16:29.045714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4242ce-5e1d-41e6-8e04-0971ad87c2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:16:29.046573 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4242ce-5e1d-41e6-8e04-0971ad87c2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:16:29.046853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4242ce-5e1d-41e6-8e04-0971ad87c2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:16:29.047128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4242ce-5e1d-41e6-8e04-0971ad87c2aa admin admin] PATH_INFO: `/v3/users/38dde6fe09ca4266af31f3e1bc19e18c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:16:29.048312 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4242ce-5e1d-41e6-8e04-0971ad87c2aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=38dde6fe09ca4266af31f3e1bc19e18c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:16:29.050168 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef5dae-215f-4ab2-bfe0-f369a38295c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:16:29.050311 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4242ce-5e1d-41e6-8e04-0971ad87c2aa admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:16:29.051745 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef5dae-215f-4ab2-bfe0-f369a38295c5 service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:16:29.065948 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1182/2392] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:16:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:16:29.103211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ff4242ce-5e1d-41e6-8e04-0971ad87c2aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38dde6fe09ca4266af31f3e1bc19e18c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:16:29.113672 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:16:29.116147 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ff4242ce-5e1d-41e6-8e04-0971ad87c2aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38dde6fe09ca4266af31f3e1bc19e18c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:16:29.117155 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ff4242ce-5e1d-41e6-8e04-0971ad87c2aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38dde6fe09ca4266af31f3e1bc19e18c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:16:29.118036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ff4242ce-5e1d-41e6-8e04-0971ad87c2aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38dde6fe09ca4266af31f3e1bc19e18c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:16:29.125738 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ff4242ce-5e1d-41e6-8e04-0971ad87c2aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38dde6fe09ca4266af31f3e1bc19e18c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:16:29.137760 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1211/2393] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:16:29 2022] DELETE /identity/v3/users/38dde6fe09ca4266af31f3e1bc19e18c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:16:29.308584 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef5dae-215f-4ab2-bfe0-f369a38295c5 service placement] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:16:29.321125 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef5dae-215f-4ab2-bfe0-f369a38295c5 service placement] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:16:29.382871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581f815-78b3-4b00-869d-099490047176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:16:29.383733 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581f815-78b3-4b00-869d-099490047176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:16:29.384017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581f815-78b3-4b00-869d-099490047176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:16:29.384296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581f815-78b3-4b00-869d-099490047176 admin admin] PATH_INFO: `/v3/projects/4bf80abcddfc4dbdb9e845b6eaf1b508` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:16:29.385512 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581f815-78b3-4b00-869d-099490047176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf80abcddfc4dbdb9e845b6eaf1b508)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:16:29.387456 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581f815-78b3-4b00-869d-099490047176 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:16:29.432903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5581f815-78b3-4b00-869d-099490047176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf80abcddfc4dbdb9e845b6eaf1b508', 'request_id': 'req-5581f815-78b3-4b00-869d-099490047176'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:16:29.439564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5581f815-78b3-4b00-869d-099490047176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf80abcddfc4dbdb9e845b6eaf1b508', 'request_id': 'req-5581f815-78b3-4b00-869d-099490047176'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:16:29.444902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5581f815-78b3-4b00-869d-099490047176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf80abcddfc4dbdb9e845b6eaf1b508', 'request_id': 'req-5581f815-78b3-4b00-869d-099490047176'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:16:29.456559 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5581f815-78b3-4b00-869d-099490047176 admin admin] The token cache is being invalidate because project 4bf80abcddfc4dbdb9e845b6eaf1b508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:16:29.456841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5581f815-78b3-4b00-869d-099490047176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:16:29.457495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5581f815-78b3-4b00-869d-099490047176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:16:29.459005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1183/2394] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:16:29 2022] DELETE /identity/v3/projects/4bf80abcddfc4dbdb9e845b6eaf1b508 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:16:29.463978 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3fd0e-a216-41ed-9e82-28a5522e5d1f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:16:29.464275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3fd0e-a216-41ed-9e82-28a5522e5d1f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:16:29.464552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3fd0e-a216-41ed-9e82-28a5522e5d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:16:29.481553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-22a3fd0e-a216-41ed-9e82-28a5522e5d1f None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:16:29.483243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-22a3fd0e-a216-41ed-9e82-28a5522e5d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:16:29.540512 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1212/2395] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:16:29.548757 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ea9a7-a75c-4603-955a-6e101256fb83 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:16:29.549049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ea9a7-a75c-4603-955a-6e101256fb83 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:16:29.549325 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ea9a7-a75c-4603-955a-6e101256fb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:16:29.567985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-375ea9a7-a75c-4603-955a-6e101256fb83 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:16:29.569106 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-375ea9a7-a75c-4603-955a-6e101256fb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:16:29.577050 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1184/2396] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:16:29.581221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3fd0e-a216-41ed-9e82-28a5522e5d1f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:16:29.590854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3fd0e-a216-41ed-9e82-28a5522e5d1f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:16:29.595496 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d314594-a23a-4f56-b226-8a08af2a9e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:16:29.596141 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d314594-a23a-4f56-b226-8a08af2a9e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:16:29.600934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d314594-a23a-4f56-b226-8a08af2a9e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:16:29.601219 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d314594-a23a-4f56-b226-8a08af2a9e03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:16:29.601971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d314594-a23a-4f56-b226-8a08af2a9e03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:16:29.602290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d314594-a23a-4f56-b226-8a08af2a9e03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:16:29.603955 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d314594-a23a-4f56-b226-8a08af2a9e03 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:16:29.619743 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1213/2397] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:16:29.624596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ea9a7-a75c-4603-955a-6e101256fb83 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:16:29.633888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ea9a7-a75c-4603-955a-6e101256fb83 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:16:29.638592 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e556317-d414-4ee5-9375-68511129bc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:16:29.639266 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e556317-d414-4ee5-9375-68511129bc6e admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:16:29.639545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e556317-d414-4ee5-9375-68511129bc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:16:29.639846 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e556317-d414-4ee5-9375-68511129bc6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:16:29.640562 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e556317-d414-4ee5-9375-68511129bc6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:16:29.642524 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e556317-d414-4ee5-9375-68511129bc6e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:16:29.652458 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:16:29.683224 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1185/2398] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:16:29 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:16:29.684392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d314594-a23a-4f56-b226-8a08af2a9e03 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:16:29.694427 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d314594-a23a-4f56-b226-8a08af2a9e03 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:16:29.748877 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412bf128-8eb5-42ff-b13b-85f3ea9f5115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:16:29.749559 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bf128-8eb5-42ff-b13b-85f3ea9f5115 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:16:29.749930 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bf128-8eb5-42ff-b13b-85f3ea9f5115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:16:29.750119 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bf128-8eb5-42ff-b13b-85f3ea9f5115 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:16:29.750795 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412bf128-8eb5-42ff-b13b-85f3ea9f5115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:16:29.752712 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412bf128-8eb5-42ff-b13b-85f3ea9f5115 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:16:29.771714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1214/2399] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:16:29 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:16:29.775918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e556317-d414-4ee5-9375-68511129bc6e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:16:29.786661 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e556317-d414-4ee5-9375-68511129bc6e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:16:29.791316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d587c01-7269-4468-97cc-8d1094a99492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:16:29.791968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d587c01-7269-4468-97cc-8d1094a99492 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:16:29.792251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d587c01-7269-4468-97cc-8d1094a99492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:16:29.792537 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d587c01-7269-4468-97cc-8d1094a99492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:16:29.793258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d587c01-7269-4468-97cc-8d1094a99492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:16:29.795468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d587c01-7269-4468-97cc-8d1094a99492 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:16:29.805202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1186/2400] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:16:29.808960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412bf128-8eb5-42ff-b13b-85f3ea9f5115 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:16:29.818869 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412bf128-8eb5-42ff-b13b-85f3ea9f5115 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:16:29.823398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bddaa-0ad3-4444-939a-e86a05d84233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:16:29.824039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bddaa-0ad3-4444-939a-e86a05d84233 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:16:29.824322 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bddaa-0ad3-4444-939a-e86a05d84233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:16:29.824598 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bddaa-0ad3-4444-939a-e86a05d84233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:16:29.825321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bddaa-0ad3-4444-939a-e86a05d84233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:16:29.826943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bddaa-0ad3-4444-939a-e86a05d84233 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:16:29.836608 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1215/2401] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:16:29.840523 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d587c01-7269-4468-97cc-8d1094a99492 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:16:29.850861 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d587c01-7269-4468-97cc-8d1094a99492 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:16:29.855544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5138ca6-08ce-4ded-a7bd-0c474a312061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:16:29.856406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5138ca6-08ce-4ded-a7bd-0c474a312061 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:16:29.856692 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5138ca6-08ce-4ded-a7bd-0c474a312061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:16:29.857592 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5138ca6-08ce-4ded-a7bd-0c474a312061 admin admin] PATH_INFO: `/v3/projects/ab3acd3335534462ba418e37ee809534/users/b1c9bf7e450e4b7f95c0e50116fd8b34/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:16:29.872192 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5138ca6-08ce-4ded-a7bd-0c474a312061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3acd3335534462ba418e37ee809534, user_id=b1c9bf7e450e4b7f95c0e50116fd8b34, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:16:29.874915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5138ca6-08ce-4ded-a7bd-0c474a312061 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:16:29.887360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1187/2402] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:16:29 2022] PUT /identity/v3/projects/ab3acd3335534462ba418e37ee809534/users/b1c9bf7e450e4b7f95c0e50116fd8b34/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:16:29.892424 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4ede4-4ab4-49a8-bacb-1b7b5f520a51 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:16:29.892963 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4ede4-4ab4-49a8-bacb-1b7b5f520a51 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:16:29.893253 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4ede4-4ab4-49a8-bacb-1b7b5f520a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:16:29.911155 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-24d4ede4-4ab4-49a8-bacb-1b7b5f520a51 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:16:29.912353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-24d4ede4-4ab4-49a8-bacb-1b7b5f520a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:16:29.952266 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:16:29.972434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1216/2403] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:16:29.982808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5138ca6-08ce-4ded-a7bd-0c474a312061 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:16:29.984510 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e5138ca6-08ce-4ded-a7bd-0c474a312061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:16:30.041089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5138ca6-08ce-4ded-a7bd-0c474a312061 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:16:30.044724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2831b7b-c78b-4749-a9fd-50832ff65c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:16:30.045354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2831b7b-c78b-4749-a9fd-50832ff65c8f service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:16:30.045665 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2831b7b-c78b-4749-a9fd-50832ff65c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:16:30.045939 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2831b7b-c78b-4749-a9fd-50832ff65c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:16:30.054732 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2831b7b-c78b-4749-a9fd-50832ff65c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:16:30.056128 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2831b7b-c78b-4749-a9fd-50832ff65c8f service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:16:30.066047 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1188/2404] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:16:33.693027 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8f089-4a1a-4c8a-8a44-0eb929b55c23 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:16:33.693543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8f089-4a1a-4c8a-8a44-0eb929b55c23 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:16:33.693753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8f089-4a1a-4c8a-8a44-0eb929b55c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:16:33.721290 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bee8f089-4a1a-4c8a-8a44-0eb929b55c23 None None] MFA Rules not processed for user `b1c9bf7e450e4b7f95c0e50116fd8b34`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:16:33.722425 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bee8f089-4a1a-4c8a-8a44-0eb929b55c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:16:33.787265 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1217/2405] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:16:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:16:33.801824 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2831b7b-c78b-4749-a9fd-50832ff65c8f service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:16:33.803322 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b2831b7b-c78b-4749-a9fd-50832ff65c8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:16:33.885701 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2831b7b-c78b-4749-a9fd-50832ff65c8f service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:16:33.891726 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc57c48-f7c6-4006-ab40-7207c8c08ee3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:16:33.892389 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc57c48-f7c6-4006-ab40-7207c8c08ee3 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:16:33.892676 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc57c48-f7c6-4006-ab40-7207c8c08ee3 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:16:33.893218 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc57c48-f7c6-4006-ab40-7207c8c08ee3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:16:33.901788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc57c48-f7c6-4006-ab40-7207c8c08ee3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:16:33.903413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc57c48-f7c6-4006-ab40-7207c8c08ee3 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:16:33.913645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1189/2406] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:16:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:16:35.259916 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137762e3-2ee7-44ca-acf7-f8b04d98581e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:16:35.260466 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137762e3-2ee7-44ca-acf7-f8b04d98581e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:16:35.260466 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137762e3-2ee7-44ca-acf7-f8b04d98581e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:16:35.280831 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-137762e3-2ee7-44ca-acf7-f8b04d98581e None None] MFA Rules not processed for user `b1c9bf7e450e4b7f95c0e50116fd8b34`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:16:35.282128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-137762e3-2ee7-44ca-acf7-f8b04d98581e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:16:35.289309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1218/2407] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:16:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:16:43.909271 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=82,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:16:45.274327 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=42 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:17:17.681412 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e90b3-6642-4003-a791-fb24fee2c62e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:17:17.681948 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e90b3-6642-4003-a791-fb24fee2c62e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:17:17.682052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e90b3-6642-4003-a791-fb24fee2c62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:17:17.699669 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-fb5e90b3-6642-4003-a791-fb24fee2c62e None None] MFA Rules not processed for user `fcbcaa64592b45d2a4db33a592ca3d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:17:17.700856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fb5e90b3-6642-4003-a791-fb24fee2c62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:17:17.754820 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1190/2408] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:17:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:17:25.217196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137762e3-2ee7-44ca-acf7-f8b04d98581e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:17:25.218709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-137762e3-2ee7-44ca-acf7-f8b04d98581e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:17:25.287671 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137762e3-2ee7-44ca-acf7-f8b04d98581e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:17:25.293106 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f143ea-aadd-49c3-a12d-054deb82c0e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8673c91abf14c0b9a237f0499fdf20e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:17:25.293711 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f143ea-aadd-49c3-a12d-054deb82c0e4 service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:17:25.293993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f143ea-aadd-49c3-a12d-054deb82c0e4 service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:17:25.294268 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f143ea-aadd-49c3-a12d-054deb82c0e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:17:25.296065 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-58f143ea-aadd-49c3-a12d-054deb82c0e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:17:25.309034 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f143ea-aadd-49c3-a12d-054deb82c0e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:17:25.310682 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f143ea-aadd-49c3-a12d-054deb82c0e4 service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:17:25.323854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1219/2409] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:17:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:17:27.747583 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=25 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:17:35.318330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=32 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:17:36.315042 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e90b3-6642-4003-a791-fb24fee2c62e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:17:36.316440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fb5e90b3-6642-4003-a791-fb24fee2c62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:17:36.371788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e90b3-6642-4003-a791-fb24fee2c62e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:17:36.375336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a17792-db6c-4391-8bda-cfe796e6081b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:17:36.375971 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a17792-db6c-4391-8bda-cfe796e6081b service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:17:36.376249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a17792-db6c-4391-8bda-cfe796e6081b service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:17:36.376522 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a17792-db6c-4391-8bda-cfe796e6081b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:17:36.378199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-12a17792-db6c-4391-8bda-cfe796e6081b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:17:36.436977 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a17792-db6c-4391-8bda-cfe796e6081b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:17:36.438442 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a17792-db6c-4391-8bda-cfe796e6081b service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:17:36.447315 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1191/2410] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:17:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:17:46.443302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=48 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:17:48.464289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc983043-c495-4aa3-887e-6d6ef30bacb9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:17:48.464772 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc983043-c495-4aa3-887e-6d6ef30bacb9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:17:48.464772 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc983043-c495-4aa3-887e-6d6ef30bacb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:17:48.482777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cc983043-c495-4aa3-887e-6d6ef30bacb9 None None] MFA Rules not processed for user `3ce30513dcc846fc82ec79a1d68ad4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:17:48.483949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cc983043-c495-4aa3-887e-6d6ef30bacb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:17:48.490739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1220/2411] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:17:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:17:48.653848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf413c78-7a88-4732-9d61-861342246650 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:17:48.654745 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf413c78-7a88-4732-9d61-861342246650 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:17:48.655025 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf413c78-7a88-4732-9d61-861342246650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:17:48.673410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-bf413c78-7a88-4732-9d61-861342246650 None None] MFA Rules not processed for user `40c6739db5404d59a6799b2ace1c7982`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:17:48.674923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bf413c78-7a88-4732-9d61-861342246650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:17:48.732677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1192/2412] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jun 27 11:17:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:17:48.781606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc983043-c495-4aa3-887e-6d6ef30bacb9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:17:48.783047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cc983043-c495-4aa3-887e-6d6ef30bacb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:17:48.858835 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc983043-c495-4aa3-887e-6d6ef30bacb9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:17:48.869694 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2f0b7-a9bb-409b-9f91-9d751b977082 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189af68908944b5e9a7cb35fde0e1bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:17:48.870361 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2f0b7-a9bb-409b-9f91-9d751b977082 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:17:48.870644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2f0b7-a9bb-409b-9f91-9d751b977082 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:17:48.870924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2f0b7-a9bb-409b-9f91-9d751b977082 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:17:48.880502 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2f0b7-a9bb-409b-9f91-9d751b977082 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:17:48.882411 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2f0b7-a9bb-409b-9f91-9d751b977082 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:17:48.891824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1221/2413] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jun 27 11:17:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 11:17:58.725909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=25 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:17:58.888137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=35 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:18:05.643923 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3bf53-727c-42bd-9f04-2efcf24c4ed3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:18:05.644780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3bf53-727c-42bd-9f04-2efcf24c4ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:18:05.645056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3bf53-727c-42bd-9f04-2efcf24c4ed3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:18:05.646470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1193/2414] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jun 27 11:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:18:05.653921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652a1f6-fa8e-49d1-922c-be1fdc77bdac None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:18:05.654393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652a1f6-fa8e-49d1-922c-be1fdc77bdac None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:18:05.654495 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652a1f6-fa8e-49d1-922c-be1fdc77bdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:18:05.673456 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a652a1f6-fa8e-49d1-922c-be1fdc77bdac None None] MFA Rules not processed for user `ed08c367a3d34207a51914ff77a93898`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:18:05.674663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a652a1f6-fa8e-49d1-922c-be1fdc77bdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:18:05.683874 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1222/2415] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jun 27 11:18:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:18:05.695939 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3bf53-727c-42bd-9f04-2efcf24c4ed3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:18:05.697741 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-22d3bf53-727c-42bd-9f04-2efcf24c4ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:18:05.756718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3bf53-727c-42bd-9f04-2efcf24c4ed3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:18:05.760381 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baa82c-2afc-42ac-8062-947c2e26ede7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b6436fdd7a4977a2e02c0e1b8be2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:18:05.761028 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baa82c-2afc-42ac-8062-947c2e26ede7 service glance] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:18:05.761313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baa82c-2afc-42ac-8062-947c2e26ede7 service glance] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:18:05.761623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baa82c-2afc-42ac-8062-947c2e26ede7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:18:05.777971 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64baa82c-2afc-42ac-8062-947c2e26ede7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:18:05.777971 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64baa82c-2afc-42ac-8062-947c2e26ede7 service glance] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:18:05.786013 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1194/2416] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:18:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:18:05.859860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0957a-ff99-4f7e-a09d-31c61f57f1c1 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:18:05.860127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0957a-ff99-4f7e-a09d-31c61f57f1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:18:05.860403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0957a-ff99-4f7e-a09d-31c61f57f1c1 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:18:05.861919 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1223/2417] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jun 27 11:18:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:18:05.867075 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2710a30-4f0f-4847-bbfb-40ad1ec73665 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:18:05.867365 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2710a30-4f0f-4847-bbfb-40ad1ec73665 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:18:05.867643 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2710a30-4f0f-4847-bbfb-40ad1ec73665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:18:05.886194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f2710a30-4f0f-4847-bbfb-40ad1ec73665 None None] MFA Rules not processed for user `cb2d4050a05f4517ab165c74f9e6cae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:18:05.887424 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f2710a30-4f0f-4847-bbfb-40ad1ec73665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:18:05.894866 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1195/2418] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jun 27 11:18:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:18:05.906189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0957a-ff99-4f7e-a09d-31c61f57f1c1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:18:05.907889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-41c0957a-ff99-4f7e-a09d-31c61f57f1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:18:05.921504 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0957a-ff99-4f7e-a09d-31c61f57f1c1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:18:05.925005 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fe292-d6ff-4756-b4c0-a3fd96ee88b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:18:05.925684 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fe292-d6ff-4756-b4c0-a3fd96ee88b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:18:05.925969 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fe292-d6ff-4756-b4c0-a3fd96ee88b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:18:05.926248 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fe292-d6ff-4756-b4c0-a3fd96ee88b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:18:05.933562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fe292-d6ff-4756-b4c0-a3fd96ee88b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:18:05.934995 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fe292-d6ff-4756-b4c0-a3fd96ee88b5 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:18:05.943355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1224/2419] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:18:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:18:06.051810 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba01b59-2b28-4c13-a6af-9a8849162ec5 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:18:06.052103 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba01b59-2b28-4c13-a6af-9a8849162ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:18:06.052385 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba01b59-2b28-4c13-a6af-9a8849162ec5 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:18:06.053844 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1196/2420] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jun 27 11:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 11:18:06.059141 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d684924-41fa-4085-8802-406869e40224 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:18:06.059399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d684924-41fa-4085-8802-406869e40224 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:18:06.059683 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d684924-41fa-4085-8802-406869e40224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:18:06.079474 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0d684924-41fa-4085-8802-406869e40224 None None] MFA Rules not processed for user `ed08c367a3d34207a51914ff77a93898`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:18:06.081342 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0d684924-41fa-4085-8802-406869e40224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:18:06.090994 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1225/2421] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jun 27 11:18:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:18:06.101327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba01b59-2b28-4c13-a6af-9a8849162ec5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:18:06.112158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba01b59-2b28-4c13-a6af-9a8849162ec5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:18:06.115639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e905e37-d239-4385-9466-0d28cd65bb01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:18:06.116268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e905e37-d239-4385-9466-0d28cd65bb01 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:18:06.116546 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e905e37-d239-4385-9466-0d28cd65bb01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:18:06.116815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e905e37-d239-4385-9466-0d28cd65bb01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:18:06.127142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e905e37-d239-4385-9466-0d28cd65bb01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:18:06.128543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e905e37-d239-4385-9466-0d28cd65bb01 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:18:06.138915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1197/2422] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:18:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:18:07.449520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d684924-41fa-4085-8802-406869e40224 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:18:07.459296 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d684924-41fa-4085-8802-406869e40224 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:18:07.462776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3471fd-f911-4fd8-82ac-fca27564af57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:18:07.463426 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3471fd-f911-4fd8-82ac-fca27564af57 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:18:07.463705 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3471fd-f911-4fd8-82ac-fca27564af57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:18:07.463975 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3471fd-f911-4fd8-82ac-fca27564af57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:18:07.465728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7d3471fd-f911-4fd8-82ac-fca27564af57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:18:07.528426 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3471fd-f911-4fd8-82ac-fca27564af57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:18:07.529907 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3471fd-f911-4fd8-82ac-fca27564af57 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:18:07.539757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1226/2423] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:18:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:18:08.438102 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf676ea9-4a8a-4978-b692-b79b7fd8e2e1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:18:08.438656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf676ea9-4a8a-4978-b692-b79b7fd8e2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:18:08.438656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf676ea9-4a8a-4978-b692-b79b7fd8e2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:18:08.457316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-bf676ea9-4a8a-4978-b692-b79b7fd8e2e1 None None] MFA Rules not processed for user `40c6739db5404d59a6799b2ace1c7982`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:18:08.458586 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bf676ea9-4a8a-4978-b692-b79b7fd8e2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:18:08.465907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1198/2424] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jun 27 11:18:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:18:08.480153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3471fd-f911-4fd8-82ac-fca27564af57 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:18:08.492600 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3471fd-f911-4fd8-82ac-fca27564af57 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:18:08.497641 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6ceed-4ee1-417e-8ae8-a171e3ecb2df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189af68908944b5e9a7cb35fde0e1bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:18:08.498299 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6ceed-4ee1-417e-8ae8-a171e3ecb2df service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:18:08.498581 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6ceed-4ee1-417e-8ae8-a171e3ecb2df service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:18:08.498853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6ceed-4ee1-417e-8ae8-a171e3ecb2df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:18:08.507755 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6ceed-4ee1-417e-8ae8-a171e3ecb2df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:18:08.509444 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6ceed-4ee1-417e-8ae8-a171e3ecb2df service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:18:08.519117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1227/2425] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jun 27 11:18:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 11:18:18.452001 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=38 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:18:18.514665 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=48 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:18:33.130279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a1d35-03f6-49bd-820e-f9f8106abe08 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:18:33.130756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a1d35-03f6-49bd-820e-f9f8106abe08 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:18:33.130872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a1d35-03f6-49bd-820e-f9f8106abe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:18:33.148340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1a8a1d35-03f6-49bd-820e-f9f8106abe08 None None] MFA Rules not processed for user `40c6739db5404d59a6799b2ace1c7982`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:18:33.149559 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1a8a1d35-03f6-49bd-820e-f9f8106abe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:18:33.156866 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1199/2426] 10.222.0.18 () {58 vars in 967 bytes} [Mon Jun 27 11:18:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:18:33.168661 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6ceed-4ee1-417e-8ae8-a171e3ecb2df service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:18:33.180009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6ceed-4ee1-417e-8ae8-a171e3ecb2df service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:18:33.184872 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e5f4f-ee39-4467-9b00-087c2e3fb5f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189af68908944b5e9a7cb35fde0e1bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:18:33.185480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e5f4f-ee39-4467-9b00-087c2e3fb5f6 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:18:33.185765 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e5f4f-ee39-4467-9b00-087c2e3fb5f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:18:33.186036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e5f4f-ee39-4467-9b00-087c2e3fb5f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:18:33.194806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e5f4f-ee39-4467-9b00-087c2e3fb5f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:18:33.196370 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e5f4f-ee39-4467-9b00-087c2e3fb5f6 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:18:33.204508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1228/2427] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jun 27 11:18:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 11:18:43.143314 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:18:43.201181 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:19:12.972776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a1d35-03f6-49bd-820e-f9f8106abe08 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:12.982598 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a1d35-03f6-49bd-820e-f9f8106abe08 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:12.986088 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b2939-5b27-4edd-b2d4-0b3d259b33c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:12.986720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b2939-5b27-4edd-b2d4-0b3d259b33c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:12.987001 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b2939-5b27-4edd-b2d4-0b3d259b33c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:12.987277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b2939-5b27-4edd-b2d4-0b3d259b33c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:12.989741 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e75b2939-5b27-4edd-b2d4-0b3d259b33c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:19:13.003928 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b2939-5b27-4edd-b2d4-0b3d259b33c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:13.005352 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b2939-5b27-4edd-b2d4-0b3d259b33c9 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:13.016299 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1200/2428] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:19:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:19:15.665904 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e5f4f-ee39-4467-9b00-087c2e3fb5f6 service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:15.675039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e5f4f-ee39-4467-9b00-087c2e3fb5f6 service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:15.679148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d85d4c-14be-4bcd-8fdd-cf93545023db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:15.679778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d85d4c-14be-4bcd-8fdd-cf93545023db service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:15.680064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d85d4c-14be-4bcd-8fdd-cf93545023db service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:15.680340 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d85d4c-14be-4bcd-8fdd-cf93545023db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:15.682094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-67d85d4c-14be-4bcd-8fdd-cf93545023db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:19:15.695913 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d85d4c-14be-4bcd-8fdd-cf93545023db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:15.697330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d85d4c-14be-4bcd-8fdd-cf93545023db service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:15.708399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1229/2429] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:19:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:19:23.011692 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=6 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:19:23.676463 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b2939-5b27-4edd-b2d4-0b3d259b33c9 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:23.685708 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b2939-5b27-4edd-b2d4-0b3d259b33c9 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:23.689289 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b17b7-1113-4452-a517-988279907f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:23.689961 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b17b7-1113-4452-a517-988279907f00 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:23.690246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b17b7-1113-4452-a517-988279907f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:23.690526 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b17b7-1113-4452-a517-988279907f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:23.692767 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5c9b17b7-1113-4452-a517-988279907f00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:19:23.704290 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b17b7-1113-4452-a517-988279907f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:23.705755 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b17b7-1113-4452-a517-988279907f00 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:23.716372 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1201/2430] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:19:25.703547 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:19:26.798281 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d85d4c-14be-4bcd-8fdd-cf93545023db service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:26.799757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-67d85d4c-14be-4bcd-8fdd-cf93545023db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:19:26.813909 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d85d4c-14be-4bcd-8fdd-cf93545023db service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:26.819083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b4854-3bdf-4ffd-a709-5a497fadf5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:26.819951 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b4854-3bdf-4ffd-a709-5a497fadf5cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:26.820236 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b4854-3bdf-4ffd-a709-5a497fadf5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:26.820514 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b4854-3bdf-4ffd-a709-5a497fadf5cd admin admin] PATH_INFO: `/v3/users/fcbcaa64592b45d2a4db33a592ca3d6a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:26.837857 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b4854-3bdf-4ffd-a709-5a497fadf5cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcbcaa64592b45d2a4db33a592ca3d6a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:26.840522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b4854-3bdf-4ffd-a709-5a497fadf5cd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:26.885301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6e0b4854-3bdf-4ffd-a709-5a497fadf5cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcbcaa64592b45d2a4db33a592ca3d6a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:26.897087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6e0b4854-3bdf-4ffd-a709-5a497fadf5cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcbcaa64592b45d2a4db33a592ca3d6a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:26.897702 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6e0b4854-3bdf-4ffd-a709-5a497fadf5cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcbcaa64592b45d2a4db33a592ca3d6a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:26.898305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6e0b4854-3bdf-4ffd-a709-5a497fadf5cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcbcaa64592b45d2a4db33a592ca3d6a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:26.905224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6e0b4854-3bdf-4ffd-a709-5a497fadf5cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcbcaa64592b45d2a4db33a592ca3d6a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:26.917285 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1230/2431] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:19:26 2022] DELETE /identity/v3/users/fcbcaa64592b45d2a4db33a592ca3d6a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:19:27.094455 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b17b7-1113-4452-a517-988279907f00 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:27.111267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b17b7-1113-4452-a517-988279907f00 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:27.168443 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323d80f-7906-417c-9eff-595416e04bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:27.169302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323d80f-7906-417c-9eff-595416e04bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:27.169614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323d80f-7906-417c-9eff-595416e04bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:27.169890 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323d80f-7906-417c-9eff-595416e04bb0 admin admin] PATH_INFO: `/v3/projects/0bbf44422f974f348d8a4217896ceaaf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:27.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323d80f-7906-417c-9eff-595416e04bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bbf44422f974f348d8a4217896ceaaf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:27.182934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323d80f-7906-417c-9eff-595416e04bb0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:27.228047 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b323d80f-7906-417c-9eff-595416e04bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bbf44422f974f348d8a4217896ceaaf', 'request_id': 'req-b323d80f-7906-417c-9eff-595416e04bb0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:27.234577 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b323d80f-7906-417c-9eff-595416e04bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bbf44422f974f348d8a4217896ceaaf', 'request_id': 'req-b323d80f-7906-417c-9eff-595416e04bb0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:27.240506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b323d80f-7906-417c-9eff-595416e04bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bbf44422f974f348d8a4217896ceaaf', 'request_id': 'req-b323d80f-7906-417c-9eff-595416e04bb0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:27.252342 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b323d80f-7906-417c-9eff-595416e04bb0 admin admin] The token cache is being invalidate because project 0bbf44422f974f348d8a4217896ceaaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:19:27.252636 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b323d80f-7906-417c-9eff-595416e04bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:27.253248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b323d80f-7906-417c-9eff-595416e04bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:27.254818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1202/2432] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:19:27 2022] DELETE /identity/v3/projects/0bbf44422f974f348d8a4217896ceaaf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:19:27.259632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaa618-3ed3-4912-b9eb-17cb93402b3e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:27.259914 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaa618-3ed3-4912-b9eb-17cb93402b3e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:27.260186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaa618-3ed3-4912-b9eb-17cb93402b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:27.277983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2faaa618-3ed3-4912-b9eb-17cb93402b3e None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:19:27.279160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2faaa618-3ed3-4912-b9eb-17cb93402b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:19:27.335577 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1231/2433] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:19:27.343406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f186d5-62fa-403d-9643-4e87f218d955 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:27.343633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f186d5-62fa-403d-9643-4e87f218d955 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:27.343907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f186d5-62fa-403d-9643-4e87f218d955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:27.361631 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c2f186d5-62fa-403d-9643-4e87f218d955 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:19:27.362823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c2f186d5-62fa-403d-9643-4e87f218d955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:19:27.371296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1203/2434] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:19:27.375442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaa618-3ed3-4912-b9eb-17cb93402b3e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:27.385111 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaa618-3ed3-4912-b9eb-17cb93402b3e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:27.389862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc604e-7583-44ee-b57f-0a69ca8cc477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:27.390508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc604e-7583-44ee-b57f-0a69ca8cc477 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:27.391130 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc604e-7583-44ee-b57f-0a69ca8cc477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:27.391130 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc604e-7583-44ee-b57f-0a69ca8cc477 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:27.391822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc604e-7583-44ee-b57f-0a69ca8cc477 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:19:27.392123 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc604e-7583-44ee-b57f-0a69ca8cc477 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:27.394013 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc604e-7583-44ee-b57f-0a69ca8cc477 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:27.405803 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1232/2435] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:19:27.409852 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f186d5-62fa-403d-9643-4e87f218d955 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:27.419392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f186d5-62fa-403d-9643-4e87f218d955 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:27.424031 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e4f97-095b-46d2-b1bf-128dd1e704fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:27.424668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e4f97-095b-46d2-b1bf-128dd1e704fd admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:27.424948 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e4f97-095b-46d2-b1bf-128dd1e704fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:27.425223 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e4f97-095b-46d2-b1bf-128dd1e704fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:27.426690 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e4f97-095b-46d2-b1bf-128dd1e704fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:27.428650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e4f97-095b-46d2-b1bf-128dd1e704fd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:27.454361 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1204/2436] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:19:27 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:19:27.457707 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc604e-7583-44ee-b57f-0a69ca8cc477 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:27.467583 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc604e-7583-44ee-b57f-0a69ca8cc477 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:27.511992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:19:27.525933 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493644f3-c7ce-41c3-b753-035beec913bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:27.526595 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493644f3-c7ce-41c3-b753-035beec913bf admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:27.526878 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493644f3-c7ce-41c3-b753-035beec913bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:27.527153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493644f3-c7ce-41c3-b753-035beec913bf admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:27.527842 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493644f3-c7ce-41c3-b753-035beec913bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:27.529829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493644f3-c7ce-41c3-b753-035beec913bf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:27.548975 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1233/2437] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:19:27 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:19:27.553022 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e4f97-095b-46d2-b1bf-128dd1e704fd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:27.563053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e4f97-095b-46d2-b1bf-128dd1e704fd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:27.567611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125050fd-b3eb-4aeb-93a4-86b816fdb7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:27.568252 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125050fd-b3eb-4aeb-93a4-86b816fdb7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:27.568530 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125050fd-b3eb-4aeb-93a4-86b816fdb7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:27.568800 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125050fd-b3eb-4aeb-93a4-86b816fdb7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:27.569546 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125050fd-b3eb-4aeb-93a4-86b816fdb7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:27.571148 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125050fd-b3eb-4aeb-93a4-86b816fdb7c3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:27.580885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1205/2438] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:19:27.585187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493644f3-c7ce-41c3-b753-035beec913bf admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:27.595077 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493644f3-c7ce-41c3-b753-035beec913bf admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:27.600244 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e1e90-0f45-432b-9f93-377778ec8707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:27.600891 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e1e90-0f45-432b-9f93-377778ec8707 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:27.601177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e1e90-0f45-432b-9f93-377778ec8707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:27.601490 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e1e90-0f45-432b-9f93-377778ec8707 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:27.602213 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e1e90-0f45-432b-9f93-377778ec8707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:27.603802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e1e90-0f45-432b-9f93-377778ec8707 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:27.613961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1234/2439] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:19:27.617879 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125050fd-b3eb-4aeb-93a4-86b816fdb7c3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:27.627498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125050fd-b3eb-4aeb-93a4-86b816fdb7c3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:27.632134 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2a21b-e371-4887-9b45-cfce209d2aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:27.632989 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2a21b-e371-4887-9b45-cfce209d2aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:27.633267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2a21b-e371-4887-9b45-cfce209d2aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:27.633571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2a21b-e371-4887-9b45-cfce209d2aea admin admin] PATH_INFO: `/v3/projects/04d299b839c7489f999ec15bcb2ad91b/users/2107693081d5494197b28c9a41fa970c/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:27.648601 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2a21b-e371-4887-9b45-cfce209d2aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d299b839c7489f999ec15bcb2ad91b, user_id=2107693081d5494197b28c9a41fa970c, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:27.651251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2a21b-e371-4887-9b45-cfce209d2aea admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:27.664154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1206/2440] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:19:27 2022] PUT /identity/v3/projects/04d299b839c7489f999ec15bcb2ad91b/users/2107693081d5494197b28c9a41fa970c/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:19:27.675103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5064d1-2e17-4d35-9186-0a558e37a988 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:27.675402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5064d1-2e17-4d35-9186-0a558e37a988 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:27.675718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5064d1-2e17-4d35-9186-0a558e37a988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:27.701415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5c5064d1-2e17-4d35-9186-0a558e37a988 None None] MFA Rules not processed for user `2107693081d5494197b28c9a41fa970c`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:19:27.702611 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5c5064d1-2e17-4d35-9186-0a558e37a988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:19:27.765442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1235/2441] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:19:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:19:27.770670 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2a21b-e371-4887-9b45-cfce209d2aea admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:27.776251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:19:27.831188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2a21b-e371-4887-9b45-cfce209d2aea admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:27.836214 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f5a68-0b99-4e44-8e1b-b84ce8e3f4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:27.836843 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f5a68-0b99-4e44-8e1b-b84ce8e3f4ee admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:27.837119 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f5a68-0b99-4e44-8e1b-b84ce8e3f4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:27.837412 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f5a68-0b99-4e44-8e1b-b84ce8e3f4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:27.838123 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f5a68-0b99-4e44-8e1b-b84ce8e3f4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:27.840011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f5a68-0b99-4e44-8e1b-b84ce8e3f4ee admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:27.865483 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1207/2442] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:19:27 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:19:27.874573 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5064d1-2e17-4d35-9186-0a558e37a988 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:27.885937 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5064d1-2e17-4d35-9186-0a558e37a988 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:27.941988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4456b1-be6f-4770-ae36-5a105822de7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:27.942658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4456b1-be6f-4770-ae36-5a105822de7d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:27.942943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4456b1-be6f-4770-ae36-5a105822de7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:27.943222 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4456b1-be6f-4770-ae36-5a105822de7d admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:27.943905 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4456b1-be6f-4770-ae36-5a105822de7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:27.945885 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4456b1-be6f-4770-ae36-5a105822de7d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:27.964913 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1236/2443] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:19:27 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:19:27.969023 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f5a68-0b99-4e44-8e1b-b84ce8e3f4ee admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:27.979157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f5a68-0b99-4e44-8e1b-b84ce8e3f4ee admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:27.983694 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac95ce1-a0bf-48b1-be54-c1c235ba79a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:27.984342 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac95ce1-a0bf-48b1-be54-c1c235ba79a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:27.984624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac95ce1-a0bf-48b1-be54-c1c235ba79a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:27.984899 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac95ce1-a0bf-48b1-be54-c1c235ba79a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:27.985648 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac95ce1-a0bf-48b1-be54-c1c235ba79a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:27.987233 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac95ce1-a0bf-48b1-be54-c1c235ba79a2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:27.997979 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1208/2444] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:19:28.001913 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4456b1-be6f-4770-ae36-5a105822de7d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:28.012451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4456b1-be6f-4770-ae36-5a105822de7d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:28.017175 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b34a05-1907-4b88-b1cd-c847357513a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:28.018073 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b34a05-1907-4b88-b1cd-c847357513a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:28.018608 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b34a05-1907-4b88-b1cd-c847357513a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:28.018881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b34a05-1907-4b88-b1cd-c847357513a6 admin admin] PATH_INFO: `/v3/projects/fd1cae06ff2245e19221f2a4e5bc7ed5/users/2fc5f5e56480414fadfc0a8c719ac239/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:28.039345 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b34a05-1907-4b88-b1cd-c847357513a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1cae06ff2245e19221f2a4e5bc7ed5, user_id=2fc5f5e56480414fadfc0a8c719ac239, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:28.042027 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b34a05-1907-4b88-b1cd-c847357513a6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:28.054449 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1237/2445] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:19:28 2022] PUT /identity/v3/projects/fd1cae06ff2245e19221f2a4e5bc7ed5/users/2fc5f5e56480414fadfc0a8c719ac239/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:19:28.058343 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac95ce1-a0bf-48b1-be54-c1c235ba79a2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:28.069029 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac95ce1-a0bf-48b1-be54-c1c235ba79a2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:28.127193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1c6a2-5b5f-4624-8a7b-4dcdf9f1e21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:28.127850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1c6a2-5b5f-4624-8a7b-4dcdf9f1e21a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:28.128078 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1c6a2-5b5f-4624-8a7b-4dcdf9f1e21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:28.128351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1c6a2-5b5f-4624-8a7b-4dcdf9f1e21a admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:28.129585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1c6a2-5b5f-4624-8a7b-4dcdf9f1e21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:28.131179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1c6a2-5b5f-4624-8a7b-4dcdf9f1e21a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:28.140693 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1209/2446] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:19:28.145763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b34a05-1907-4b88-b1cd-c847357513a6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:28.155829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b34a05-1907-4b88-b1cd-c847357513a6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:28.160375 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba5018-170e-405c-8895-8c48763ab1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:28.161238 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba5018-170e-405c-8895-8c48763ab1c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:28.161551 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba5018-170e-405c-8895-8c48763ab1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:28.161829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba5018-170e-405c-8895-8c48763ab1c6 admin admin] PATH_INFO: `/v3/projects/fd1cae06ff2245e19221f2a4e5bc7ed5/users/2fc5f5e56480414fadfc0a8c719ac239/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:28.163766 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba5018-170e-405c-8895-8c48763ab1c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1cae06ff2245e19221f2a4e5bc7ed5, user_id=2fc5f5e56480414fadfc0a8c719ac239, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:28.166416 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba5018-170e-405c-8895-8c48763ab1c6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:28.176376 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1238/2447] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:19:28 2022] PUT /identity/v3/projects/fd1cae06ff2245e19221f2a4e5bc7ed5/users/2fc5f5e56480414fadfc0a8c719ac239/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:19:28.186387 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f31c4-54ee-4735-b75e-51cad81dac4b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:28.186672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f31c4-54ee-4735-b75e-51cad81dac4b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:28.186951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f31c4-54ee-4735-b75e-51cad81dac4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:28.213897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-266f31c4-54ee-4735-b75e-51cad81dac4b None None] MFA Rules not processed for user `2fc5f5e56480414fadfc0a8c719ac239`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:19:28.215083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-266f31c4-54ee-4735-b75e-51cad81dac4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:19:28.278183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:19:28.282473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1210/2448] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:19:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:19:28.293740 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba5018-170e-405c-8895-8c48763ab1c6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:28.295453 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-64ba5018-170e-405c-8895-8c48763ab1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:19:28.306478 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:19:28.352912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba5018-170e-405c-8895-8c48763ab1c6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:28.356498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96040e09-b92c-4c9d-9797-de31ddd9eb5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:28.357150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96040e09-b92c-4c9d-9797-de31ddd9eb5e service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:28.357462 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96040e09-b92c-4c9d-9797-de31ddd9eb5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:28.357736 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96040e09-b92c-4c9d-9797-de31ddd9eb5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:28.367065 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96040e09-b92c-4c9d-9797-de31ddd9eb5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:28.368477 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96040e09-b92c-4c9d-9797-de31ddd9eb5e service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:28.378074 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1239/2449] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:19:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:19:28.446319 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f31c4-54ee-4735-b75e-51cad81dac4b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:28.455782 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f31c4-54ee-4735-b75e-51cad81dac4b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:28.459761 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45e693-6977-4b9c-8daa-0d21580b4173 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:28.460403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45e693-6977-4b9c-8daa-0d21580b4173 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:28.460680 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45e693-6977-4b9c-8daa-0d21580b4173 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:28.460952 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45e693-6977-4b9c-8daa-0d21580b4173 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:28.518962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45e693-6977-4b9c-8daa-0d21580b4173 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:28.520403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45e693-6977-4b9c-8daa-0d21580b4173 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:28.529569 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1211/2450] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:19:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:19:38.373721 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=22 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:19:38.525417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=28 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:19:48.057260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96040e09-b92c-4c9d-9797-de31ddd9eb5e service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:48.058670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-96040e09-b92c-4c9d-9797-de31ddd9eb5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:19:48.117706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96040e09-b92c-4c9d-9797-de31ddd9eb5e service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:48.121222 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626dfed9-d455-4611-942c-94f247512443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:48.121881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dfed9-d455-4611-942c-94f247512443 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:48.122158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dfed9-d455-4611-942c-94f247512443 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:48.122430 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dfed9-d455-4611-942c-94f247512443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:48.124152 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-626dfed9-d455-4611-942c-94f247512443 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:19:48.186336 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626dfed9-d455-4611-942c-94f247512443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:48.187822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626dfed9-d455-4611-942c-94f247512443 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:48.197836 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1240/2451] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:19:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:19:51.357847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45e693-6977-4b9c-8daa-0d21580b4173 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:51.359278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6c45e693-6977-4b9c-8daa-0d21580b4173 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:19:51.374083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45e693-6977-4b9c-8daa-0d21580b4173 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:51.378665 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76bf91-93ff-456f-beb1-81166b6cf0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:51.379544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76bf91-93ff-456f-beb1-81166b6cf0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:51.379831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76bf91-93ff-456f-beb1-81166b6cf0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:51.380107 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76bf91-93ff-456f-beb1-81166b6cf0fe admin admin] PATH_INFO: `/v3/users/1a6f74ad17db45bf8d2e4f0631d1a55e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:51.394112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76bf91-93ff-456f-beb1-81166b6cf0fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a6f74ad17db45bf8d2e4f0631d1a55e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:51.396060 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76bf91-93ff-456f-beb1-81166b6cf0fe admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:51.440367 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0f76bf91-93ff-456f-beb1-81166b6cf0fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a6f74ad17db45bf8d2e4f0631d1a55e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:51.451931 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0f76bf91-93ff-456f-beb1-81166b6cf0fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a6f74ad17db45bf8d2e4f0631d1a55e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:51.452555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0f76bf91-93ff-456f-beb1-81166b6cf0fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a6f74ad17db45bf8d2e4f0631d1a55e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:51.453153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0f76bf91-93ff-456f-beb1-81166b6cf0fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a6f74ad17db45bf8d2e4f0631d1a55e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:51.460400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0f76bf91-93ff-456f-beb1-81166b6cf0fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a6f74ad17db45bf8d2e4f0631d1a55e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:51.473342 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1212/2452] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:19:51 2022] DELETE /identity/v3/users/1a6f74ad17db45bf8d2e4f0631d1a55e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:19:51.643646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626dfed9-d455-4611-942c-94f247512443 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:51.654614 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626dfed9-d455-4611-942c-94f247512443 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:51.714353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28143fc5-d586-4c4a-b318-eeb1ae17c106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:51.715206 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28143fc5-d586-4c4a-b318-eeb1ae17c106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:51.715506 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28143fc5-d586-4c4a-b318-eeb1ae17c106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:51.715762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28143fc5-d586-4c4a-b318-eeb1ae17c106 admin admin] PATH_INFO: `/v3/projects/33b8bcf19597417b87a2c3e532871bcb` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:51.726450 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28143fc5-d586-4c4a-b318-eeb1ae17c106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b8bcf19597417b87a2c3e532871bcb)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:51.728369 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28143fc5-d586-4c4a-b318-eeb1ae17c106 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:51.768838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:19:51.773463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-28143fc5-d586-4c4a-b318-eeb1ae17c106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b8bcf19597417b87a2c3e532871bcb', 'request_id': 'req-28143fc5-d586-4c4a-b318-eeb1ae17c106'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:51.780540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-28143fc5-d586-4c4a-b318-eeb1ae17c106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b8bcf19597417b87a2c3e532871bcb', 'request_id': 'req-28143fc5-d586-4c4a-b318-eeb1ae17c106'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:51.786613 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-28143fc5-d586-4c4a-b318-eeb1ae17c106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b8bcf19597417b87a2c3e532871bcb', 'request_id': 'req-28143fc5-d586-4c4a-b318-eeb1ae17c106'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:51.797856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-28143fc5-d586-4c4a-b318-eeb1ae17c106 admin admin] The token cache is being invalidate because project 33b8bcf19597417b87a2c3e532871bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:19:51.798142 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-28143fc5-d586-4c4a-b318-eeb1ae17c106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:51.798766 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-28143fc5-d586-4c4a-b318-eeb1ae17c106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:19:51.800282 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1241/2453] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:19:51 2022] DELETE /identity/v3/projects/33b8bcf19597417b87a2c3e532871bcb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:19:51.805196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef979a-7900-427f-84be-e5e83129d20f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:51.805508 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef979a-7900-427f-84be-e5e83129d20f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:51.805785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef979a-7900-427f-84be-e5e83129d20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:51.823442 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ddef979a-7900-427f-84be-e5e83129d20f None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:19:51.824622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ddef979a-7900-427f-84be-e5e83129d20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:19:51.882021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1213/2454] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:19:51.889816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89596c6d-86ef-47c4-ac4f-b5adb33afd40 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:51.890043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89596c6d-86ef-47c4-ac4f-b5adb33afd40 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:51.890315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89596c6d-86ef-47c4-ac4f-b5adb33afd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:51.908280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-89596c6d-86ef-47c4-ac4f-b5adb33afd40 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:19:51.909506 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-89596c6d-86ef-47c4-ac4f-b5adb33afd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:19:51.917274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1242/2455] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:19:51.921180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef979a-7900-427f-84be-e5e83129d20f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:51.930699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef979a-7900-427f-84be-e5e83129d20f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:51.935299 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93d1f2-0594-40a6-a96e-e04b0a02138d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:51.935935 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93d1f2-0594-40a6-a96e-e04b0a02138d admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:51.936215 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93d1f2-0594-40a6-a96e-e04b0a02138d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:51.936501 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93d1f2-0594-40a6-a96e-e04b0a02138d admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:51.937203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93d1f2-0594-40a6-a96e-e04b0a02138d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:19:51.937562 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93d1f2-0594-40a6-a96e-e04b0a02138d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:51.939136 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93d1f2-0594-40a6-a96e-e04b0a02138d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:51.950835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1214/2456] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:19:51.955081 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89596c6d-86ef-47c4-ac4f-b5adb33afd40 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:51.964793 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89596c6d-86ef-47c4-ac4f-b5adb33afd40 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:51.969420 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a7ff7-8ef4-446c-8425-3bdec2d973a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:51.970054 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a7ff7-8ef4-446c-8425-3bdec2d973a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:51.970336 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a7ff7-8ef4-446c-8425-3bdec2d973a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:51.970610 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a7ff7-8ef4-446c-8425-3bdec2d973a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:51.971348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a7ff7-8ef4-446c-8425-3bdec2d973a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:51.973246 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a7ff7-8ef4-446c-8425-3bdec2d973a6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:51.999383 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1243/2457] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:19:51 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:19:52.002686 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93d1f2-0594-40a6-a96e-e04b0a02138d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:52.012940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93d1f2-0594-40a6-a96e-e04b0a02138d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:52.056805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:19:52.071341 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3fd0a-32d2-4183-a568-275d6462b27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:52.072011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3fd0a-32d2-4183-a568-275d6462b27c admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:52.072370 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3fd0a-32d2-4183-a568-275d6462b27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:52.072656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3fd0a-32d2-4183-a568-275d6462b27c admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:52.073347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3fd0a-32d2-4183-a568-275d6462b27c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:52.075429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3fd0a-32d2-4183-a568-275d6462b27c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:52.098217 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1215/2458] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:19:52 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:19:52.099419 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a7ff7-8ef4-446c-8425-3bdec2d973a6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:52.109388 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a7ff7-8ef4-446c-8425-3bdec2d973a6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:52.114361 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6642440-049e-4254-8777-070d9d4ffa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:52.115016 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642440-049e-4254-8777-070d9d4ffa25 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:52.115297 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642440-049e-4254-8777-070d9d4ffa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:52.115570 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642440-049e-4254-8777-070d9d4ffa25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:52.116287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6642440-049e-4254-8777-070d9d4ffa25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:52.117910 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6642440-049e-4254-8777-070d9d4ffa25 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:52.131536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1244/2459] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:19:52.135365 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3fd0a-32d2-4183-a568-275d6462b27c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:52.146026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3fd0a-32d2-4183-a568-275d6462b27c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:52.150484 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d79fd3-74bb-40f6-9347-5336e7bcfd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:52.151118 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d79fd3-74bb-40f6-9347-5336e7bcfd43 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:52.151397 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d79fd3-74bb-40f6-9347-5336e7bcfd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:52.151696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d79fd3-74bb-40f6-9347-5336e7bcfd43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:52.152404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d79fd3-74bb-40f6-9347-5336e7bcfd43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:52.154016 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d79fd3-74bb-40f6-9347-5336e7bcfd43 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:52.163716 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1216/2460] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:19:52.167984 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6642440-049e-4254-8777-070d9d4ffa25 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:52.178031 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6642440-049e-4254-8777-070d9d4ffa25 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:52.182981 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7eadf-3206-4448-9d71-3c682226f429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:52.183866 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7eadf-3206-4448-9d71-3c682226f429 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:52.184146 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7eadf-3206-4448-9d71-3c682226f429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:52.184422 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7eadf-3206-4448-9d71-3c682226f429 admin admin] PATH_INFO: `/v3/projects/b532dd230b2d4b8ba091a5eb32012e0f/users/e1fd95dd50a64e8ea3bf7583f7a37a9e/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:52.199836 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7eadf-3206-4448-9d71-3c682226f429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b532dd230b2d4b8ba091a5eb32012e0f, user_id=e1fd95dd50a64e8ea3bf7583f7a37a9e, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:52.202539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7eadf-3206-4448-9d71-3c682226f429 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:52.216758 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1245/2461] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:19:52 2022] PUT /identity/v3/projects/b532dd230b2d4b8ba091a5eb32012e0f/users/e1fd95dd50a64e8ea3bf7583f7a37a9e/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:19:52.226674 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7b931-0f1a-41bc-974c-dbb737d19600 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:52.226994 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7b931-0f1a-41bc-974c-dbb737d19600 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:52.227272 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7b931-0f1a-41bc-974c-dbb737d19600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:52.252819 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-04b7b931-0f1a-41bc-974c-dbb737d19600 None None] MFA Rules not processed for user `e1fd95dd50a64e8ea3bf7583f7a37a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:19:52.254518 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-04b7b931-0f1a-41bc-974c-dbb737d19600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:19:52.319135 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1217/2462] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:19:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:19:52.323495 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7eadf-3206-4448-9d71-3c682226f429 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:52.383996 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7eadf-3206-4448-9d71-3c682226f429 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:52.388529 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b0b32-0603-40d1-93e6-8b274acee5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:52.389167 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b0b32-0603-40d1-93e6-8b274acee5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:52.389478 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b0b32-0603-40d1-93e6-8b274acee5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:52.389779 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b0b32-0603-40d1-93e6-8b274acee5b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:52.390454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b0b32-0603-40d1-93e6-8b274acee5b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:52.392347 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b0b32-0603-40d1-93e6-8b274acee5b6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:52.416360 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1246/2463] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:19:52 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:19:52.420389 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7b931-0f1a-41bc-974c-dbb737d19600 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:52.431306 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7b931-0f1a-41bc-974c-dbb737d19600 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:52.494347 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922efe8-aa5f-4118-93a5-3271c4c4b516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:52.495021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922efe8-aa5f-4118-93a5-3271c4c4b516 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:52.495304 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922efe8-aa5f-4118-93a5-3271c4c4b516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:52.495577 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922efe8-aa5f-4118-93a5-3271c4c4b516 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:52.496258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922efe8-aa5f-4118-93a5-3271c4c4b516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:52.498209 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922efe8-aa5f-4118-93a5-3271c4c4b516 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:52.523447 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1218/2464] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:19:52 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:19:52.525957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b0b32-0603-40d1-93e6-8b274acee5b6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:52.536351 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b0b32-0603-40d1-93e6-8b274acee5b6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:52.540980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe5765-d94e-4a4a-9cbb-eb5e378d7837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:52.541671 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe5765-d94e-4a4a-9cbb-eb5e378d7837 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:52.541955 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe5765-d94e-4a4a-9cbb-eb5e378d7837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:52.542231 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe5765-d94e-4a4a-9cbb-eb5e378d7837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:52.542954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe5765-d94e-4a4a-9cbb-eb5e378d7837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:52.544593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe5765-d94e-4a4a-9cbb-eb5e378d7837 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:52.555752 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1247/2465] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:19:52.559978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922efe8-aa5f-4118-93a5-3271c4c4b516 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:52.572799 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922efe8-aa5f-4118-93a5-3271c4c4b516 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:52.577570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592ec21-99b3-4ddb-8568-155053b8092c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:52.578448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592ec21-99b3-4ddb-8568-155053b8092c admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:52.578723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592ec21-99b3-4ddb-8568-155053b8092c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:52.578990 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592ec21-99b3-4ddb-8568-155053b8092c admin admin] PATH_INFO: `/v3/projects/bf444ee7f78542b5b59d99829b821f17/users/528ca79270094fe78c5aa0d46a097d6a/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:52.593510 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592ec21-99b3-4ddb-8568-155053b8092c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf444ee7f78542b5b59d99829b821f17, user_id=528ca79270094fe78c5aa0d46a097d6a, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:52.596204 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592ec21-99b3-4ddb-8568-155053b8092c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:52.608940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1219/2466] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:19:52 2022] PUT /identity/v3/projects/bf444ee7f78542b5b59d99829b821f17/users/528ca79270094fe78c5aa0d46a097d6a/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:19:52.612894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe5765-d94e-4a4a-9cbb-eb5e378d7837 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:52.623376 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe5765-d94e-4a4a-9cbb-eb5e378d7837 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:52.662886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:19:52.681336 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62bd90-f4f8-4b45-9a1b-e502f9eb7e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:52.681971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62bd90-f4f8-4b45-9a1b-e502f9eb7e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:52.682256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62bd90-f4f8-4b45-9a1b-e502f9eb7e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:52.682537 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62bd90-f4f8-4b45-9a1b-e502f9eb7e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:52.683287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62bd90-f4f8-4b45-9a1b-e502f9eb7e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:52.684912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62bd90-f4f8-4b45-9a1b-e502f9eb7e40 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:52.694554 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1248/2467] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:19:52.698741 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592ec21-99b3-4ddb-8568-155053b8092c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:52.714200 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592ec21-99b3-4ddb-8568-155053b8092c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:52.719090 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbcc9a-9794-4feb-934a-85423dfc30eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:52.719965 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbcc9a-9794-4feb-934a-85423dfc30eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:52.720241 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbcc9a-9794-4feb-934a-85423dfc30eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:52.720512 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbcc9a-9794-4feb-934a-85423dfc30eb admin admin] PATH_INFO: `/v3/projects/bf444ee7f78542b5b59d99829b821f17/users/528ca79270094fe78c5aa0d46a097d6a/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:52.723015 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbbcc9a-9794-4feb-934a-85423dfc30eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf444ee7f78542b5b59d99829b821f17, user_id=528ca79270094fe78c5aa0d46a097d6a, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:52.725655 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbbcc9a-9794-4feb-934a-85423dfc30eb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:52.735728 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1220/2468] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:19:52 2022] PUT /identity/v3/projects/bf444ee7f78542b5b59d99829b821f17/users/528ca79270094fe78c5aa0d46a097d6a/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:19:52.747566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf1a37-3f45-491d-9de0-cda3e83ae0a0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:52.747857 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf1a37-3f45-491d-9de0-cda3e83ae0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:52.748136 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf1a37-3f45-491d-9de0-cda3e83ae0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:52.774061 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-26bf1a37-3f45-491d-9de0-cda3e83ae0a0 None None] MFA Rules not processed for user `528ca79270094fe78c5aa0d46a097d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:19:52.775248 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-26bf1a37-3f45-491d-9de0-cda3e83ae0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:19:52.841725 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1249/2469] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:19:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:19:52.853418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbcc9a-9794-4feb-934a-85423dfc30eb admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:52.855115 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7dbbcc9a-9794-4feb-934a-85423dfc30eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:19:52.866403 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:19:52.913788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbcc9a-9794-4feb-934a-85423dfc30eb admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:52.917455 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a0630-175c-4bc9-a1ba-546bc7768d21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:52.918098 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a0630-175c-4bc9-a1ba-546bc7768d21 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:52.918381 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a0630-175c-4bc9-a1ba-546bc7768d21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:52.918658 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a0630-175c-4bc9-a1ba-546bc7768d21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:52.928117 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a0630-175c-4bc9-a1ba-546bc7768d21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:52.929633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a0630-175c-4bc9-a1ba-546bc7768d21 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:52.939010 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1221/2470] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:19:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:19:53.010504 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf1a37-3f45-491d-9de0-cda3e83ae0a0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:19:53.020831 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf1a37-3f45-491d-9de0-cda3e83ae0a0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:19:53.024457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afa797-d4ab-4048-9911-96b0809256ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:19:53.025094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afa797-d4ab-4048-9911-96b0809256ab service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:19:53.025404 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afa797-d4ab-4048-9911-96b0809256ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:19:53.025688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afa797-d4ab-4048-9911-96b0809256ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:19:53.084873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afa797-d4ab-4048-9911-96b0809256ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:19:53.086353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afa797-d4ab-4048-9911-96b0809256ab service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:19:53.095293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1250/2471] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:19:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:02.934680 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=22 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:03.091209 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=72 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:09.212002 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a0630-175c-4bc9-a1ba-546bc7768d21 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:09.272146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a0630-175c-4bc9-a1ba-546bc7768d21 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:09.276738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efbd99-e933-4f65-a116-05b0b7c190f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:09.277633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efbd99-e933-4f65-a116-05b0b7c190f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:09.277912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efbd99-e933-4f65-a116-05b0b7c190f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:09.278180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efbd99-e933-4f65-a116-05b0b7c190f0 admin admin] PATH_INFO: `/v3/users/e1fd95dd50a64e8ea3bf7583f7a37a9e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:09.279350 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efbd99-e933-4f65-a116-05b0b7c190f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1fd95dd50a64e8ea3bf7583f7a37a9e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:09.281243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efbd99-e933-4f65-a116-05b0b7c190f0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:09.326900 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-31efbd99-e933-4f65-a116-05b0b7c190f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1fd95dd50a64e8ea3bf7583f7a37a9e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:09.339337 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-31efbd99-e933-4f65-a116-05b0b7c190f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1fd95dd50a64e8ea3bf7583f7a37a9e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:09.340102 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-31efbd99-e933-4f65-a116-05b0b7c190f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1fd95dd50a64e8ea3bf7583f7a37a9e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:09.340774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-31efbd99-e933-4f65-a116-05b0b7c190f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1fd95dd50a64e8ea3bf7583f7a37a9e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:09.349503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-31efbd99-e933-4f65-a116-05b0b7c190f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1fd95dd50a64e8ea3bf7583f7a37a9e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:09.362511 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1222/2472] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:09 2022] DELETE /identity/v3/users/e1fd95dd50a64e8ea3bf7583f7a37a9e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:09.367704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1729b5-26d8-4602-a78d-40ce55a38c91 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:09.368165 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1729b5-26d8-4602-a78d-40ce55a38c91 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:09.368268 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1729b5-26d8-4602-a78d-40ce55a38c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:09.385256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2e1729b5-26d8-4602-a78d-40ce55a38c91 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:09.386507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2e1729b5-26d8-4602-a78d-40ce55a38c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:09.447141 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1251/2473] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:09.456686 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efbd99-e933-4f65-a116-05b0b7c190f0 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:09.458113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-31efbd99-e933-4f65-a116-05b0b7c190f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:09.516477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efbd99-e933-4f65-a116-05b0b7c190f0 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:09.520371 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3f1e2-3475-434a-abd3-fa4917711853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:09.521014 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3f1e2-3475-434a-abd3-fa4917711853 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:09.521290 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3f1e2-3475-434a-abd3-fa4917711853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:09.521593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3f1e2-3475-434a-abd3-fa4917711853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:09.531047 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3f1e2-3475-434a-abd3-fa4917711853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:09.532474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3f1e2-3475-434a-abd3-fa4917711853 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:09.543210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1223/2474] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:09.809535 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1729b5-26d8-4602-a78d-40ce55a38c91 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:09.810977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2e1729b5-26d8-4602-a78d-40ce55a38c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:09.823459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1729b5-26d8-4602-a78d-40ce55a38c91 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:09.828106 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac45365-158d-4807-a516-bae3281f251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:09.829323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac45365-158d-4807-a516-bae3281f251d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:09.829323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac45365-158d-4807-a516-bae3281f251d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:09.829573 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac45365-158d-4807-a516-bae3281f251d admin admin] PATH_INFO: `/v3/projects/b532dd230b2d4b8ba091a5eb32012e0f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:09.830721 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac45365-158d-4807-a516-bae3281f251d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b532dd230b2d4b8ba091a5eb32012e0f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:09.832641 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac45365-158d-4807-a516-bae3281f251d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:09.889969 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9ac45365-158d-4807-a516-bae3281f251d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b532dd230b2d4b8ba091a5eb32012e0f', 'request_id': 'req-9ac45365-158d-4807-a516-bae3281f251d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:09.901517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9ac45365-158d-4807-a516-bae3281f251d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b532dd230b2d4b8ba091a5eb32012e0f', 'request_id': 'req-9ac45365-158d-4807-a516-bae3281f251d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:09.915435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9ac45365-158d-4807-a516-bae3281f251d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b532dd230b2d4b8ba091a5eb32012e0f', 'request_id': 'req-9ac45365-158d-4807-a516-bae3281f251d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:09.922800 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9ac45365-158d-4807-a516-bae3281f251d admin admin] The token cache is being invalidate because project b532dd230b2d4b8ba091a5eb32012e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:09.923045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9ac45365-158d-4807-a516-bae3281f251d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:09.923792 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9ac45365-158d-4807-a516-bae3281f251d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:09.928114 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1252/2475] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:09 2022] DELETE /identity/v3/projects/b532dd230b2d4b8ba091a5eb32012e0f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:09.930008 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3f1e2-3475-434a-abd3-fa4917711853 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:09.940037 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3f1e2-3475-434a-abd3-fa4917711853 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:09.963166 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:10.009133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d43db-eb73-41e8-bf4d-233bac2b0cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:10.010371 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d43db-eb73-41e8-bf4d-233bac2b0cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:10.010371 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d43db-eb73-41e8-bf4d-233bac2b0cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:10.010703 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d43db-eb73-41e8-bf4d-233bac2b0cb9 admin admin] PATH_INFO: `/v3/users/528ca79270094fe78c5aa0d46a097d6a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:10.011868 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d43db-eb73-41e8-bf4d-233bac2b0cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=528ca79270094fe78c5aa0d46a097d6a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:10.013836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d43db-eb73-41e8-bf4d-233bac2b0cb9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:10.071167 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-085d43db-eb73-41e8-bf4d-233bac2b0cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '528ca79270094fe78c5aa0d46a097d6a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:10.087248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-085d43db-eb73-41e8-bf4d-233bac2b0cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '528ca79270094fe78c5aa0d46a097d6a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:10.088155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-085d43db-eb73-41e8-bf4d-233bac2b0cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '528ca79270094fe78c5aa0d46a097d6a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:10.088905 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-085d43db-eb73-41e8-bf4d-233bac2b0cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '528ca79270094fe78c5aa0d46a097d6a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:10.101203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-085d43db-eb73-41e8-bf4d-233bac2b0cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '528ca79270094fe78c5aa0d46a097d6a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:10.116569 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1224/2476] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:09 2022] DELETE /identity/v3/users/528ca79270094fe78c5aa0d46a097d6a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:10.137903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac45365-158d-4807-a516-bae3281f251d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:10.139601 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9ac45365-158d-4807-a516-bae3281f251d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:10.251522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac45365-158d-4807-a516-bae3281f251d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:10.273938 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:10.340646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e233689-cb15-4f1a-ab89-3b7b2884c962 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:10.341241 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e233689-cb15-4f1a-ab89-3b7b2884c962 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:10.341606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e233689-cb15-4f1a-ab89-3b7b2884c962 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:10.341881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e233689-cb15-4f1a-ab89-3b7b2884c962 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:10.343861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5e233689-cb15-4f1a-ab89-3b7b2884c962 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:10.358670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e233689-cb15-4f1a-ab89-3b7b2884c962 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:10.361030 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e233689-cb15-4f1a-ab89-3b7b2884c962 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:10.378174 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1253/2477] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:10.542053 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d43db-eb73-41e8-bf4d-233bac2b0cb9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:10.544054 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-085d43db-eb73-41e8-bf4d-233bac2b0cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:10.613315 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d43db-eb73-41e8-bf4d-233bac2b0cb9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:10.618753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcf224-fbeb-4c7e-ac28-e766ccc609f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:10.619616 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcf224-fbeb-4c7e-ac28-e766ccc609f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:10.619896 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcf224-fbeb-4c7e-ac28-e766ccc609f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:10.620170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcf224-fbeb-4c7e-ac28-e766ccc609f5 admin admin] PATH_INFO: `/v3/projects/bf444ee7f78542b5b59d99829b821f17` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:10.621343 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcf224-fbeb-4c7e-ac28-e766ccc609f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf444ee7f78542b5b59d99829b821f17)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:10.623471 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcf224-fbeb-4c7e-ac28-e766ccc609f5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:10.668282 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:10.672359 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5bdcf224-fbeb-4c7e-ac28-e766ccc609f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf444ee7f78542b5b59d99829b821f17', 'request_id': 'req-5bdcf224-fbeb-4c7e-ac28-e766ccc609f5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:10.680811 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5bdcf224-fbeb-4c7e-ac28-e766ccc609f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf444ee7f78542b5b59d99829b821f17', 'request_id': 'req-5bdcf224-fbeb-4c7e-ac28-e766ccc609f5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:10.686785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5bdcf224-fbeb-4c7e-ac28-e766ccc609f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf444ee7f78542b5b59d99829b821f17', 'request_id': 'req-5bdcf224-fbeb-4c7e-ac28-e766ccc609f5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:10.698738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5bdcf224-fbeb-4c7e-ac28-e766ccc609f5 admin admin] The token cache is being invalidate because project bf444ee7f78542b5b59d99829b821f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:10.699024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5bdcf224-fbeb-4c7e-ac28-e766ccc609f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:10.699666 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5bdcf224-fbeb-4c7e-ac28-e766ccc609f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:10.701306 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1225/2478] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:10 2022] DELETE /identity/v3/projects/bf444ee7f78542b5b59d99829b821f17 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:10.706132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e72f4-b3bd-4efb-a962-d83b4934ad0a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:10.706426 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e72f4-b3bd-4efb-a962-d83b4934ad0a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:10.706706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e72f4-b3bd-4efb-a962-d83b4934ad0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:10.724410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-325e72f4-b3bd-4efb-a962-d83b4934ad0a None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:10.726305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-325e72f4-b3bd-4efb-a962-d83b4934ad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:10.786972 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1254/2479] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:10.795224 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04f7bd-e14b-4bf4-9e57-5767ed20a0b1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:10.795559 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04f7bd-e14b-4bf4-9e57-5767ed20a0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:10.795783 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04f7bd-e14b-4bf4-9e57-5767ed20a0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:10.815381 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6f04f7bd-e14b-4bf4-9e57-5767ed20a0b1 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:10.816720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6f04f7bd-e14b-4bf4-9e57-5767ed20a0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:10.825015 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1226/2480] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:20:10.829289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e72f4-b3bd-4efb-a962-d83b4934ad0a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:10.839253 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e72f4-b3bd-4efb-a962-d83b4934ad0a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:10.843873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f36abe-97ad-4f10-b889-434be60d7404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:10.844524 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f36abe-97ad-4f10-b889-434be60d7404 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:10.844804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f36abe-97ad-4f10-b889-434be60d7404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:10.845075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f36abe-97ad-4f10-b889-434be60d7404 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:10.845889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f36abe-97ad-4f10-b889-434be60d7404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:20:10.846188 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f36abe-97ad-4f10-b889-434be60d7404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:10.847783 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f36abe-97ad-4f10-b889-434be60d7404 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:10.863389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1255/2481] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:20:10.864618 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04f7bd-e14b-4bf4-9e57-5767ed20a0b1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:10.874424 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04f7bd-e14b-4bf4-9e57-5767ed20a0b1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:10.879004 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d194941-3e82-4740-8524-3f3009a2d744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:10.879644 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d194941-3e82-4740-8524-3f3009a2d744 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:10.879925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d194941-3e82-4740-8524-3f3009a2d744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:10.880198 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d194941-3e82-4740-8524-3f3009a2d744 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:10.880878 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d194941-3e82-4740-8524-3f3009a2d744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:10.882809 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d194941-3e82-4740-8524-3f3009a2d744 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:10.908605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1227/2482] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:20:10 2022] POST /identity/v3/projects => generated 361 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:10.913352 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f36abe-97ad-4f10-b889-434be60d7404 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:10.923718 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f36abe-97ad-4f10-b889-434be60d7404 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:10.981441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbecd4a-262c-4713-a56a-90ace218e587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:10.982109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbecd4a-262c-4713-a56a-90ace218e587 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:10.982389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbecd4a-262c-4713-a56a-90ace218e587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:10.982659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbecd4a-262c-4713-a56a-90ace218e587 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:10.983350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbecd4a-262c-4713-a56a-90ace218e587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:10.985262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbecd4a-262c-4713-a56a-90ace218e587 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:11.004405 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1256/2483] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:20:10 2022] POST /identity/v3/users => generated 281 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:11.008495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d194941-3e82-4740-8524-3f3009a2d744 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:11.019065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d194941-3e82-4740-8524-3f3009a2d744 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:11.024380 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b87193-ec49-4743-b075-398790c2149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:11.025043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b87193-ec49-4743-b075-398790c2149b admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:11.025322 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b87193-ec49-4743-b075-398790c2149b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:11.025619 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b87193-ec49-4743-b075-398790c2149b admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:11.026349 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b87193-ec49-4743-b075-398790c2149b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:11.027972 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b87193-ec49-4743-b075-398790c2149b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:11.039618 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1228/2484] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:11.043511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbecd4a-262c-4713-a56a-90ace218e587 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:11.053865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbecd4a-262c-4713-a56a-90ace218e587 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:11.058664 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5857f9-eb1e-4f1a-8575-cdffd57cf8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:11.059336 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5857f9-eb1e-4f1a-8575-cdffd57cf8ef admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:11.059624 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5857f9-eb1e-4f1a-8575-cdffd57cf8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:11.059898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5857f9-eb1e-4f1a-8575-cdffd57cf8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:11.060634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5857f9-eb1e-4f1a-8575-cdffd57cf8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:11.062271 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5857f9-eb1e-4f1a-8575-cdffd57cf8ef admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:11.073036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1257/2485] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:11.077653 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b87193-ec49-4743-b075-398790c2149b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:11.089615 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b87193-ec49-4743-b075-398790c2149b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:11.094784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356d0f7-0fe5-4e9b-a846-24181352ee03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:11.095668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356d0f7-0fe5-4e9b-a846-24181352ee03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:11.095950 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356d0f7-0fe5-4e9b-a846-24181352ee03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:11.096738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356d0f7-0fe5-4e9b-a846-24181352ee03 admin admin] PATH_INFO: `/v3/projects/ebb717f066f0457b8f9a80bb2d6f16b2/users/a7271dc88f9a4462b37c6da30d930cbc/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:11.115561 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356d0f7-0fe5-4e9b-a846-24181352ee03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb717f066f0457b8f9a80bb2d6f16b2, user_id=a7271dc88f9a4462b37c6da30d930cbc, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:11.118338 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356d0f7-0fe5-4e9b-a846-24181352ee03 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:11.134344 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1229/2486] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:11 2022] PUT /identity/v3/projects/ebb717f066f0457b8f9a80bb2d6f16b2/users/a7271dc88f9a4462b37c6da30d930cbc/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:11.142262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52cb4c-78dd-4f1a-a8b2-c64076ff57ed None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:11.142550 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52cb4c-78dd-4f1a-a8b2-c64076ff57ed None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:11.142824 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52cb4c-78dd-4f1a-a8b2-c64076ff57ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:11.167634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:11.171166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1f52cb4c-78dd-4f1a-a8b2-c64076ff57ed None None] MFA Rules not processed for user `a7271dc88f9a4462b37c6da30d930cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:11.173287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1f52cb4c-78dd-4f1a-a8b2-c64076ff57ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:11.244018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1258/2487] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:11.248504 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356d0f7-0fe5-4e9b-a846-24181352ee03 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:11.309261 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356d0f7-0fe5-4e9b-a846-24181352ee03 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:11.313972 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145c5c4-27d9-419e-aefb-1c06240ded64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:11.314624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145c5c4-27d9-419e-aefb-1c06240ded64 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:11.314907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145c5c4-27d9-419e-aefb-1c06240ded64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:11.315183 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145c5c4-27d9-419e-aefb-1c06240ded64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:11.315873 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145c5c4-27d9-419e-aefb-1c06240ded64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:11.317898 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145c5c4-27d9-419e-aefb-1c06240ded64 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:11.343009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1230/2488] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:20:11 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:11.347135 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52cb4c-78dd-4f1a-a8b2-c64076ff57ed None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:11.358005 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52cb4c-78dd-4f1a-a8b2-c64076ff57ed None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:11.413769 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e7601-f4c6-4e15-8d3d-d98a3f5c62bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:11.414436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e7601-f4c6-4e15-8d3d-d98a3f5c62bf admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:11.414726 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e7601-f4c6-4e15-8d3d-d98a3f5c62bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:11.415006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e7601-f4c6-4e15-8d3d-d98a3f5c62bf admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:11.415696 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e7601-f4c6-4e15-8d3d-d98a3f5c62bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:11.417715 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e7601-f4c6-4e15-8d3d-d98a3f5c62bf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:11.437467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1259/2489] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:20:11 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:11.441348 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145c5c4-27d9-419e-aefb-1c06240ded64 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:11.452406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145c5c4-27d9-419e-aefb-1c06240ded64 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:11.457075 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2c678-3f24-43a4-acf7-5ce5419116a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:11.457760 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2c678-3f24-43a4-acf7-5ce5419116a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:11.458047 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2c678-3f24-43a4-acf7-5ce5419116a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:11.458326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2c678-3f24-43a4-acf7-5ce5419116a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:11.459051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2c678-3f24-43a4-acf7-5ce5419116a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:11.461292 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2c678-3f24-43a4-acf7-5ce5419116a0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:11.472962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1231/2490] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:11.476967 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e7601-f4c6-4e15-8d3d-d98a3f5c62bf admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:11.486833 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e7601-f4c6-4e15-8d3d-d98a3f5c62bf admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:11.491451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbbbcc-1532-453c-aae0-c97492c952be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:11.492322 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbbbcc-1532-453c-aae0-c97492c952be admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:11.492609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbbbcc-1532-453c-aae0-c97492c952be admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:11.492888 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbbbcc-1532-453c-aae0-c97492c952be admin admin] PATH_INFO: `/v3/projects/ecf85cad1cd1421f9d2d1e4cbabe4ad1/users/a538729885bf4eb29a52686d6016dadd/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:11.507927 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbbbcc-1532-453c-aae0-c97492c952be admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf85cad1cd1421f9d2d1e4cbabe4ad1, user_id=a538729885bf4eb29a52686d6016dadd, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:11.510609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbbbcc-1532-453c-aae0-c97492c952be admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:11.523523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1260/2491] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:11 2022] PUT /identity/v3/projects/ecf85cad1cd1421f9d2d1e4cbabe4ad1/users/a538729885bf4eb29a52686d6016dadd/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:11.527409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2c678-3f24-43a4-acf7-5ce5419116a0 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:11.537028 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2c678-3f24-43a4-acf7-5ce5419116a0 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:11.575470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:11.594218 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc95f4-dd6a-4b90-8f52-490cd6d870dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:11.594886 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc95f4-dd6a-4b90-8f52-490cd6d870dc admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:11.595165 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc95f4-dd6a-4b90-8f52-490cd6d870dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:11.595435 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc95f4-dd6a-4b90-8f52-490cd6d870dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:11.597445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc95f4-dd6a-4b90-8f52-490cd6d870dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:11.597784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc95f4-dd6a-4b90-8f52-490cd6d870dc admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:11.607943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1232/2492] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:11.612398 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbbbcc-1532-453c-aae0-c97492c952be admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:11.622920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbbbcc-1532-453c-aae0-c97492c952be admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:11.627499 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107b206-9a0f-4da3-bb46-f8a3c529b72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:11.628374 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107b206-9a0f-4da3-bb46-f8a3c529b72a admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:11.628658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107b206-9a0f-4da3-bb46-f8a3c529b72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:11.628932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107b206-9a0f-4da3-bb46-f8a3c529b72a admin admin] PATH_INFO: `/v3/projects/ecf85cad1cd1421f9d2d1e4cbabe4ad1/users/a538729885bf4eb29a52686d6016dadd/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:11.630990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107b206-9a0f-4da3-bb46-f8a3c529b72a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf85cad1cd1421f9d2d1e4cbabe4ad1, user_id=a538729885bf4eb29a52686d6016dadd, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:11.634164 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107b206-9a0f-4da3-bb46-f8a3c529b72a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:11.645315 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1261/2493] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:11 2022] PUT /identity/v3/projects/ecf85cad1cd1421f9d2d1e4cbabe4ad1/users/a538729885bf4eb29a52686d6016dadd/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:11.656930 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be563a-fa15-4395-a552-860b72a7b681 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:11.657228 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be563a-fa15-4395-a552-860b72a7b681 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:11.657552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be563a-fa15-4395-a552-860b72a7b681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:11.684493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-59be563a-fa15-4395-a552-860b72a7b681 None None] MFA Rules not processed for user `a538729885bf4eb29a52686d6016dadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:11.685707 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-59be563a-fa15-4395-a552-860b72a7b681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:11.763062 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1233/2494] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:11.774468 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107b206-9a0f-4da3-bb46-f8a3c529b72a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:11.776182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8107b206-9a0f-4da3-bb46-f8a3c529b72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:11.832052 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107b206-9a0f-4da3-bb46-f8a3c529b72a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:11.835750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d9ced-dce3-4f18-b07e-dc7ee1b0fe6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:11.836381 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d9ced-dce3-4f18-b07e-dc7ee1b0fe6c service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:11.836666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d9ced-dce3-4f18-b07e-dc7ee1b0fe6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:11.836943 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d9ced-dce3-4f18-b07e-dc7ee1b0fe6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:11.845949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d9ced-dce3-4f18-b07e-dc7ee1b0fe6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:11.847379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d9ced-dce3-4f18-b07e-dc7ee1b0fe6c service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:11.851355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:11.858726 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1262/2495] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:20:12.253324 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be563a-fa15-4395-a552-860b72a7b681 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:12.314971 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be563a-fa15-4395-a552-860b72a7b681 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:12.320019 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e02e8b-8db0-4112-bebf-9c4a431b76ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:12.320877 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e02e8b-8db0-4112-bebf-9c4a431b76ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:12.321153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e02e8b-8db0-4112-bebf-9c4a431b76ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:12.321459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e02e8b-8db0-4112-bebf-9c4a431b76ce admin admin] PATH_INFO: `/v3/users/a7271dc88f9a4462b37c6da30d930cbc` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:12.322616 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e02e8b-8db0-4112-bebf-9c4a431b76ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7271dc88f9a4462b37c6da30d930cbc)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:12.324508 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e02e8b-8db0-4112-bebf-9c4a431b76ce admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:12.367681 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b1e02e8b-8db0-4112-bebf-9c4a431b76ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7271dc88f9a4462b37c6da30d930cbc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:12.379335 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b1e02e8b-8db0-4112-bebf-9c4a431b76ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7271dc88f9a4462b37c6da30d930cbc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:12.379994 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b1e02e8b-8db0-4112-bebf-9c4a431b76ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7271dc88f9a4462b37c6da30d930cbc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:12.380652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b1e02e8b-8db0-4112-bebf-9c4a431b76ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7271dc88f9a4462b37c6da30d930cbc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:12.382764 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:12.388659 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b1e02e8b-8db0-4112-bebf-9c4a431b76ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7271dc88f9a4462b37c6da30d930cbc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:12.401399 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1234/2496] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:12 2022] DELETE /identity/v3/users/a7271dc88f9a4462b37c6da30d930cbc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:12.405842 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3edb60-f693-4775-9426-0d81a7da25ca None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:12.406139 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3edb60-f693-4775-9426-0d81a7da25ca None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:12.406423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3edb60-f693-4775-9426-0d81a7da25ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:12.424903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ff3edb60-f693-4775-9426-0d81a7da25ca None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:12.426153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ff3edb60-f693-4775-9426-0d81a7da25ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:12.483831 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1263/2497] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:12.493920 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e02e8b-8db0-4112-bebf-9c4a431b76ce admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:12.495322 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b1e02e8b-8db0-4112-bebf-9c4a431b76ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:12.551189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e02e8b-8db0-4112-bebf-9c4a431b76ce admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:12.555429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90902e-26c3-4a30-94f9-eac5bb18e5a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:12.556065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90902e-26c3-4a30-94f9-eac5bb18e5a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:12.556353 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90902e-26c3-4a30-94f9-eac5bb18e5a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:12.556629 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90902e-26c3-4a30-94f9-eac5bb18e5a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:12.565859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90902e-26c3-4a30-94f9-eac5bb18e5a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:12.567269 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90902e-26c3-4a30-94f9-eac5bb18e5a6 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:12.577247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1235/2498] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:12.902689 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3edb60-f693-4775-9426-0d81a7da25ca None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:12.904161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ff3edb60-f693-4775-9426-0d81a7da25ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:12.916118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3edb60-f693-4775-9426-0d81a7da25ca None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:12.920978 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207426-bb51-4912-baa3-77c922150b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:12.922053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207426-bb51-4912-baa3-77c922150b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:12.922379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207426-bb51-4912-baa3-77c922150b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:12.922713 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207426-bb51-4912-baa3-77c922150b09 admin admin] PATH_INFO: `/v3/projects/ebb717f066f0457b8f9a80bb2d6f16b2` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:12.923956 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a207426-bb51-4912-baa3-77c922150b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb717f066f0457b8f9a80bb2d6f16b2)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:12.926205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a207426-bb51-4912-baa3-77c922150b09 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:12.988078 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a207426-bb51-4912-baa3-77c922150b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb717f066f0457b8f9a80bb2d6f16b2', 'request_id': 'req-0a207426-bb51-4912-baa3-77c922150b09'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:12.994703 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a207426-bb51-4912-baa3-77c922150b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb717f066f0457b8f9a80bb2d6f16b2', 'request_id': 'req-0a207426-bb51-4912-baa3-77c922150b09'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:13.000436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a207426-bb51-4912-baa3-77c922150b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb717f066f0457b8f9a80bb2d6f16b2', 'request_id': 'req-0a207426-bb51-4912-baa3-77c922150b09'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:13.012520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a207426-bb51-4912-baa3-77c922150b09 admin admin] The token cache is being invalidate because project ebb717f066f0457b8f9a80bb2d6f16b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:13.012813 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a207426-bb51-4912-baa3-77c922150b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:13.013511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a207426-bb51-4912-baa3-77c922150b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:13.015058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1264/2499] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:12 2022] DELETE /identity/v3/projects/ebb717f066f0457b8f9a80bb2d6f16b2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:13.019145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90902e-26c3-4a30-94f9-eac5bb18e5a6 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:13.029259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90902e-26c3-4a30-94f9-eac5bb18e5a6 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:13.084301 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8eb270-09b6-405f-85e0-7f6919e19222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:13.085841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8eb270-09b6-405f-85e0-7f6919e19222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:13.086121 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8eb270-09b6-405f-85e0-7f6919e19222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:13.086394 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8eb270-09b6-405f-85e0-7f6919e19222 admin admin] PATH_INFO: `/v3/users/a538729885bf4eb29a52686d6016dadd` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:13.087585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8eb270-09b6-405f-85e0-7f6919e19222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a538729885bf4eb29a52686d6016dadd)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:13.089537 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8eb270-09b6-405f-85e0-7f6919e19222 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:13.132023 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3c8eb270-09b6-405f-85e0-7f6919e19222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a538729885bf4eb29a52686d6016dadd'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:13.144116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3c8eb270-09b6-405f-85e0-7f6919e19222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a538729885bf4eb29a52686d6016dadd'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:13.144772 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3c8eb270-09b6-405f-85e0-7f6919e19222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a538729885bf4eb29a52686d6016dadd'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:13.145391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3c8eb270-09b6-405f-85e0-7f6919e19222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a538729885bf4eb29a52686d6016dadd'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:13.152802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3c8eb270-09b6-405f-85e0-7f6919e19222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a538729885bf4eb29a52686d6016dadd'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:13.164780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1236/2500] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:13 2022] DELETE /identity/v3/users/a538729885bf4eb29a52686d6016dadd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:13.437776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207426-bb51-4912-baa3-77c922150b09 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:13.439223 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0a207426-bb51-4912-baa3-77c922150b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:13.457955 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207426-bb51-4912-baa3-77c922150b09 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:13.514992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fde44-fc53-4b44-9f70-01cdd2d6ff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:13.515783 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fde44-fc53-4b44-9f70-01cdd2d6ff0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:13.516067 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fde44-fc53-4b44-9f70-01cdd2d6ff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:13.516343 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fde44-fc53-4b44-9f70-01cdd2d6ff0f admin admin] PATH_INFO: `/v3/projects/ecf85cad1cd1421f9d2d1e4cbabe4ad1` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:13.517558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fde44-fc53-4b44-9f70-01cdd2d6ff0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf85cad1cd1421f9d2d1e4cbabe4ad1)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:13.520233 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fde44-fc53-4b44-9f70-01cdd2d6ff0f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:13.543545 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:13.566616 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-244fde44-fc53-4b44-9f70-01cdd2d6ff0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf85cad1cd1421f9d2d1e4cbabe4ad1', 'request_id': 'req-244fde44-fc53-4b44-9f70-01cdd2d6ff0f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:13.574093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-244fde44-fc53-4b44-9f70-01cdd2d6ff0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf85cad1cd1421f9d2d1e4cbabe4ad1', 'request_id': 'req-244fde44-fc53-4b44-9f70-01cdd2d6ff0f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:13.579654 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-244fde44-fc53-4b44-9f70-01cdd2d6ff0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf85cad1cd1421f9d2d1e4cbabe4ad1', 'request_id': 'req-244fde44-fc53-4b44-9f70-01cdd2d6ff0f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:13.590731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-244fde44-fc53-4b44-9f70-01cdd2d6ff0f admin admin] The token cache is being invalidate because project ecf85cad1cd1421f9d2d1e4cbabe4ad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:13.591021 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-244fde44-fc53-4b44-9f70-01cdd2d6ff0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:13.591681 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-244fde44-fc53-4b44-9f70-01cdd2d6ff0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:13.593253 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1265/2501] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:13 2022] DELETE /identity/v3/projects/ecf85cad1cd1421f9d2d1e4cbabe4ad1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:13.598149 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8c39a-bf7f-47bd-aa1f-799b63b46c4d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:13.598603 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8c39a-bf7f-47bd-aa1f-799b63b46c4d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:13.598724 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8c39a-bf7f-47bd-aa1f-799b63b46c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:13.606334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:13.618243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-07e8c39a-bf7f-47bd-aa1f-799b63b46c4d None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:13.619416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-07e8c39a-bf7f-47bd-aa1f-799b63b46c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:13.675461 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1237/2502] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:13.683646 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba6221-fe55-42c9-bc28-a23737380987 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:13.683941 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba6221-fe55-42c9-bc28-a23737380987 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:13.684224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba6221-fe55-42c9-bc28-a23737380987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:13.701970 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-29ba6221-fe55-42c9-bc28-a23737380987 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:13.703161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-29ba6221-fe55-42c9-bc28-a23737380987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:13.711042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1266/2503] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:13.714996 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8c39a-bf7f-47bd-aa1f-799b63b46c4d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:13.724985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8c39a-bf7f-47bd-aa1f-799b63b46c4d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:13.729950 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5e41b-41c1-4908-b9d6-697df2f65e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:13.730582 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5e41b-41c1-4908-b9d6-697df2f65e8e admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:13.730860 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5e41b-41c1-4908-b9d6-697df2f65e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:13.731133 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5e41b-41c1-4908-b9d6-697df2f65e8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:13.731838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5e41b-41c1-4908-b9d6-697df2f65e8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:20:13.732138 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5e41b-41c1-4908-b9d6-697df2f65e8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:13.733746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5e41b-41c1-4908-b9d6-697df2f65e8e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:13.745384 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1238/2504] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:20:13.749476 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba6221-fe55-42c9-bc28-a23737380987 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:13.758614 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba6221-fe55-42c9-bc28-a23737380987 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:13.763283 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384dce8-f857-4f98-9b5d-23e128ccb6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:13.763921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384dce8-f857-4f98-9b5d-23e128ccb6bd admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:13.764203 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384dce8-f857-4f98-9b5d-23e128ccb6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:13.764480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384dce8-f857-4f98-9b5d-23e128ccb6bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:13.765211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384dce8-f857-4f98-9b5d-23e128ccb6bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:13.767110 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384dce8-f857-4f98-9b5d-23e128ccb6bd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:13.793039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1267/2505] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:20:13 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:13.796952 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5e41b-41c1-4908-b9d6-697df2f65e8e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:13.807209 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5e41b-41c1-4908-b9d6-697df2f65e8e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:13.861384 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0c4ec-4916-4f0d-a110-b1c1f4973cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:13.862068 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0c4ec-4916-4f0d-a110-b1c1f4973cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:13.862357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0c4ec-4916-4f0d-a110-b1c1f4973cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:13.862634 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0c4ec-4916-4f0d-a110-b1c1f4973cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:13.863314 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0c4ec-4916-4f0d-a110-b1c1f4973cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:13.865218 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0c4ec-4916-4f0d-a110-b1c1f4973cd9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:13.885355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1239/2506] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:20:13 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:13.889482 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384dce8-f857-4f98-9b5d-23e128ccb6bd admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:13.899756 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384dce8-f857-4f98-9b5d-23e128ccb6bd admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:13.904311 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f842d9a-9679-418a-b8ba-51e336412492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:13.904959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f842d9a-9679-418a-b8ba-51e336412492 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:13.905242 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f842d9a-9679-418a-b8ba-51e336412492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:13.905556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f842d9a-9679-418a-b8ba-51e336412492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:13.906281 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f842d9a-9679-418a-b8ba-51e336412492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:13.907868 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f842d9a-9679-418a-b8ba-51e336412492 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:13.918608 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1268/2507] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:13.922339 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0c4ec-4916-4f0d-a110-b1c1f4973cd9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:13.932857 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0c4ec-4916-4f0d-a110-b1c1f4973cd9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:13.937623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f04e34-f7e7-4d0b-b031-a1dffc99822d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:13.938299 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f04e34-f7e7-4d0b-b031-a1dffc99822d admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:13.938582 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f04e34-f7e7-4d0b-b031-a1dffc99822d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:13.938857 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f04e34-f7e7-4d0b-b031-a1dffc99822d admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:13.939573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f04e34-f7e7-4d0b-b031-a1dffc99822d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:13.941185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f04e34-f7e7-4d0b-b031-a1dffc99822d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:13.952996 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1240/2508] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:13.956728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f842d9a-9679-418a-b8ba-51e336412492 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:13.967103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f842d9a-9679-418a-b8ba-51e336412492 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:13.971828 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b8a27-11c5-4df2-b198-04a9ee16da59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:13.972707 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b8a27-11c5-4df2-b198-04a9ee16da59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:13.972988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b8a27-11c5-4df2-b198-04a9ee16da59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:13.973264 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b8a27-11c5-4df2-b198-04a9ee16da59 admin admin] PATH_INFO: `/v3/projects/d63503fb439548559fca6a67edba9714/users/8979fd758e2544a1b9fe8905145879c1/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:13.988387 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b8a27-11c5-4df2-b198-04a9ee16da59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63503fb439548559fca6a67edba9714, user_id=8979fd758e2544a1b9fe8905145879c1, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:13.991142 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b8a27-11c5-4df2-b198-04a9ee16da59 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:14.005013 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1269/2509] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:13 2022] PUT /identity/v3/projects/d63503fb439548559fca6a67edba9714/users/8979fd758e2544a1b9fe8905145879c1/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:14.016281 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8ad08-24bd-494b-a15f-6e8bb646a1a0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:14.016579 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8ad08-24bd-494b-a15f-6e8bb646a1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:14.016927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8ad08-24bd-494b-a15f-6e8bb646a1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:14.044619 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4cd8ad08-24bd-494b-a15f-6e8bb646a1a0 None None] MFA Rules not processed for user `8979fd758e2544a1b9fe8905145879c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:14.045839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4cd8ad08-24bd-494b-a15f-6e8bb646a1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:14.111684 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:14.115916 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1241/2510] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:14.120364 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b8a27-11c5-4df2-b198-04a9ee16da59 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:14.183189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b8a27-11c5-4df2-b198-04a9ee16da59 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:14.187930 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3c199-a78e-4714-bb20-c87da39ef66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:14.188583 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3c199-a78e-4714-bb20-c87da39ef66c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:14.188875 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3c199-a78e-4714-bb20-c87da39ef66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:14.189154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3c199-a78e-4714-bb20-c87da39ef66c admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:14.189872 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3c199-a78e-4714-bb20-c87da39ef66c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:14.191787 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3c199-a78e-4714-bb20-c87da39ef66c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:14.219525 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1270/2511] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:20:14 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:14.223770 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8ad08-24bd-494b-a15f-6e8bb646a1a0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:14.235299 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8ad08-24bd-494b-a15f-6e8bb646a1a0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:14.291168 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a48f04-7eec-4708-9d2c-45383423b5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:14.291849 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a48f04-7eec-4708-9d2c-45383423b5bf admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:14.292137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a48f04-7eec-4708-9d2c-45383423b5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:14.292419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a48f04-7eec-4708-9d2c-45383423b5bf admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:14.293153 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a48f04-7eec-4708-9d2c-45383423b5bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:14.295686 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a48f04-7eec-4708-9d2c-45383423b5bf admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:14.315330 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1242/2512] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:20:14 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:14.319673 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3c199-a78e-4714-bb20-c87da39ef66c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:14.329964 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3c199-a78e-4714-bb20-c87da39ef66c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:14.334543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f5e6a-e085-4269-8e1f-44e5f5c2cb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:14.335708 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f5e6a-e085-4269-8e1f-44e5f5c2cb0a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:14.335987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f5e6a-e085-4269-8e1f-44e5f5c2cb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:14.336261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f5e6a-e085-4269-8e1f-44e5f5c2cb0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:14.336976 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f5e6a-e085-4269-8e1f-44e5f5c2cb0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:14.338603 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f5e6a-e085-4269-8e1f-44e5f5c2cb0a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:14.348846 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1271/2513] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:14.352768 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a48f04-7eec-4708-9d2c-45383423b5bf admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:14.362600 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a48f04-7eec-4708-9d2c-45383423b5bf admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:14.367293 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc7e57-c807-44cc-a58a-bd86607b28a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:14.368160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc7e57-c807-44cc-a58a-bd86607b28a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:14.368445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc7e57-c807-44cc-a58a-bd86607b28a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:14.368721 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc7e57-c807-44cc-a58a-bd86607b28a9 admin admin] PATH_INFO: `/v3/projects/e40b998d52f646c99860559ab8ee2fd9/users/44e7d8cf89c14a3887febe5edd76c89e/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:14.383771 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc7e57-c807-44cc-a58a-bd86607b28a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40b998d52f646c99860559ab8ee2fd9, user_id=44e7d8cf89c14a3887febe5edd76c89e, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:14.386683 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc7e57-c807-44cc-a58a-bd86607b28a9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:14.399881 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1243/2514] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:14 2022] PUT /identity/v3/projects/e40b998d52f646c99860559ab8ee2fd9/users/44e7d8cf89c14a3887febe5edd76c89e/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:14.403720 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f5e6a-e085-4269-8e1f-44e5f5c2cb0a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:14.413636 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f5e6a-e085-4269-8e1f-44e5f5c2cb0a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:14.431084 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:14.470875 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ece6e6-c9fc-43bd-9dc9-3c3dba81cf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:14.471535 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ece6e6-c9fc-43bd-9dc9-3c3dba81cf83 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:14.471807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ece6e6-c9fc-43bd-9dc9-3c3dba81cf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:14.472091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ece6e6-c9fc-43bd-9dc9-3c3dba81cf83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:14.472795 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ece6e6-c9fc-43bd-9dc9-3c3dba81cf83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:14.474427 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ece6e6-c9fc-43bd-9dc9-3c3dba81cf83 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:14.484498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1272/2515] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:14.488671 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc7e57-c807-44cc-a58a-bd86607b28a9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:14.493471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ece6e6-c9fc-43bd-9dc9-3c3dba81cf83 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:14.495466 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-05ece6e6-c9fc-43bd-9dc9-3c3dba81cf83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:14.499359 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc7e57-c807-44cc-a58a-bd86607b28a9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:14.504069 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd4bc1-f1db-4e5b-969c-ae42570f377e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:14.504954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd4bc1-f1db-4e5b-969c-ae42570f377e admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:14.505234 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd4bc1-f1db-4e5b-969c-ae42570f377e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:14.505557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd4bc1-f1db-4e5b-969c-ae42570f377e admin admin] PATH_INFO: `/v3/projects/e40b998d52f646c99860559ab8ee2fd9/users/44e7d8cf89c14a3887febe5edd76c89e/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:14.508440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd4bc1-f1db-4e5b-969c-ae42570f377e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40b998d52f646c99860559ab8ee2fd9, user_id=44e7d8cf89c14a3887febe5edd76c89e, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:14.511848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd4bc1-f1db-4e5b-969c-ae42570f377e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:14.523115 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1244/2516] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:14 2022] PUT /identity/v3/projects/e40b998d52f646c99860559ab8ee2fd9/users/44e7d8cf89c14a3887febe5edd76c89e/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:14.532805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2120e-f76a-4653-8942-d0098778ec68 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:14.533171 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2120e-f76a-4653-8942-d0098778ec68 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:14.533480 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2120e-f76a-4653-8942-d0098778ec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:14.554985 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ece6e6-c9fc-43bd-9dc9-3c3dba81cf83 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:14.558965 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-91d2120e-f76a-4653-8942-d0098778ec68 None None] MFA Rules not processed for user `44e7d8cf89c14a3887febe5edd76c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:14.560160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-91d2120e-f76a-4653-8942-d0098778ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:14.604288 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e551b46-98ce-4871-82ef-925fa0071abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:14.604953 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e551b46-98ce-4871-82ef-925fa0071abb service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:14.605215 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e551b46-98ce-4871-82ef-925fa0071abb service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:14.605526 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e551b46-98ce-4871-82ef-925fa0071abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:14.607311 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0e551b46-98ce-4871-82ef-925fa0071abb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:14.616489 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e551b46-98ce-4871-82ef-925fa0071abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:14.617945 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e551b46-98ce-4871-82ef-925fa0071abb service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:14.625793 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1273/2517] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:20:14.632192 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1245/2518] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:20:14.643123 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e551b46-98ce-4871-82ef-925fa0071abb service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:14.644774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0e551b46-98ce-4871-82ef-925fa0071abb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:14.703123 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e551b46-98ce-4871-82ef-925fa0071abb service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:14.706850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f8d27-437f-4030-b379-a0476fd28a00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:14.707500 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8d27-437f-4030-b379-a0476fd28a00 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:14.707786 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8d27-437f-4030-b379-a0476fd28a00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:14.708064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8d27-437f-4030-b379-a0476fd28a00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:14.717498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f8d27-437f-4030-b379-a0476fd28a00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:14.718940 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f8d27-437f-4030-b379-a0476fd28a00 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:14.728728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1274/2519] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:14 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:16.104876 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2120e-f76a-4653-8942-d0098778ec68 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:16.160915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:16.185076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2120e-f76a-4653-8942-d0098778ec68 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:16.190445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32a0a9-9271-40b2-8d1d-c19555413bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:16.191322 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32a0a9-9271-40b2-8d1d-c19555413bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:16.191610 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32a0a9-9271-40b2-8d1d-c19555413bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:16.191976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32a0a9-9271-40b2-8d1d-c19555413bbb admin admin] PATH_INFO: `/v3/users/8979fd758e2544a1b9fe8905145879c1` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:16.193250 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32a0a9-9271-40b2-8d1d-c19555413bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8979fd758e2544a1b9fe8905145879c1)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:16.195773 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32a0a9-9271-40b2-8d1d-c19555413bbb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:16.249883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6e32a0a9-9271-40b2-8d1d-c19555413bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8979fd758e2544a1b9fe8905145879c1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:16.265180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6e32a0a9-9271-40b2-8d1d-c19555413bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8979fd758e2544a1b9fe8905145879c1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:16.265964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6e32a0a9-9271-40b2-8d1d-c19555413bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8979fd758e2544a1b9fe8905145879c1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:16.266601 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6e32a0a9-9271-40b2-8d1d-c19555413bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8979fd758e2544a1b9fe8905145879c1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:16.275337 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6e32a0a9-9271-40b2-8d1d-c19555413bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8979fd758e2544a1b9fe8905145879c1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:16.288944 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1246/2520] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:16 2022] DELETE /identity/v3/users/8979fd758e2544a1b9fe8905145879c1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:16.293692 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b61723-6e9b-4aa1-a5a4-57a7cc1120e7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:16.294156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b61723-6e9b-4aa1-a5a4-57a7cc1120e7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:16.294303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b61723-6e9b-4aa1-a5a4-57a7cc1120e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:16.313583 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-37b61723-6e9b-4aa1-a5a4-57a7cc1120e7 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:16.315096 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-37b61723-6e9b-4aa1-a5a4-57a7cc1120e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:16.330699 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:16.392471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1275/2521] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:16.403356 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32a0a9-9271-40b2-8d1d-c19555413bbb admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:16.405351 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6e32a0a9-9271-40b2-8d1d-c19555413bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:16.469443 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32a0a9-9271-40b2-8d1d-c19555413bbb admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:16.473757 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c46520-445e-4e5c-acfd-0e4f5c1ce94a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:16.474418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c46520-445e-4e5c-acfd-0e4f5c1ce94a service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:16.474702 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c46520-445e-4e5c-acfd-0e4f5c1ce94a service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:16.474980 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c46520-445e-4e5c-acfd-0e4f5c1ce94a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:16.485574 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c46520-445e-4e5c-acfd-0e4f5c1ce94a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:16.487259 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c46520-445e-4e5c-acfd-0e4f5c1ce94a service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:16.497503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1247/2522] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:16.819904 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b61723-6e9b-4aa1-a5a4-57a7cc1120e7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:16.821336 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-37b61723-6e9b-4aa1-a5a4-57a7cc1120e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:16.848941 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b61723-6e9b-4aa1-a5a4-57a7cc1120e7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:16.854209 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce9b13-69e3-4918-b820-a0604d5642c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:16.855210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce9b13-69e3-4918-b820-a0604d5642c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:16.855496 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce9b13-69e3-4918-b820-a0604d5642c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:16.855765 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce9b13-69e3-4918-b820-a0604d5642c1 admin admin] PATH_INFO: `/v3/projects/d63503fb439548559fca6a67edba9714` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:16.856977 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce9b13-69e3-4918-b820-a0604d5642c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63503fb439548559fca6a67edba9714)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:16.858981 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce9b13-69e3-4918-b820-a0604d5642c1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:16.918953 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-60ce9b13-69e3-4918-b820-a0604d5642c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63503fb439548559fca6a67edba9714', 'request_id': 'req-60ce9b13-69e3-4918-b820-a0604d5642c1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:16.926486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-60ce9b13-69e3-4918-b820-a0604d5642c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63503fb439548559fca6a67edba9714', 'request_id': 'req-60ce9b13-69e3-4918-b820-a0604d5642c1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:16.933302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-60ce9b13-69e3-4918-b820-a0604d5642c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63503fb439548559fca6a67edba9714', 'request_id': 'req-60ce9b13-69e3-4918-b820-a0604d5642c1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:16.944700 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-60ce9b13-69e3-4918-b820-a0604d5642c1 admin admin] The token cache is being invalidate because project d63503fb439548559fca6a67edba9714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:16.944991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-60ce9b13-69e3-4918-b820-a0604d5642c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:16.945670 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-60ce9b13-69e3-4918-b820-a0604d5642c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:16.947248 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1276/2523] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:16 2022] DELETE /identity/v3/projects/d63503fb439548559fca6a67edba9714 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:16.951317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c46520-445e-4e5c-acfd-0e4f5c1ce94a service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:16.962848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c46520-445e-4e5c-acfd-0e4f5c1ce94a service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:17.015721 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160c355-bb56-4818-bdaf-c4e2b85af260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:17.016577 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160c355-bb56-4818-bdaf-c4e2b85af260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:17.016853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160c355-bb56-4818-bdaf-c4e2b85af260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:17.017123 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160c355-bb56-4818-bdaf-c4e2b85af260 admin admin] PATH_INFO: `/v3/users/44e7d8cf89c14a3887febe5edd76c89e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:17.018564 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160c355-bb56-4818-bdaf-c4e2b85af260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e7d8cf89c14a3887febe5edd76c89e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:17.020459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160c355-bb56-4818-bdaf-c4e2b85af260 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:17.022501 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:17.066706 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3160c355-bb56-4818-bdaf-c4e2b85af260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e7d8cf89c14a3887febe5edd76c89e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:17.079876 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3160c355-bb56-4818-bdaf-c4e2b85af260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e7d8cf89c14a3887febe5edd76c89e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:17.080617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3160c355-bb56-4818-bdaf-c4e2b85af260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e7d8cf89c14a3887febe5edd76c89e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:17.081265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3160c355-bb56-4818-bdaf-c4e2b85af260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e7d8cf89c14a3887febe5edd76c89e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:17.090996 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3160c355-bb56-4818-bdaf-c4e2b85af260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e7d8cf89c14a3887febe5edd76c89e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:17.104478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1248/2524] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:16 2022] DELETE /identity/v3/users/44e7d8cf89c14a3887febe5edd76c89e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:17.393825 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce9b13-69e3-4918-b820-a0604d5642c1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:17.395685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-60ce9b13-69e3-4918-b820-a0604d5642c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:17.408869 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce9b13-69e3-4918-b820-a0604d5642c1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:17.468607 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e702788-b1b5-4a5a-94b4-0fe35bc5d00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:17.468607 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e702788-b1b5-4a5a-94b4-0fe35bc5d00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:17.468607 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e702788-b1b5-4a5a-94b4-0fe35bc5d00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:17.470533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e702788-b1b5-4a5a-94b4-0fe35bc5d00d admin admin] PATH_INFO: `/v3/projects/e40b998d52f646c99860559ab8ee2fd9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:17.470533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e702788-b1b5-4a5a-94b4-0fe35bc5d00d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e40b998d52f646c99860559ab8ee2fd9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:17.472331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e702788-b1b5-4a5a-94b4-0fe35bc5d00d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:17.517120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:17.521259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e702788-b1b5-4a5a-94b4-0fe35bc5d00d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e40b998d52f646c99860559ab8ee2fd9', 'request_id': 'req-3e702788-b1b5-4a5a-94b4-0fe35bc5d00d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:17.532705 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e702788-b1b5-4a5a-94b4-0fe35bc5d00d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e40b998d52f646c99860559ab8ee2fd9', 'request_id': 'req-3e702788-b1b5-4a5a-94b4-0fe35bc5d00d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:17.536729 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e702788-b1b5-4a5a-94b4-0fe35bc5d00d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e40b998d52f646c99860559ab8ee2fd9', 'request_id': 'req-3e702788-b1b5-4a5a-94b4-0fe35bc5d00d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:17.548897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e702788-b1b5-4a5a-94b4-0fe35bc5d00d admin admin] The token cache is being invalidate because project e40b998d52f646c99860559ab8ee2fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:17.549304 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e702788-b1b5-4a5a-94b4-0fe35bc5d00d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:17.549982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e702788-b1b5-4a5a-94b4-0fe35bc5d00d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:17.551712 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1277/2525] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:17 2022] DELETE /identity/v3/projects/e40b998d52f646c99860559ab8ee2fd9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:17.557068 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f7373-b783-487a-836d-018014048e11 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:17.557699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f7373-b783-487a-836d-018014048e11 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:17.557799 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f7373-b783-487a-836d-018014048e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:17.576551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8d8f7373-b783-487a-836d-018014048e11 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:17.577915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8d8f7373-b783-487a-836d-018014048e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:17.637054 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1249/2526] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:17.645243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd5d83-c426-4ab6-b7ef-9d584f171318 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:17.645585 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd5d83-c426-4ab6-b7ef-9d584f171318 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:17.645868 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd5d83-c426-4ab6-b7ef-9d584f171318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:17.664222 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-65dd5d83-c426-4ab6-b7ef-9d584f171318 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:17.665435 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-65dd5d83-c426-4ab6-b7ef-9d584f171318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:17.673270 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1278/2527] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:17.677223 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f7373-b783-487a-836d-018014048e11 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:17.687456 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f7373-b783-487a-836d-018014048e11 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:17.692130 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45dc288-13eb-4879-97fa-7d00bd992bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:17.692769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45dc288-13eb-4879-97fa-7d00bd992bdd admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:17.693049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45dc288-13eb-4879-97fa-7d00bd992bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:17.693318 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45dc288-13eb-4879-97fa-7d00bd992bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:17.694082 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45dc288-13eb-4879-97fa-7d00bd992bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:20:17.694381 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45dc288-13eb-4879-97fa-7d00bd992bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:17.696138 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45dc288-13eb-4879-97fa-7d00bd992bdd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:17.707541 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1250/2528] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:20:17.712262 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd5d83-c426-4ab6-b7ef-9d584f171318 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:17.721726 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd5d83-c426-4ab6-b7ef-9d584f171318 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:17.726929 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5bfea-eba3-4b3d-bf52-cd171c29cd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:17.727742 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5bfea-eba3-4b3d-bf52-cd171c29cd94 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:17.728021 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5bfea-eba3-4b3d-bf52-cd171c29cd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:17.728328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5bfea-eba3-4b3d-bf52-cd171c29cd94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:17.729013 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5bfea-eba3-4b3d-bf52-cd171c29cd94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:17.730973 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5bfea-eba3-4b3d-bf52-cd171c29cd94 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:17.756194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1279/2529] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:20:17 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:17.761353 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45dc288-13eb-4879-97fa-7d00bd992bdd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:17.771957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45dc288-13eb-4879-97fa-7d00bd992bdd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:17.830003 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236d52b-8b86-4416-ab08-30e0639f11b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:17.830697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236d52b-8b86-4416-ab08-30e0639f11b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:17.830974 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236d52b-8b86-4416-ab08-30e0639f11b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:17.831244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236d52b-8b86-4416-ab08-30e0639f11b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:17.831954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236d52b-8b86-4416-ab08-30e0639f11b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:17.833949 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236d52b-8b86-4416-ab08-30e0639f11b3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:17.843780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:17.858388 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1251/2530] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:20:17 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:20:17.859521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5bfea-eba3-4b3d-bf52-cd171c29cd94 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:17.870329 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5bfea-eba3-4b3d-bf52-cd171c29cd94 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:17.874891 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6c98b-f580-4b8d-bd72-f9db82b1de1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:17.875539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6c98b-f580-4b8d-bd72-f9db82b1de1d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:17.875819 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6c98b-f580-4b8d-bd72-f9db82b1de1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:17.876095 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6c98b-f580-4b8d-bd72-f9db82b1de1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:17.876821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6c98b-f580-4b8d-bd72-f9db82b1de1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:17.878459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6c98b-f580-4b8d-bd72-f9db82b1de1d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:17.889921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1280/2531] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:17.893616 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236d52b-8b86-4416-ab08-30e0639f11b3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:17.906451 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236d52b-8b86-4416-ab08-30e0639f11b3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:17.911212 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00173a57-f999-4338-a698-9eff8a9237b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:17.911888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00173a57-f999-4338-a698-9eff8a9237b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:17.912167 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00173a57-f999-4338-a698-9eff8a9237b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:17.912464 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00173a57-f999-4338-a698-9eff8a9237b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:17.913225 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00173a57-f999-4338-a698-9eff8a9237b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:17.914822 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00173a57-f999-4338-a698-9eff8a9237b2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:17.924584 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1252/2532] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:17.929200 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6c98b-f580-4b8d-bd72-f9db82b1de1d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:17.939160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6c98b-f580-4b8d-bd72-f9db82b1de1d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:17.944361 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb8da2-dbbf-452e-a7bb-506488bbf51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:17.945226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb8da2-dbbf-452e-a7bb-506488bbf51a admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:17.945550 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb8da2-dbbf-452e-a7bb-506488bbf51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:17.945828 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb8da2-dbbf-452e-a7bb-506488bbf51a admin admin] PATH_INFO: `/v3/projects/db0769cc6b324aaea4a42f6535b89655/users/b6fc1cf7837b43308686b4af278149d6/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:17.959974 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb8da2-dbbf-452e-a7bb-506488bbf51a admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0769cc6b324aaea4a42f6535b89655, user_id=b6fc1cf7837b43308686b4af278149d6, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:17.962734 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb8da2-dbbf-452e-a7bb-506488bbf51a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:17.976930 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1281/2533] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:17 2022] PUT /identity/v3/projects/db0769cc6b324aaea4a42f6535b89655/users/b6fc1cf7837b43308686b4af278149d6/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:17.987774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf08387-3389-4532-829c-99b4066f0a16 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:17.988067 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf08387-3389-4532-829c-99b4066f0a16 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:17.988339 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf08387-3389-4532-829c-99b4066f0a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:18.016718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4bf08387-3389-4532-829c-99b4066f0a16 None None] MFA Rules not processed for user `b6fc1cf7837b43308686b4af278149d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:18.017929 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4bf08387-3389-4532-829c-99b4066f0a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:18.086390 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1253/2534] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:18.091134 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb8da2-dbbf-452e-a7bb-506488bbf51a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:18.158510 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb8da2-dbbf-452e-a7bb-506488bbf51a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:18.163112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2a1fe-3714-4b9d-a4be-10645185cfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:18.163773 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2a1fe-3714-4b9d-a4be-10645185cfa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:18.164127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2a1fe-3714-4b9d-a4be-10645185cfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:18.164318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2a1fe-3714-4b9d-a4be-10645185cfa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:18.165150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2a1fe-3714-4b9d-a4be-10645185cfa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:18.166928 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2a1fe-3714-4b9d-a4be-10645185cfa7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:18.196996 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1282/2535] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:20:18 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:18.202646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf08387-3389-4532-829c-99b4066f0a16 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:18.213409 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf08387-3389-4532-829c-99b4066f0a16 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:18.273232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bb3d9-2bc3-4d38-b470-8a70c3690b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:18.273966 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bb3d9-2bc3-4d38-b470-8a70c3690b6a admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:18.274240 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bb3d9-2bc3-4d38-b470-8a70c3690b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:18.274516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bb3d9-2bc3-4d38-b470-8a70c3690b6a admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:18.275202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bb3d9-2bc3-4d38-b470-8a70c3690b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:18.277194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bb3d9-2bc3-4d38-b470-8a70c3690b6a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:18.301636 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1254/2536] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:20:18 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:18.303079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2a1fe-3714-4b9d-a4be-10645185cfa7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:18.313801 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2a1fe-3714-4b9d-a4be-10645185cfa7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:18.318493 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a772cf1-24fc-46d9-b8c8-0a9354d0aef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:18.319176 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772cf1-24fc-46d9-b8c8-0a9354d0aef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:18.319460 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772cf1-24fc-46d9-b8c8-0a9354d0aef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:18.319735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772cf1-24fc-46d9-b8c8-0a9354d0aef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:18.320656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a772cf1-24fc-46d9-b8c8-0a9354d0aef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:18.322482 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a772cf1-24fc-46d9-b8c8-0a9354d0aef2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:18.334297 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1283/2537] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:18.338217 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bb3d9-2bc3-4d38-b470-8a70c3690b6a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:18.348262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bb3d9-2bc3-4d38-b470-8a70c3690b6a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:18.349753 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a772cf1-24fc-46d9-b8c8-0a9354d0aef2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:18.352061 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8a772cf1-24fc-46d9-b8c8-0a9354d0aef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:18.353520 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23da5e-14dc-4f9f-82ef-8aeb1b4a197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:18.354400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23da5e-14dc-4f9f-82ef-8aeb1b4a197b admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:18.354676 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23da5e-14dc-4f9f-82ef-8aeb1b4a197b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:18.354947 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23da5e-14dc-4f9f-82ef-8aeb1b4a197b admin admin] PATH_INFO: `/v3/projects/5a7c7d16b4844df1a99cc0e6765e3741/users/2844ed9ff4a74adf9ed139e47d29e72e/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:18.364708 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a772cf1-24fc-46d9-b8c8-0a9354d0aef2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:18.369922 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74644968-e5bd-43d0-83f2-a48ad9f3ae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:18.370389 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23da5e-14dc-4f9f-82ef-8aeb1b4a197b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7c7d16b4844df1a99cc0e6765e3741, user_id=2844ed9ff4a74adf9ed139e47d29e72e, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:18.370774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74644968-e5bd-43d0-83f2-a48ad9f3ae3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:18.371053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74644968-e5bd-43d0-83f2-a48ad9f3ae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:18.371365 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74644968-e5bd-43d0-83f2-a48ad9f3ae3e admin admin] PATH_INFO: `/v3/users/2107693081d5494197b28c9a41fa970c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:18.372543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74644968-e5bd-43d0-83f2-a48ad9f3ae3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2107693081d5494197b28c9a41fa970c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:18.373021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23da5e-14dc-4f9f-82ef-8aeb1b4a197b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:18.374480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74644968-e5bd-43d0-83f2-a48ad9f3ae3e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:18.386009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1255/2538] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:18 2022] PUT /identity/v3/projects/5a7c7d16b4844df1a99cc0e6765e3741/users/2844ed9ff4a74adf9ed139e47d29e72e/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:18.390159 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23da5e-14dc-4f9f-82ef-8aeb1b4a197b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:18.417759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:18.424445 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-74644968-e5bd-43d0-83f2-a48ad9f3ae3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2107693081d5494197b28c9a41fa970c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:18.436026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:18.439275 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-74644968-e5bd-43d0-83f2-a48ad9f3ae3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2107693081d5494197b28c9a41fa970c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:18.440086 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-74644968-e5bd-43d0-83f2-a48ad9f3ae3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2107693081d5494197b28c9a41fa970c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:18.440706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-74644968-e5bd-43d0-83f2-a48ad9f3ae3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2107693081d5494197b28c9a41fa970c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:18.447284 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-74644968-e5bd-43d0-83f2-a48ad9f3ae3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2107693081d5494197b28c9a41fa970c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:18.460146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23da5e-14dc-4f9f-82ef-8aeb1b4a197b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:18.460302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1284/2539] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:18 2022] DELETE /identity/v3/users/2107693081d5494197b28c9a41fa970c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:20:18.464612 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a18a0-5afb-4a66-a845-995b9ba08c2d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:18.464907 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a18a0-5afb-4a66-a845-995b9ba08c2d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:18.465188 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a18a0-5afb-4a66-a845-995b9ba08c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:18.486276 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-128a18a0-5afb-4a66-a845-995b9ba08c2d None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:18.487455 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-128a18a0-5afb-4a66-a845-995b9ba08c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:18.517587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42544729-8ca4-45f8-982c-644618232e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:18.518280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42544729-8ca4-45f8-982c-644618232e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:18.518814 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42544729-8ca4-45f8-982c-644618232e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:18.519083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42544729-8ca4-45f8-982c-644618232e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:18.519829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42544729-8ca4-45f8-982c-644618232e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:18.521594 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42544729-8ca4-45f8-982c-644618232e54 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:18.535463 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1256/2540] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:20:18.536668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42544729-8ca4-45f8-982c-644618232e54 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:18.538904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-42544729-8ca4-45f8-982c-644618232e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:18.546469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1285/2541] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:20:18.550790 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42544729-8ca4-45f8-982c-644618232e54 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:18.555954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a8db0-cebc-4554-a4a9-830f93fe248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:18.556490 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a18a0-5afb-4a66-a845-995b9ba08c2d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:18.556826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a8db0-cebc-4554-a4a9-830f93fe248c admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:18.557104 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a8db0-cebc-4554-a4a9-830f93fe248c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:18.557617 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a8db0-cebc-4554-a4a9-830f93fe248c admin admin] PATH_INFO: `/v3/projects/5a7c7d16b4844df1a99cc0e6765e3741/users/2844ed9ff4a74adf9ed139e47d29e72e/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:18.557869 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-128a18a0-5afb-4a66-a845-995b9ba08c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:18.559336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a8db0-cebc-4554-a4a9-830f93fe248c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7c7d16b4844df1a99cc0e6765e3741, user_id=2844ed9ff4a74adf9ed139e47d29e72e, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:18.561986 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a8db0-cebc-4554-a4a9-830f93fe248c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:18.573027 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1257/2542] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:18 2022] PUT /identity/v3/projects/5a7c7d16b4844df1a99cc0e6765e3741/users/2844ed9ff4a74adf9ed139e47d29e72e/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:20:18.583348 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbbff9-2ee7-433a-8f54-feb9b613ee65 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:18.584074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbbff9-2ee7-433a-8f54-feb9b613ee65 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:18.584363 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbbff9-2ee7-433a-8f54-feb9b613ee65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:18.616626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a18a0-5afb-4a66-a845-995b9ba08c2d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:18.619901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-bbdbbff9-2ee7-433a-8f54-feb9b613ee65 None None] MFA Rules not processed for user `2844ed9ff4a74adf9ed139e47d29e72e`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:18.621115 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bbdbbff9-2ee7-433a-8f54-feb9b613ee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:18.672123 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b389c-85b2-4717-a977-876d9ccaa35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:18.672695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b389c-85b2-4717-a977-876d9ccaa35c service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:18.672971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b389c-85b2-4717-a977-876d9ccaa35c service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:18.673253 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b389c-85b2-4717-a977-876d9ccaa35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:18.714064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1258/2543] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:20:18.719543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:18.726774 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbbff9-2ee7-433a-8f54-feb9b613ee65 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:18.728469 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bbdbbff9-2ee7-433a-8f54-feb9b613ee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:18.757255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b389c-85b2-4717-a977-876d9ccaa35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:18.758949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b389c-85b2-4717-a977-876d9ccaa35c service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:18.769017 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1286/2544] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:18.785209 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbbff9-2ee7-433a-8f54-feb9b613ee65 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:18.789861 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a4182-e4d5-4dfa-8cdc-3ad1c01c3686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:18.790520 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a4182-e4d5-4dfa-8cdc-3ad1c01c3686 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:18.790799 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a4182-e4d5-4dfa-8cdc-3ad1c01c3686 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:18.791075 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a4182-e4d5-4dfa-8cdc-3ad1c01c3686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:18.800265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a4182-e4d5-4dfa-8cdc-3ad1c01c3686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:18.801710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a4182-e4d5-4dfa-8cdc-3ad1c01c3686 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:18.805990 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:18.812565 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1259/2545] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:18 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:20:18.895502 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b389c-85b2-4717-a977-876d9ccaa35c service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:18.905516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b389c-85b2-4717-a977-876d9ccaa35c service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:18.909217 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357d9f9-dd1e-4265-8f7e-a756e87f2dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:18.909882 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357d9f9-dd1e-4265-8f7e-a756e87f2dca service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:18.910161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357d9f9-dd1e-4265-8f7e-a756e87f2dca service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:18.910430 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357d9f9-dd1e-4265-8f7e-a756e87f2dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:18.912258 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e357d9f9-dd1e-4265-8f7e-a756e87f2dca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:18.991921 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357d9f9-dd1e-4265-8f7e-a756e87f2dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:18.993423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357d9f9-dd1e-4265-8f7e-a756e87f2dca service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:19.002711 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1287/2546] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:19.057607 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a4182-e4d5-4dfa-8cdc-3ad1c01c3686 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:19.059003 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8c5a4182-e4d5-4dfa-8cdc-3ad1c01c3686 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:19.075467 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a4182-e4d5-4dfa-8cdc-3ad1c01c3686 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:19.081771 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c891d01-32df-4287-839e-5787d46302ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:19.082862 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c891d01-32df-4287-839e-5787d46302ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:19.083148 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c891d01-32df-4287-839e-5787d46302ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:19.083424 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c891d01-32df-4287-839e-5787d46302ca admin admin] PATH_INFO: `/v3/projects/04d299b839c7489f999ec15bcb2ad91b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:19.085679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c891d01-32df-4287-839e-5787d46302ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d299b839c7489f999ec15bcb2ad91b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:19.087727 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c891d01-32df-4287-839e-5787d46302ca admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:19.147618 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8c891d01-32df-4287-839e-5787d46302ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d299b839c7489f999ec15bcb2ad91b', 'request_id': 'req-8c891d01-32df-4287-839e-5787d46302ca'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:19.154398 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8c891d01-32df-4287-839e-5787d46302ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d299b839c7489f999ec15bcb2ad91b', 'request_id': 'req-8c891d01-32df-4287-839e-5787d46302ca'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:19.161024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8c891d01-32df-4287-839e-5787d46302ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d299b839c7489f999ec15bcb2ad91b', 'request_id': 'req-8c891d01-32df-4287-839e-5787d46302ca'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:19.174218 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8c891d01-32df-4287-839e-5787d46302ca admin admin] The token cache is being invalidate because project 04d299b839c7489f999ec15bcb2ad91b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:19.174477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8c891d01-32df-4287-839e-5787d46302ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:19.175160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8c891d01-32df-4287-839e-5787d46302ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:19.176791 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1260/2547] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:19 2022] DELETE /identity/v3/projects/04d299b839c7489f999ec15bcb2ad91b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:19.181585 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357d9f9-dd1e-4265-8f7e-a756e87f2dca service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:19.194830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357d9f9-dd1e-4265-8f7e-a756e87f2dca service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:19.254486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6842f-01d0-40bf-b28f-5a8872df57e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:19.255260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6842f-01d0-40bf-b28f-5a8872df57e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:19.255540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6842f-01d0-40bf-b28f-5a8872df57e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:19.255844 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6842f-01d0-40bf-b28f-5a8872df57e0 admin admin] PATH_INFO: `/v3/users/2fc5f5e56480414fadfc0a8c719ac239` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:19.258036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6842f-01d0-40bf-b28f-5a8872df57e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fc5f5e56480414fadfc0a8c719ac239)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:19.259981 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6842f-01d0-40bf-b28f-5a8872df57e0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:19.325869 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e6e6842f-01d0-40bf-b28f-5a8872df57e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fc5f5e56480414fadfc0a8c719ac239'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:19.338867 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:19.341020 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e6e6842f-01d0-40bf-b28f-5a8872df57e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fc5f5e56480414fadfc0a8c719ac239'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:19.341949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e6e6842f-01d0-40bf-b28f-5a8872df57e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fc5f5e56480414fadfc0a8c719ac239'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:19.342859 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e6e6842f-01d0-40bf-b28f-5a8872df57e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fc5f5e56480414fadfc0a8c719ac239'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:19.350830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e6e6842f-01d0-40bf-b28f-5a8872df57e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fc5f5e56480414fadfc0a8c719ac239'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:19.363634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1288/2548] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:19 2022] DELETE /identity/v3/users/2fc5f5e56480414fadfc0a8c719ac239 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:19.626545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c891d01-32df-4287-839e-5787d46302ca admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:19.628021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8c891d01-32df-4287-839e-5787d46302ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:19.640871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c891d01-32df-4287-839e-5787d46302ca admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:19.703665 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a60d3-b80c-44ea-a95d-4da38b02b004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:19.704525 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a60d3-b80c-44ea-a95d-4da38b02b004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:19.704804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a60d3-b80c-44ea-a95d-4da38b02b004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:19.705076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a60d3-b80c-44ea-a95d-4da38b02b004 admin admin] PATH_INFO: `/v3/projects/fd1cae06ff2245e19221f2a4e5bc7ed5` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:19.706310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a60d3-b80c-44ea-a95d-4da38b02b004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd1cae06ff2245e19221f2a4e5bc7ed5)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:19.708335 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a60d3-b80c-44ea-a95d-4da38b02b004 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:19.763460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-590a60d3-b80c-44ea-a95d-4da38b02b004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd1cae06ff2245e19221f2a4e5bc7ed5', 'request_id': 'req-590a60d3-b80c-44ea-a95d-4da38b02b004'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:19.771335 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-590a60d3-b80c-44ea-a95d-4da38b02b004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd1cae06ff2245e19221f2a4e5bc7ed5', 'request_id': 'req-590a60d3-b80c-44ea-a95d-4da38b02b004'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:19.780139 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-590a60d3-b80c-44ea-a95d-4da38b02b004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd1cae06ff2245e19221f2a4e5bc7ed5', 'request_id': 'req-590a60d3-b80c-44ea-a95d-4da38b02b004'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:19.795064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-590a60d3-b80c-44ea-a95d-4da38b02b004 admin admin] The token cache is being invalidate because project fd1cae06ff2245e19221f2a4e5bc7ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:19.797173 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-590a60d3-b80c-44ea-a95d-4da38b02b004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:19.797606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-590a60d3-b80c-44ea-a95d-4da38b02b004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:19.799468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1261/2549] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:19 2022] DELETE /identity/v3/projects/fd1cae06ff2245e19221f2a4e5bc7ed5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:19.804748 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fa787-1390-4c95-a12d-8833d4b35ff5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:19.806096 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fa787-1390-4c95-a12d-8833d4b35ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:19.806456 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fa787-1390-4c95-a12d-8833d4b35ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:19.824867 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-440fa787-1390-4c95-a12d-8833d4b35ff5 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:19.831034 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-440fa787-1390-4c95-a12d-8833d4b35ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:19.904253 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1289/2550] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:19.913272 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec646dd-905b-470f-8074-16d6a2a9b1d4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:19.913586 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec646dd-905b-470f-8074-16d6a2a9b1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:19.913856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec646dd-905b-470f-8074-16d6a2a9b1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:19.933272 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4ec646dd-905b-470f-8074-16d6a2a9b1d4 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:19.934509 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4ec646dd-905b-470f-8074-16d6a2a9b1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:19.943038 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1262/2551] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:19.947769 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fa787-1390-4c95-a12d-8833d4b35ff5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:19.957970 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fa787-1390-4c95-a12d-8833d4b35ff5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:19.963154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e84ea9-5d9e-4e0a-a9af-9fe0a099ba94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:19.963802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e84ea9-5d9e-4e0a-a9af-9fe0a099ba94 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:19.964120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e84ea9-5d9e-4e0a-a9af-9fe0a099ba94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:19.964389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e84ea9-5d9e-4e0a-a9af-9fe0a099ba94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:19.965108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e84ea9-5d9e-4e0a-a9af-9fe0a099ba94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:20:19.965448 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e84ea9-5d9e-4e0a-a9af-9fe0a099ba94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:19.967047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e84ea9-5d9e-4e0a-a9af-9fe0a099ba94 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:19.982883 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1290/2552] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 11:20:19.984201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec646dd-905b-470f-8074-16d6a2a9b1d4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:19.990265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:19.994029 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec646dd-905b-470f-8074-16d6a2a9b1d4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:20.000142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fa2c7-50a4-48bc-a927-af0dbfe3e8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:20.001195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fa2c7-50a4-48bc-a927-af0dbfe3e8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:20.001720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fa2c7-50a4-48bc-a927-af0dbfe3e8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:20.002052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fa2c7-50a4-48bc-a927-af0dbfe3e8b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:20.002878 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fa2c7-50a4-48bc-a927-af0dbfe3e8b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:20.004765 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fa2c7-50a4-48bc-a927-af0dbfe3e8b3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:20.031730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1263/2553] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:20:19 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:20:20.036105 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e84ea9-5d9e-4e0a-a9af-9fe0a099ba94 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:20.047057 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e84ea9-5d9e-4e0a-a9af-9fe0a099ba94 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:20.106944 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21340c80-131d-4090-b03c-999170c44579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:20.107606 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21340c80-131d-4090-b03c-999170c44579 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:20.107888 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21340c80-131d-4090-b03c-999170c44579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:20.108161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21340c80-131d-4090-b03c-999170c44579 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:20.108835 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21340c80-131d-4090-b03c-999170c44579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:20.110920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21340c80-131d-4090-b03c-999170c44579 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:20.137618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1291/2554] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:20:20 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:20.138836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fa2c7-50a4-48bc-a927-af0dbfe3e8b3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:20.150744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fa2c7-50a4-48bc-a927-af0dbfe3e8b3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:20.158512 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1f6c5-457f-4660-8fdd-723bb5949dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:20.159179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1f6c5-457f-4660-8fdd-723bb5949dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:20.159469 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1f6c5-457f-4660-8fdd-723bb5949dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:20.159748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1f6c5-457f-4660-8fdd-723bb5949dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:20.160476 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1f6c5-457f-4660-8fdd-723bb5949dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:20.162123 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1f6c5-457f-4660-8fdd-723bb5949dfa admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:20.176421 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1264/2555] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:20.179911 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21340c80-131d-4090-b03c-999170c44579 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:20.192135 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21340c80-131d-4090-b03c-999170c44579 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:20.197257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c534a-612e-4113-8b8e-de84081d1781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:20.202361 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c534a-612e-4113-8b8e-de84081d1781 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:20.202361 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c534a-612e-4113-8b8e-de84081d1781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:20.202361 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c534a-612e-4113-8b8e-de84081d1781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:20.202361 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c534a-612e-4113-8b8e-de84081d1781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:20.202361 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c534a-612e-4113-8b8e-de84081d1781 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:20.212521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1292/2556] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:20.216588 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1f6c5-457f-4660-8fdd-723bb5949dfa admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:20.227554 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1f6c5-457f-4660-8fdd-723bb5949dfa admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:20.232319 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594f809-dc38-482c-b1bd-6a87185782c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:20.233199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594f809-dc38-482c-b1bd-6a87185782c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:20.233520 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594f809-dc38-482c-b1bd-6a87185782c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:20.233799 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594f809-dc38-482c-b1bd-6a87185782c7 admin admin] PATH_INFO: `/v3/projects/1512d615b1054524969789c56d276617/users/3b881689b9db423aa6369a666f93ba76/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:20.250026 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594f809-dc38-482c-b1bd-6a87185782c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1512d615b1054524969789c56d276617, user_id=3b881689b9db423aa6369a666f93ba76, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:20.252689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594f809-dc38-482c-b1bd-6a87185782c7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:20.267016 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1265/2557] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:20 2022] PUT /identity/v3/projects/1512d615b1054524969789c56d276617/users/3b881689b9db423aa6369a666f93ba76/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:20.278597 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c2225-5de2-499f-8a1c-b956f49d1b33 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:20.278884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c2225-5de2-499f-8a1c-b956f49d1b33 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:20.279158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c2225-5de2-499f-8a1c-b956f49d1b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:20.307206 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0c1c2225-5de2-499f-8a1c-b956f49d1b33 None None] MFA Rules not processed for user `3b881689b9db423aa6369a666f93ba76`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:20.308460 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0c1c2225-5de2-499f-8a1c-b956f49d1b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:20.349038 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:20.386361 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1293/2558] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:20.390501 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594f809-dc38-482c-b1bd-6a87185782c7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:20.462763 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594f809-dc38-482c-b1bd-6a87185782c7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:20.468967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262573c-ba91-467a-8c7a-a6bb71e51626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:20.469818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262573c-ba91-467a-8c7a-a6bb71e51626 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:20.470171 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262573c-ba91-467a-8c7a-a6bb71e51626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:20.470666 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262573c-ba91-467a-8c7a-a6bb71e51626 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:20.471458 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262573c-ba91-467a-8c7a-a6bb71e51626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:20.473580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262573c-ba91-467a-8c7a-a6bb71e51626 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:20.514089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1266/2559] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:20:20 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:20:20.515254 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c2225-5de2-499f-8a1c-b956f49d1b33 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:20.526994 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c2225-5de2-499f-8a1c-b956f49d1b33 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:20.615436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9380e9e-485f-4ecd-a402-7a88249f348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:20.616487 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380e9e-485f-4ecd-a402-7a88249f348f admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:20.616931 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380e9e-485f-4ecd-a402-7a88249f348f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:20.617436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380e9e-485f-4ecd-a402-7a88249f348f admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:20.618280 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9380e9e-485f-4ecd-a402-7a88249f348f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:20.620305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9380e9e-485f-4ecd-a402-7a88249f348f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:20.646568 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1294/2560] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:20:20 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:20.650969 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262573c-ba91-467a-8c7a-a6bb71e51626 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:20.670395 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262573c-ba91-467a-8c7a-a6bb71e51626 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:20.675843 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05abe62-5c22-4986-9f25-2e49c72a37d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:20.676525 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05abe62-5c22-4986-9f25-2e49c72a37d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:20.676807 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05abe62-5c22-4986-9f25-2e49c72a37d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:20.677083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05abe62-5c22-4986-9f25-2e49c72a37d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:20.677857 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05abe62-5c22-4986-9f25-2e49c72a37d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:20.680062 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05abe62-5c22-4986-9f25-2e49c72a37d8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:20.693619 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1267/2561] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:20.698527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9380e9e-485f-4ecd-a402-7a88249f348f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:20.710083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9380e9e-485f-4ecd-a402-7a88249f348f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:20.715369 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdb7f8-92fa-45cc-9979-722a93b959d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:20.716247 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdb7f8-92fa-45cc-9979-722a93b959d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:20.716531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdb7f8-92fa-45cc-9979-722a93b959d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:20.716806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdb7f8-92fa-45cc-9979-722a93b959d6 admin admin] PATH_INFO: `/v3/projects/be08d107eb11483ea1944b2b06a8a8e3/users/db5a3c569cd44e7da7cbb0f96ba2f1f8/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:20.733840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdb7f8-92fa-45cc-9979-722a93b959d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be08d107eb11483ea1944b2b06a8a8e3, user_id=db5a3c569cd44e7da7cbb0f96ba2f1f8, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:20.736679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdb7f8-92fa-45cc-9979-722a93b959d6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:20.757064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1295/2562] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:20 2022] PUT /identity/v3/projects/be08d107eb11483ea1944b2b06a8a8e3/users/db5a3c569cd44e7da7cbb0f96ba2f1f8/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:20.761117 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05abe62-5c22-4986-9f25-2e49c72a37d8 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:20.772577 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05abe62-5c22-4986-9f25-2e49c72a37d8 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:20.830720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09552455-e216-44fe-97d1-d0127bf93552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:20.831421 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552455-e216-44fe-97d1-d0127bf93552 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:20.831702 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552455-e216-44fe-97d1-d0127bf93552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:20.831977 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552455-e216-44fe-97d1-d0127bf93552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:20.832694 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09552455-e216-44fe-97d1-d0127bf93552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:20.834326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09552455-e216-44fe-97d1-d0127bf93552 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:20.844656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1268/2563] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:20.848847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdb7f8-92fa-45cc-9979-722a93b959d6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:20.860859 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdb7f8-92fa-45cc-9979-722a93b959d6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:20.867075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401fd16-a6e6-4755-ab3e-4f8eeddfe4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:20.867966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401fd16-a6e6-4755-ab3e-4f8eeddfe4da admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:20.868219 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401fd16-a6e6-4755-ab3e-4f8eeddfe4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:20.868489 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401fd16-a6e6-4755-ab3e-4f8eeddfe4da admin admin] PATH_INFO: `/v3/projects/be08d107eb11483ea1944b2b06a8a8e3/users/db5a3c569cd44e7da7cbb0f96ba2f1f8/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:20.870680 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401fd16-a6e6-4755-ab3e-4f8eeddfe4da admin admin] RBAC: Authorizing `identity:create_grant(project_id=be08d107eb11483ea1944b2b06a8a8e3, user_id=db5a3c569cd44e7da7cbb0f96ba2f1f8, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:20.873392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401fd16-a6e6-4755-ab3e-4f8eeddfe4da admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:20.888985 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1296/2564] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:20 2022] PUT /identity/v3/projects/be08d107eb11483ea1944b2b06a8a8e3/users/db5a3c569cd44e7da7cbb0f96ba2f1f8/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:20.900021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2d423-2781-4db2-8813-156d2fd486c5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:20.900310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2d423-2781-4db2-8813-156d2fd486c5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:20.900594 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2d423-2781-4db2-8813-156d2fd486c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:20.939790 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-fba2d423-2781-4db2-8813-156d2fd486c5 None None] MFA Rules not processed for user `db5a3c569cd44e7da7cbb0f96ba2f1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:20.941081 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fba2d423-2781-4db2-8813-156d2fd486c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:20.949080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:21.031028 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1269/2565] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:21.044240 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401fd16-a6e6-4755-ab3e-4f8eeddfe4da admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:21.047167 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7401fd16-a6e6-4755-ab3e-4f8eeddfe4da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:21.130224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401fd16-a6e6-4755-ab3e-4f8eeddfe4da admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:21.135103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87330c68-b7f7-463d-8e36-edbf3cb24eb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:21.135751 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87330c68-b7f7-463d-8e36-edbf3cb24eb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:21.136034 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87330c68-b7f7-463d-8e36-edbf3cb24eb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:21.136308 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87330c68-b7f7-463d-8e36-edbf3cb24eb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:21.148612 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87330c68-b7f7-463d-8e36-edbf3cb24eb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:21.150095 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87330c68-b7f7-463d-8e36-edbf3cb24eb7 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:21.160735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1297/2566] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:21 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:21.247870 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2d423-2781-4db2-8813-156d2fd486c5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:21.258960 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2d423-2781-4db2-8813-156d2fd486c5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:21.262901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ca937-2a36-4596-a8d3-96724b982238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:21.263537 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ca937-2a36-4596-a8d3-96724b982238 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:21.263943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ca937-2a36-4596-a8d3-96724b982238 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:21.264227 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ca937-2a36-4596-a8d3-96724b982238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:21.323710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ca937-2a36-4596-a8d3-96724b982238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:21.325193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ca937-2a36-4596-a8d3-96724b982238 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:21.335205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1270/2567] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:21 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:20:23.847730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87330c68-b7f7-463d-8e36-edbf3cb24eb7 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:23.849127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-87330c68-b7f7-463d-8e36-edbf3cb24eb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:23.882715 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:23.915683 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87330c68-b7f7-463d-8e36-edbf3cb24eb7 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:23.920165 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95aeb5-bd4b-47b9-ac73-31117ca5ee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:23.921019 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95aeb5-bd4b-47b9-ac73-31117ca5ee6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:23.921301 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95aeb5-bd4b-47b9-ac73-31117ca5ee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:23.921610 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95aeb5-bd4b-47b9-ac73-31117ca5ee6c admin admin] PATH_INFO: `/v3/users/b6fc1cf7837b43308686b4af278149d6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:23.922774 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95aeb5-bd4b-47b9-ac73-31117ca5ee6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6fc1cf7837b43308686b4af278149d6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:23.924676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95aeb5-bd4b-47b9-ac73-31117ca5ee6c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:23.968649 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bd95aeb5-bd4b-47b9-ac73-31117ca5ee6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6fc1cf7837b43308686b4af278149d6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:23.980878 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bd95aeb5-bd4b-47b9-ac73-31117ca5ee6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6fc1cf7837b43308686b4af278149d6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:23.981560 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bd95aeb5-bd4b-47b9-ac73-31117ca5ee6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6fc1cf7837b43308686b4af278149d6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:23.982158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bd95aeb5-bd4b-47b9-ac73-31117ca5ee6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6fc1cf7837b43308686b4af278149d6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:23.989460 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bd95aeb5-bd4b-47b9-ac73-31117ca5ee6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6fc1cf7837b43308686b4af278149d6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.003638 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1298/2568] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:23 2022] DELETE /identity/v3/users/b6fc1cf7837b43308686b4af278149d6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:24.008158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b905d2a-e4de-47d6-93f3-fd35a2fe61c9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:24.008619 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b905d2a-e4de-47d6-93f3-fd35a2fe61c9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:24.008872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b905d2a-e4de-47d6-93f3-fd35a2fe61c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:24.027410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6b905d2a-e4de-47d6-93f3-fd35a2fe61c9 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:24.028624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6b905d2a-e4de-47d6-93f3-fd35a2fe61c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:24.094279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1271/2569] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:20:24.102656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95aeb5-bd4b-47b9-ac73-31117ca5ee6c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:24.104186 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b905d2a-e4de-47d6-93f3-fd35a2fe61c9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:24.104903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bd95aeb5-bd4b-47b9-ac73-31117ca5ee6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:24.105750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6b905d2a-e4de-47d6-93f3-fd35a2fe61c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:24.117870 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95aeb5-bd4b-47b9-ac73-31117ca5ee6c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:24.122474 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232c487-2e9b-4244-8ae7-41ec8f3f2b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:24.123331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232c487-2e9b-4244-8ae7-41ec8f3f2b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:24.123610 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232c487-2e9b-4244-8ae7-41ec8f3f2b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:24.123879 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232c487-2e9b-4244-8ae7-41ec8f3f2b4c admin admin] PATH_INFO: `/v3/users/3b881689b9db423aa6369a666f93ba76` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:24.125069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232c487-2e9b-4244-8ae7-41ec8f3f2b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b881689b9db423aa6369a666f93ba76)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:24.127007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232c487-2e9b-4244-8ae7-41ec8f3f2b4c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:24.152638 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:24.166010 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b905d2a-e4de-47d6-93f3-fd35a2fe61c9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:24.170241 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa010a-4165-434e-a651-f0e954a0dd7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:24.170888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa010a-4165-434e-a651-f0e954a0dd7b service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:24.171169 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa010a-4165-434e-a651-f0e954a0dd7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:24.171438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa010a-4165-434e-a651-f0e954a0dd7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:24.180885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa010a-4165-434e-a651-f0e954a0dd7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:24.182349 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa010a-4165-434e-a651-f0e954a0dd7b service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:24.183506 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d232c487-2e9b-4244-8ae7-41ec8f3f2b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b881689b9db423aa6369a666f93ba76'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.191893 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1272/2570] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:20:24.197789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d232c487-2e9b-4244-8ae7-41ec8f3f2b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b881689b9db423aa6369a666f93ba76'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.198695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d232c487-2e9b-4244-8ae7-41ec8f3f2b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b881689b9db423aa6369a666f93ba76'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.199321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d232c487-2e9b-4244-8ae7-41ec8f3f2b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b881689b9db423aa6369a666f93ba76'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.208936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d232c487-2e9b-4244-8ae7-41ec8f3f2b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b881689b9db423aa6369a666f93ba76'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.222688 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1299/2571] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:24 2022] DELETE /identity/v3/users/3b881689b9db423aa6369a666f93ba76 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:24.227170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7584f1-c0c5-45cc-8281-d2a69a77d3c3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:24.227460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7584f1-c0c5-45cc-8281-d2a69a77d3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:24.227734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7584f1-c0c5-45cc-8281-d2a69a77d3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:24.245251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-be7584f1-c0c5-45cc-8281-d2a69a77d3c3 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:24.246756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-be7584f1-c0c5-45cc-8281-d2a69a77d3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:24.322261 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1273/2572] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:20:24.331671 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232c487-2e9b-4244-8ae7-41ec8f3f2b4c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:24.333089 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d232c487-2e9b-4244-8ae7-41ec8f3f2b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:24.375876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:24.411457 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232c487-2e9b-4244-8ae7-41ec8f3f2b4c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:24.415160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d6c9c-545d-4c90-be47-10addc87e226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:24.415806 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d6c9c-545d-4c90-be47-10addc87e226 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:24.416087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d6c9c-545d-4c90-be47-10addc87e226 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:24.416360 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d6c9c-545d-4c90-be47-10addc87e226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:24.425680 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d6c9c-545d-4c90-be47-10addc87e226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:24.427110 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d6c9c-545d-4c90-be47-10addc87e226 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:24.439959 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1300/2573] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:24.493436 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7584f1-c0c5-45cc-8281-d2a69a77d3c3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:24.494951 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-be7584f1-c0c5-45cc-8281-d2a69a77d3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:24.507606 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7584f1-c0c5-45cc-8281-d2a69a77d3c3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:24.512939 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e186b-14df-4bd0-a580-4cb0f436cabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:24.513878 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e186b-14df-4bd0-a580-4cb0f436cabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:24.514157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e186b-14df-4bd0-a580-4cb0f436cabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:24.514425 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e186b-14df-4bd0-a580-4cb0f436cabf admin admin] PATH_INFO: `/v3/projects/db0769cc6b324aaea4a42f6535b89655` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:24.515976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e186b-14df-4bd0-a580-4cb0f436cabf admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0769cc6b324aaea4a42f6535b89655)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:24.517568 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e186b-14df-4bd0-a580-4cb0f436cabf admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:24.570876 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-222e186b-14df-4bd0-a580-4cb0f436cabf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0769cc6b324aaea4a42f6535b89655', 'request_id': 'req-222e186b-14df-4bd0-a580-4cb0f436cabf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.577873 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-222e186b-14df-4bd0-a580-4cb0f436cabf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0769cc6b324aaea4a42f6535b89655', 'request_id': 'req-222e186b-14df-4bd0-a580-4cb0f436cabf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.586128 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-222e186b-14df-4bd0-a580-4cb0f436cabf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0769cc6b324aaea4a42f6535b89655', 'request_id': 'req-222e186b-14df-4bd0-a580-4cb0f436cabf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.612981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-222e186b-14df-4bd0-a580-4cb0f436cabf admin admin] The token cache is being invalidate because project db0769cc6b324aaea4a42f6535b89655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:24.613558 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-222e186b-14df-4bd0-a580-4cb0f436cabf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.614320 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-222e186b-14df-4bd0-a580-4cb0f436cabf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.618017 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1274/2574] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:24 2022] DELETE /identity/v3/projects/db0769cc6b324aaea4a42f6535b89655 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:24.621916 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d6c9c-545d-4c90-be47-10addc87e226 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:24.633394 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d6c9c-545d-4c90-be47-10addc87e226 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:24.702571 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba835e5-af11-429c-a9a2-bf5ca9a007d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:24.703451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba835e5-af11-429c-a9a2-bf5ca9a007d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:24.703808 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba835e5-af11-429c-a9a2-bf5ca9a007d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:24.704094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba835e5-af11-429c-a9a2-bf5ca9a007d9 admin admin] PATH_INFO: `/v3/users/2844ed9ff4a74adf9ed139e47d29e72e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:24.705344 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba835e5-af11-429c-a9a2-bf5ca9a007d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2844ed9ff4a74adf9ed139e47d29e72e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:24.707319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba835e5-af11-429c-a9a2-bf5ca9a007d9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:24.754165 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e186b-14df-4bd0-a580-4cb0f436cabf admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:24.755891 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-222e186b-14df-4bd0-a580-4cb0f436cabf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:24.762227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dba835e5-af11-429c-a9a2-bf5ca9a007d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2844ed9ff4a74adf9ed139e47d29e72e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.776473 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dba835e5-af11-429c-a9a2-bf5ca9a007d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2844ed9ff4a74adf9ed139e47d29e72e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.777807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dba835e5-af11-429c-a9a2-bf5ca9a007d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2844ed9ff4a74adf9ed139e47d29e72e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.778082 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e186b-14df-4bd0-a580-4cb0f436cabf admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:24.778532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dba835e5-af11-429c-a9a2-bf5ca9a007d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2844ed9ff4a74adf9ed139e47d29e72e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.790034 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dba835e5-af11-429c-a9a2-bf5ca9a007d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2844ed9ff4a74adf9ed139e47d29e72e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.791498 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98fb2d-d074-4d59-bedc-31e4a27d932d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:24.792443 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98fb2d-d074-4d59-bedc-31e4a27d932d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:24.792732 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98fb2d-d074-4d59-bedc-31e4a27d932d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:24.793009 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98fb2d-d074-4d59-bedc-31e4a27d932d admin admin] PATH_INFO: `/v3/projects/1512d615b1054524969789c56d276617` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:24.794756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98fb2d-d074-4d59-bedc-31e4a27d932d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1512d615b1054524969789c56d276617)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:24.797307 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98fb2d-d074-4d59-bedc-31e4a27d932d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:24.804666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1301/2575] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:24 2022] DELETE /identity/v3/users/2844ed9ff4a74adf9ed139e47d29e72e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:20:24.853978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ff98fb2d-d074-4d59-bedc-31e4a27d932d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1512d615b1054524969789c56d276617', 'request_id': 'req-ff98fb2d-d074-4d59-bedc-31e4a27d932d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.861647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ff98fb2d-d074-4d59-bedc-31e4a27d932d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1512d615b1054524969789c56d276617', 'request_id': 'req-ff98fb2d-d074-4d59-bedc-31e4a27d932d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.870816 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ff98fb2d-d074-4d59-bedc-31e4a27d932d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1512d615b1054524969789c56d276617', 'request_id': 'req-ff98fb2d-d074-4d59-bedc-31e4a27d932d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.875510 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:24.893730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ff98fb2d-d074-4d59-bedc-31e4a27d932d admin admin] The token cache is being invalidate because project 1512d615b1054524969789c56d276617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:24.894519 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ff98fb2d-d074-4d59-bedc-31e4a27d932d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.895220 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ff98fb2d-d074-4d59-bedc-31e4a27d932d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:24.897426 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1275/2576] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:24 2022] DELETE /identity/v3/projects/1512d615b1054524969789c56d276617 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:20:24.901332 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba835e5-af11-429c-a9a2-bf5ca9a007d9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:24.902809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dba835e5-af11-429c-a9a2-bf5ca9a007d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:24.960162 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:25.013489 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba835e5-af11-429c-a9a2-bf5ca9a007d9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:25.110036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10b8b6-f4ab-4b94-a158-8ac82038779d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:25.111149 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10b8b6-f4ab-4b94-a158-8ac82038779d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:25.111436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10b8b6-f4ab-4b94-a158-8ac82038779d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:25.111742 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10b8b6-f4ab-4b94-a158-8ac82038779d admin admin] PATH_INFO: `/v3/users/db5a3c569cd44e7da7cbb0f96ba2f1f8` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:25.112942 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10b8b6-f4ab-4b94-a158-8ac82038779d admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5a3c569cd44e7da7cbb0f96ba2f1f8)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:25.114933 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10b8b6-f4ab-4b94-a158-8ac82038779d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:25.118542 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98fb2d-d074-4d59-bedc-31e4a27d932d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:25.120765 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ff98fb2d-d074-4d59-bedc-31e4a27d932d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:25.136641 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98fb2d-d074-4d59-bedc-31e4a27d932d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:25.142775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9584b-0160-4d6c-a43c-c1f5cac6e66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:25.144596 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9584b-0160-4d6c-a43c-c1f5cac6e66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:25.144952 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9584b-0160-4d6c-a43c-c1f5cac6e66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:25.145297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9584b-0160-4d6c-a43c-c1f5cac6e66c admin admin] PATH_INFO: `/v3/projects/5a7c7d16b4844df1a99cc0e6765e3741` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:25.146607 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9584b-0160-4d6c-a43c-c1f5cac6e66c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a7c7d16b4844df1a99cc0e6765e3741)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:25.150006 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9584b-0160-4d6c-a43c-c1f5cac6e66c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:25.207157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5b10b8b6-f4ab-4b94-a158-8ac82038779d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5a3c569cd44e7da7cbb0f96ba2f1f8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:25.221540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5b10b8b6-f4ab-4b94-a158-8ac82038779d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5a3c569cd44e7da7cbb0f96ba2f1f8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:25.222459 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5b10b8b6-f4ab-4b94-a158-8ac82038779d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5a3c569cd44e7da7cbb0f96ba2f1f8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:25.223161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5b10b8b6-f4ab-4b94-a158-8ac82038779d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5a3c569cd44e7da7cbb0f96ba2f1f8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:25.233777 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4db9584b-0160-4d6c-a43c-c1f5cac6e66c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a7c7d16b4844df1a99cc0e6765e3741', 'request_id': 'req-4db9584b-0160-4d6c-a43c-c1f5cac6e66c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:25.235480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5b10b8b6-f4ab-4b94-a158-8ac82038779d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5a3c569cd44e7da7cbb0f96ba2f1f8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:25.243261 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4db9584b-0160-4d6c-a43c-c1f5cac6e66c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a7c7d16b4844df1a99cc0e6765e3741', 'request_id': 'req-4db9584b-0160-4d6c-a43c-c1f5cac6e66c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:25.249869 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4db9584b-0160-4d6c-a43c-c1f5cac6e66c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a7c7d16b4844df1a99cc0e6765e3741', 'request_id': 'req-4db9584b-0160-4d6c-a43c-c1f5cac6e66c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:25.251047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1302/2577] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:24 2022] DELETE /identity/v3/users/db5a3c569cd44e7da7cbb0f96ba2f1f8 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:25.264893 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4db9584b-0160-4d6c-a43c-c1f5cac6e66c admin admin] The token cache is being invalidate because project 5a7c7d16b4844df1a99cc0e6765e3741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:25.265400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4db9584b-0160-4d6c-a43c-c1f5cac6e66c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:25.266078 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4db9584b-0160-4d6c-a43c-c1f5cac6e66c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:25.268056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1276/2578] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:25 2022] DELETE /identity/v3/projects/5a7c7d16b4844df1a99cc0e6765e3741 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:25.273083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bae622-3e7c-4954-9151-ca8add54c233 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:25.273437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bae622-3e7c-4954-9151-ca8add54c233 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:25.273805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bae622-3e7c-4954-9151-ca8add54c233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:25.301310 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-19bae622-3e7c-4954-9151-ca8add54c233 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:25.302858 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-19bae622-3e7c-4954-9151-ca8add54c233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:25.378368 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1303/2579] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:25.386687 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b4fbe-7154-48b5-8cd1-07c8db632106 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:25.386977 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b4fbe-7154-48b5-8cd1-07c8db632106 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:25.387257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b4fbe-7154-48b5-8cd1-07c8db632106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:25.407748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-101b4fbe-7154-48b5-8cd1-07c8db632106 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:25.409221 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-101b4fbe-7154-48b5-8cd1-07c8db632106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:25.419690 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1277/2580] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:25.423969 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bae622-3e7c-4954-9151-ca8add54c233 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:25.434475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bae622-3e7c-4954-9151-ca8add54c233 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:25.439627 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf32789-c43c-4f13-b946-4d348242fe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:25.440313 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf32789-c43c-4f13-b946-4d348242fe7a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:25.440602 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf32789-c43c-4f13-b946-4d348242fe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:25.440879 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf32789-c43c-4f13-b946-4d348242fe7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:25.441647 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf32789-c43c-4f13-b946-4d348242fe7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:20:25.441954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf32789-c43c-4f13-b946-4d348242fe7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:25.443557 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf32789-c43c-4f13-b946-4d348242fe7a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:25.451400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:25.462009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1304/2581] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:20:25.463054 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b4fbe-7154-48b5-8cd1-07c8db632106 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:25.472675 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b4fbe-7154-48b5-8cd1-07c8db632106 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:25.477731 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8084b-a25a-40b0-ad24-21e17513fa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:25.478489 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8084b-a25a-40b0-ad24-21e17513fa0b admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:25.478852 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8084b-a25a-40b0-ad24-21e17513fa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:25.479192 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8084b-a25a-40b0-ad24-21e17513fa0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:25.479947 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8084b-a25a-40b0-ad24-21e17513fa0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:25.481958 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8084b-a25a-40b0-ad24-21e17513fa0b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:25.514234 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1278/2582] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:20:25 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:20:25.516263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf32789-c43c-4f13-b946-4d348242fe7a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:25.526903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf32789-c43c-4f13-b946-4d348242fe7a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:25.574925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8084b-a25a-40b0-ad24-21e17513fa0b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:25.576794 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-01b8084b-a25a-40b0-ad24-21e17513fa0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:25.598176 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6d7ed-bde2-42ee-93d5-dbd15343ccd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:25.598991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6d7ed-bde2-42ee-93d5-dbd15343ccd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:25.599286 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6d7ed-bde2-42ee-93d5-dbd15343ccd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:25.600732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6d7ed-bde2-42ee-93d5-dbd15343ccd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:25.602034 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6d7ed-bde2-42ee-93d5-dbd15343ccd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:25.604196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6d7ed-bde2-42ee-93d5-dbd15343ccd2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:25.629735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1305/2583] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:20:25 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:25.634179 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6d7ed-bde2-42ee-93d5-dbd15343ccd2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:25.644197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6d7ed-bde2-42ee-93d5-dbd15343ccd2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:25.648861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c26f9-edde-45c7-af23-5cf615597218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:25.649674 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c26f9-edde-45c7-af23-5cf615597218 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:25.649813 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c26f9-edde-45c7-af23-5cf615597218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:25.650087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c26f9-edde-45c7-af23-5cf615597218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:25.650802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c26f9-edde-45c7-af23-5cf615597218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:25.652194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8084b-a25a-40b0-ad24-21e17513fa0b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:25.652389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c26f9-edde-45c7-af23-5cf615597218 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:25.656991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64448af7-dbae-4dc5-a10b-1214ac7c7683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:25.657891 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64448af7-dbae-4dc5-a10b-1214ac7c7683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:25.658166 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64448af7-dbae-4dc5-a10b-1214ac7c7683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:25.658437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64448af7-dbae-4dc5-a10b-1214ac7c7683 admin admin] PATH_INFO: `/v3/projects/be08d107eb11483ea1944b2b06a8a8e3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:25.659685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64448af7-dbae-4dc5-a10b-1214ac7c7683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be08d107eb11483ea1944b2b06a8a8e3)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:25.661654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64448af7-dbae-4dc5-a10b-1214ac7c7683 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:25.662254 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1306/2584] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:20:25.666699 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c26f9-edde-45c7-af23-5cf615597218 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:25.676043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c26f9-edde-45c7-af23-5cf615597218 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:25.681773 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd4c1f-878f-4f03-9f1a-5087fb394a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:25.682452 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd4c1f-878f-4f03-9f1a-5087fb394a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:25.682732 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd4c1f-878f-4f03-9f1a-5087fb394a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:25.683005 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd4c1f-878f-4f03-9f1a-5087fb394a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:25.683742 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd4c1f-878f-4f03-9f1a-5087fb394a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:25.685318 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd4c1f-878f-4f03-9f1a-5087fb394a26 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:25.697433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1307/2585] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:20:25.700191 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd4c1f-878f-4f03-9f1a-5087fb394a26 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:25.709575 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd4c1f-878f-4f03-9f1a-5087fb394a26 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:25.714794 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:INSERT=3,keystone:DELETE=12,keystone:SELECT=85 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:25.716206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-64448af7-dbae-4dc5-a10b-1214ac7c7683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be08d107eb11483ea1944b2b06a8a8e3', 'request_id': 'req-64448af7-dbae-4dc5-a10b-1214ac7c7683'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:25.723778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-64448af7-dbae-4dc5-a10b-1214ac7c7683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be08d107eb11483ea1944b2b06a8a8e3', 'request_id': 'req-64448af7-dbae-4dc5-a10b-1214ac7c7683'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:25.730014 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-64448af7-dbae-4dc5-a10b-1214ac7c7683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be08d107eb11483ea1944b2b06a8a8e3', 'request_id': 'req-64448af7-dbae-4dc5-a10b-1214ac7c7683'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:25.743996 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-64448af7-dbae-4dc5-a10b-1214ac7c7683 admin admin] The token cache is being invalidate because project be08d107eb11483ea1944b2b06a8a8e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:25.744942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-64448af7-dbae-4dc5-a10b-1214ac7c7683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:25.744942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-64448af7-dbae-4dc5-a10b-1214ac7c7683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:25.746993 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1279/2586] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:25 2022] DELETE /identity/v3/projects/be08d107eb11483ea1944b2b06a8a8e3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:20:25.751405 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53b425-fe1c-45a6-b20c-833b4070fdfd None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:25.751701 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53b425-fe1c-45a6-b20c-833b4070fdfd None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:25.751974 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53b425-fe1c-45a6-b20c-833b4070fdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:25.768037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9df590-3298-40cc-a400-492f6d51640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:25.769105 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9df590-3298-40cc-a400-492f6d51640e admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:25.769415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9df590-3298-40cc-a400-492f6d51640e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:25.769695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9df590-3298-40cc-a400-492f6d51640e admin admin] PATH_INFO: `/v3/projects/8f8eafd73df84a33b635aff0ca1cdcd9/users/4c1daaf1d00545f280999dd3d717d570/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:25.770076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1f53b425-fe1c-45a6-b20c-833b4070fdfd None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:25.771322 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1f53b425-fe1c-45a6-b20c-833b4070fdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:25.781089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1280/2587] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:20:25.784141 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9df590-3298-40cc-a400-492f6d51640e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8eafd73df84a33b635aff0ca1cdcd9, user_id=4c1daaf1d00545f280999dd3d717d570, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:25.786807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9df590-3298-40cc-a400-492f6d51640e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:25.789069 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe076bd3-da51-449a-90fd-9d762182f335 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:25.789378 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe076bd3-da51-449a-90fd-9d762182f335 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:25.789670 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe076bd3-da51-449a-90fd-9d762182f335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:25.801956 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1308/2588] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:25 2022] PUT /identity/v3/projects/8f8eafd73df84a33b635aff0ca1cdcd9/users/4c1daaf1d00545f280999dd3d717d570/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:20:25.812159 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-fe076bd3-da51-449a-90fd-9d762182f335 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:25.813355 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fe076bd3-da51-449a-90fd-9d762182f335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:25.813562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1fc11-b322-420c-96e4-9517f4d6db44 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:25.813851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1fc11-b322-420c-96e4-9517f4d6db44 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:25.814160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1fc11-b322-420c-96e4-9517f4d6db44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:25.844624 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6cb1fc11-b322-420c-96e4-9517f4d6db44 None None] MFA Rules not processed for user `4c1daaf1d00545f280999dd3d717d570`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:25.845876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6cb1fc11-b322-420c-96e4-9517f4d6db44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:25.875450 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1281/2589] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:20:25.879610 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe076bd3-da51-449a-90fd-9d762182f335 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:25.888577 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe076bd3-da51-449a-90fd-9d762182f335 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:25.890347 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:25.894282 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedd27f-17cc-47d0-bb15-bf4d8692023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:25.894921 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedd27f-17cc-47d0-bb15-bf4d8692023a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:25.895202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedd27f-17cc-47d0-bb15-bf4d8692023a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:25.895473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedd27f-17cc-47d0-bb15-bf4d8692023a admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:25.896235 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedd27f-17cc-47d0-bb15-bf4d8692023a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:20:25.896492 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedd27f-17cc-47d0-bb15-bf4d8692023a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:25.898244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedd27f-17cc-47d0-bb15-bf4d8692023a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:25.913532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1282/2590] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 11:20:25.914452 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedd27f-17cc-47d0-bb15-bf4d8692023a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:25.918528 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1309/2591] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:20:25.922887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1fc11-b322-420c-96e4-9517f4d6db44 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:25.924180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6cb1fc11-b322-420c-96e4-9517f4d6db44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:25.924306 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedd27f-17cc-47d0-bb15-bf4d8692023a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:25.930960 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bac44-00be-4be6-bd0c-58cd221ba77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:25.931739 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bac44-00be-4be6-bd0c-58cd221ba77f admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:25.932027 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bac44-00be-4be6-bd0c-58cd221ba77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:25.932300 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bac44-00be-4be6-bd0c-58cd221ba77f admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:25.933600 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bac44-00be-4be6-bd0c-58cd221ba77f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:25.935964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bac44-00be-4be6-bd0c-58cd221ba77f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:25.948809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1fc11-b322-420c-96e4-9517f4d6db44 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:25.954195 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43676e1e-cd46-4359-b5b6-c7ad161c8b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:25.954990 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43676e1e-cd46-4359-b5b6-c7ad161c8b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:25.955415 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43676e1e-cd46-4359-b5b6-c7ad161c8b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:25.955810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43676e1e-cd46-4359-b5b6-c7ad161c8b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:25.956509 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43676e1e-cd46-4359-b5b6-c7ad161c8b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:25.958498 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43676e1e-cd46-4359-b5b6-c7ad161c8b32 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:25.969459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1283/2592] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:20:25 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:25.970611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bac44-00be-4be6-bd0c-58cd221ba77f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:25.988333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1310/2593] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:20:25 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:20:25.989287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43676e1e-cd46-4359-b5b6-c7ad161c8b32 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:26.038020 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bac44-00be-4be6-bd0c-58cd221ba77f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:26.053158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43676e1e-cd46-4359-b5b6-c7ad161c8b32 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:26.058537 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8354946-736a-4ad5-b0dd-a6065b5023e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:26.059251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8354946-736a-4ad5-b0dd-a6065b5023e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.059536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8354946-736a-4ad5-b0dd-a6065b5023e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.059811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8354946-736a-4ad5-b0dd-a6065b5023e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.060511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8354946-736a-4ad5-b0dd-a6065b5023e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:26.062453 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8354946-736a-4ad5-b0dd-a6065b5023e6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:26.079927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:26.085390 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1311/2594] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:20:25 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:20:26.088527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8354946-736a-4ad5-b0dd-a6065b5023e6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:26.098066 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8354946-736a-4ad5-b0dd-a6065b5023e6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:26.103527 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47937ecf-f57e-4e4d-b343-20d6129641da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:26.103884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ef769-c67b-4dd8-9bd1-3f6bf8d2e0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:26.104227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47937ecf-f57e-4e4d-b343-20d6129641da admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.104519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47937ecf-f57e-4e4d-b343-20d6129641da admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.104624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ef769-c67b-4dd8-9bd1-3f6bf8d2e0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.104800 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47937ecf-f57e-4e4d-b343-20d6129641da admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.104903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ef769-c67b-4dd8-9bd1-3f6bf8d2e0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.105092 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ef769-c67b-4dd8-9bd1-3f6bf8d2e0d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.105607 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47937ecf-f57e-4e4d-b343-20d6129641da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:26.105821 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ef769-c67b-4dd8-9bd1-3f6bf8d2e0d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:26.107227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47937ecf-f57e-4e4d-b343-20d6129641da admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:26.107717 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ef769-c67b-4dd8-9bd1-3f6bf8d2e0d4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:26.117357 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1312/2595] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:26.122072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47937ecf-f57e-4e4d-b343-20d6129641da admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:26.131982 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47937ecf-f57e-4e4d-b343-20d6129641da admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:26.134756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1284/2596] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:20:25 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:26.135723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ef769-c67b-4dd8-9bd1-3f6bf8d2e0d4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:26.137928 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb38376-8841-426b-86a6-2cc8b321f6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:26.139356 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38376-8841-426b-86a6-2cc8b321f6f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.139841 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38376-8841-426b-86a6-2cc8b321f6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.140308 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38376-8841-426b-86a6-2cc8b321f6f8 admin admin] PATH_INFO: `/v3/projects/0921de55a53a49558e436e356e36c07a/users/606c3840ac0c4b95810370819859886a/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.146179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ef769-c67b-4dd8-9bd1-3f6bf8d2e0d4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:26.151428 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761d7d8-cb77-4d26-900b-1a9ade800015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:26.152087 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d7d8-cb77-4d26-900b-1a9ade800015 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.152372 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d7d8-cb77-4d26-900b-1a9ade800015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.152645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d7d8-cb77-4d26-900b-1a9ade800015 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.153393 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761d7d8-cb77-4d26-900b-1a9ade800015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:26.154986 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761d7d8-cb77-4d26-900b-1a9ade800015 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:26.157210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb38376-8841-426b-86a6-2cc8b321f6f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0921de55a53a49558e436e356e36c07a, user_id=606c3840ac0c4b95810370819859886a, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:26.159865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb38376-8841-426b-86a6-2cc8b321f6f8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:26.166207 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1285/2597] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:20:26.170659 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761d7d8-cb77-4d26-900b-1a9ade800015 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:26.177847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1313/2598] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:26 2022] PUT /identity/v3/projects/0921de55a53a49558e436e356e36c07a/users/606c3840ac0c4b95810370819859886a/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:20:26.182216 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb38376-8841-426b-86a6-2cc8b321f6f8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:26.186921 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761d7d8-cb77-4d26-900b-1a9ade800015 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:26.244757 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f425f-e3b4-4127-a114-5cfd0efce5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:26.245509 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f425f-e3b4-4127-a114-5cfd0efce5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.245805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f425f-e3b4-4127-a114-5cfd0efce5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.246074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f425f-e3b4-4127-a114-5cfd0efce5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.246550 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb38376-8841-426b-86a6-2cc8b321f6f8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:26.246789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f425f-e3b4-4127-a114-5cfd0efce5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:26.248388 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f425f-e3b4-4127-a114-5cfd0efce5a7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:26.251177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582004f-5f10-4363-be72-691fa352d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:26.251825 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582004f-5f10-4363-be72-691fa352d775 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.252103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582004f-5f10-4363-be72-691fa352d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.252374 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582004f-5f10-4363-be72-691fa352d775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.253086 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582004f-5f10-4363-be72-691fa352d775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:26.254696 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582004f-5f10-4363-be72-691fa352d775 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:26.258508 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1286/2599] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:20:26.262597 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f425f-e3b4-4127-a114-5cfd0efce5a7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:26.269251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1314/2600] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:20:26.273108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582004f-5f10-4363-be72-691fa352d775 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:26.275494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f425f-e3b4-4127-a114-5cfd0efce5a7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:26.280216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b034d0-1430-49f6-a21e-486bdae0759f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:26.281083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b034d0-1430-49f6-a21e-486bdae0759f admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.281400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b034d0-1430-49f6-a21e-486bdae0759f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.281672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b034d0-1430-49f6-a21e-486bdae0759f admin admin] PATH_INFO: `/v3/projects/d6fab10ab06e4b72ba5a2dcf26c23ef1/users/93a9cfefedd040a9957c7a06c7d18666/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.282652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582004f-5f10-4363-be72-691fa352d775 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:26.287304 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95fbfd-60b8-4324-8eed-d7f3f30d63e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:26.288828 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95fbfd-60b8-4324-8eed-d7f3f30d63e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.289054 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95fbfd-60b8-4324-8eed-d7f3f30d63e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.289327 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95fbfd-60b8-4324-8eed-d7f3f30d63e8 admin admin] PATH_INFO: `/v3/projects/0921de55a53a49558e436e356e36c07a/users/606c3840ac0c4b95810370819859886a/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.291379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95fbfd-60b8-4324-8eed-d7f3f30d63e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0921de55a53a49558e436e356e36c07a, user_id=606c3840ac0c4b95810370819859886a, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:26.294123 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95fbfd-60b8-4324-8eed-d7f3f30d63e8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:26.296709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:26.297248 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b034d0-1430-49f6-a21e-486bdae0759f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fab10ab06e4b72ba5a2dcf26c23ef1, user_id=93a9cfefedd040a9957c7a06c7d18666, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:26.300031 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b034d0-1430-49f6-a21e-486bdae0759f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:26.307416 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1315/2601] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:26 2022] PUT /identity/v3/projects/0921de55a53a49558e436e356e36c07a/users/606c3840ac0c4b95810370819859886a/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:20:26.317350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d675df4-2fda-407b-b780-1edb629cbcf0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.317663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d675df4-2fda-407b-b780-1edb629cbcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.317941 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d675df4-2fda-407b-b780-1edb629cbcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.318057 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1287/2602] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:26 2022] PUT /identity/v3/projects/d6fab10ab06e4b72ba5a2dcf26c23ef1/users/93a9cfefedd040a9957c7a06c7d18666/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:20:26.328429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a3441-46a2-4917-a591-bf304607a021 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.328712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a3441-46a2-4917-a591-bf304607a021 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.328981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a3441-46a2-4917-a591-bf304607a021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.346091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3d675df4-2fda-407b-b780-1edb629cbcf0 None None] MFA Rules not processed for user `606c3840ac0c4b95810370819859886a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:26.347423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3d675df4-2fda-407b-b780-1edb629cbcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:26.355608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2f6a3441-46a2-4917-a591-bf304607a021 None None] MFA Rules not processed for user `93a9cfefedd040a9957c7a06c7d18666`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:26.357244 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2f6a3441-46a2-4917-a591-bf304607a021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:26.425984 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1316/2603] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:26.430441 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1288/2604] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:20:26.435376 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d675df4-2fda-407b-b780-1edb629cbcf0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:26.437709 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a3441-46a2-4917-a591-bf304607a021 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:26.439102 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2f6a3441-46a2-4917-a591-bf304607a021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:26.470072 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:26.517349 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a3441-46a2-4917-a591-bf304607a021 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:26.517835 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d675df4-2fda-407b-b780-1edb629cbcf0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:26.522797 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd089185-2c0e-45f8-8e99-e2b73c3d1b76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:26.523897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd089185-2c0e-45f8-8e99-e2b73c3d1b76 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.524176 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd089185-2c0e-45f8-8e99-e2b73c3d1b76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.524449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd089185-2c0e-45f8-8e99-e2b73c3d1b76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.525936 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52851b4a-38bb-4e4e-832e-1a33ef5280dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:26.526728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52851b4a-38bb-4e4e-832e-1a33ef5280dc admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.527070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52851b4a-38bb-4e4e-832e-1a33ef5280dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.527448 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52851b4a-38bb-4e4e-832e-1a33ef5280dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.528264 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52851b4a-38bb-4e4e-832e-1a33ef5280dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:26.530897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52851b4a-38bb-4e4e-832e-1a33ef5280dc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:26.579724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1317/2605] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:20:26 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:20:26.580766 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52851b4a-38bb-4e4e-832e-1a33ef5280dc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:26.627551 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd089185-2c0e-45f8-8e99-e2b73c3d1b76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:26.629011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd089185-2c0e-45f8-8e99-e2b73c3d1b76 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:26.644663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1289/2606] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:20:26.645925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd089185-2c0e-45f8-8e99-e2b73c3d1b76 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:26.647833 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fd089185-2c0e-45f8-8e99-e2b73c3d1b76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:26.685506 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52851b4a-38bb-4e4e-832e-1a33ef5280dc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:26.691205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e857-1d95-4cde-a5ec-e0f874eb0882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:26.691885 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e857-1d95-4cde-a5ec-e0f874eb0882 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.692174 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e857-1d95-4cde-a5ec-e0f874eb0882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.692452 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e857-1d95-4cde-a5ec-e0f874eb0882 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.693151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90e857-1d95-4cde-a5ec-e0f874eb0882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:26.695837 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90e857-1d95-4cde-a5ec-e0f874eb0882 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:26.707383 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:26.738327 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1318/2607] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:20:26 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:26.739222 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e857-1d95-4cde-a5ec-e0f874eb0882 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:26.742365 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd089185-2c0e-45f8-8e99-e2b73c3d1b76 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:26.750360 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e857-1d95-4cde-a5ec-e0f874eb0882 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:26.755706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1361f1-7a33-4824-ad95-b482939aecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:26.757169 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1361f1-7a33-4824-ad95-b482939aecbb admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.757579 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1361f1-7a33-4824-ad95-b482939aecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.757857 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1361f1-7a33-4824-ad95-b482939aecbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.764210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1361f1-7a33-4824-ad95-b482939aecbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:26.766082 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1361f1-7a33-4824-ad95-b482939aecbb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:26.779607 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1319/2608] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:26.783728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1361f1-7a33-4824-ad95-b482939aecbb admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:26.803801 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1361f1-7a33-4824-ad95-b482939aecbb admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:26.808956 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d61110-7885-4306-bbaf-d81ae20f3117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:26.809794 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b46f98-6fc9-4814-b129-e532a03ca085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:26.810008 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d61110-7885-4306-bbaf-d81ae20f3117 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.810157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d61110-7885-4306-bbaf-d81ae20f3117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.810437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d61110-7885-4306-bbaf-d81ae20f3117 admin admin] PATH_INFO: `/v3/projects/776796aed72047819d95a33c65e86ca7/users/3b7f384fa8644c938728f7d9780073b6/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.810569 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b46f98-6fc9-4814-b129-e532a03ca085 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.810766 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b46f98-6fc9-4814-b129-e532a03ca085 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.811056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b46f98-6fc9-4814-b129-e532a03ca085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.813341 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-71b46f98-6fc9-4814-b129-e532a03ca085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:26.829145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b46f98-6fc9-4814-b129-e532a03ca085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:26.830621 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b46f98-6fc9-4814-b129-e532a03ca085 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:26.835020 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d61110-7885-4306-bbaf-d81ae20f3117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=776796aed72047819d95a33c65e86ca7, user_id=3b7f384fa8644c938728f7d9780073b6, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:26.839536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d61110-7885-4306-bbaf-d81ae20f3117 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:26.842971 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1290/2609] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:26.864029 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1320/2610] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:26 2022] PUT /identity/v3/projects/776796aed72047819d95a33c65e86ca7/users/3b7f384fa8644c938728f7d9780073b6/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:20:26.864985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b46f98-6fc9-4814-b129-e532a03ca085 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:26.876851 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b46f98-6fc9-4814-b129-e532a03ca085 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:26.923655 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:26.964225 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f8ee1-5a2b-4dce-895f-a7289221a3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:26.964965 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f8ee1-5a2b-4dce-895f-a7289221a3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:26.965257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f8ee1-5a2b-4dce-895f-a7289221a3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:26.965577 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f8ee1-5a2b-4dce-895f-a7289221a3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:26.966366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f8ee1-5a2b-4dce-895f-a7289221a3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:26.968301 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f8ee1-5a2b-4dce-895f-a7289221a3c1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:26.981701 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1291/2611] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:26.985466 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d61110-7885-4306-bbaf-d81ae20f3117 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:26.997196 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d61110-7885-4306-bbaf-d81ae20f3117 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:27.002537 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fefa-9385-4a17-badc-190f6034b8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:27.003587 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fefa-9385-4a17-badc-190f6034b8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:27.003872 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fefa-9385-4a17-badc-190f6034b8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:27.004930 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fefa-9385-4a17-badc-190f6034b8f7 admin admin] PATH_INFO: `/v3/projects/776796aed72047819d95a33c65e86ca7/users/3b7f384fa8644c938728f7d9780073b6/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:27.007748 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710fefa-9385-4a17-badc-190f6034b8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=776796aed72047819d95a33c65e86ca7, user_id=3b7f384fa8644c938728f7d9780073b6, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:27.010494 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710fefa-9385-4a17-badc-190f6034b8f7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:27.029166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1321/2612] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:26 2022] PUT /identity/v3/projects/776796aed72047819d95a33c65e86ca7/users/3b7f384fa8644c938728f7d9780073b6/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:27.040297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978300c-8bd5-4ab5-803b-cffae4d0c667 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:27.040670 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978300c-8bd5-4ab5-803b-cffae4d0c667 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:27.041016 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978300c-8bd5-4ab5-803b-cffae4d0c667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:27.112865 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9978300c-8bd5-4ab5-803b-cffae4d0c667 None None] MFA Rules not processed for user `3b7f384fa8644c938728f7d9780073b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:27.117530 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9978300c-8bd5-4ab5-803b-cffae4d0c667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:27.230332 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1292/2613] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:27.243602 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fefa-9385-4a17-badc-190f6034b8f7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:27.245295 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b710fefa-9385-4a17-badc-190f6034b8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:27.308194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fefa-9385-4a17-badc-190f6034b8f7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:27.312769 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149d3c-4e38-4f2d-81ba-674f2fdd2fed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:27.313496 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149d3c-4e38-4f2d-81ba-674f2fdd2fed service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:27.313777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149d3c-4e38-4f2d-81ba-674f2fdd2fed service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:27.314056 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149d3c-4e38-4f2d-81ba-674f2fdd2fed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:27.324277 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e149d3c-4e38-4f2d-81ba-674f2fdd2fed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:27.325755 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e149d3c-4e38-4f2d-81ba-674f2fdd2fed service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:27.335821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1322/2614] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:27.647991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978300c-8bd5-4ab5-803b-cffae4d0c667 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:27.657233 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978300c-8bd5-4ab5-803b-cffae4d0c667 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:27.661930 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468d97d-98e0-4c43-976e-c2294e786c8a tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b7f384fa8644c938728f7d9780073b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '776796aed72047819d95a33c65e86ca7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:27.663253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468d97d-98e0-4c43-976e-c2294e786c8a tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:27.663604 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468d97d-98e0-4c43-976e-c2294e786c8a tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:27.663946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468d97d-98e0-4c43-976e-c2294e786c8a tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:27.664748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468d97d-98e0-4c43-976e-c2294e786c8a tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:20:27.665120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468d97d-98e0-4c43-976e-c2294e786c8a tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:27.666813 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468d97d-98e0-4c43-976e-c2294e786c8a tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:27.681720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1293/2615] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:20:27.682773 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149d3c-4e38-4f2d-81ba-674f2fdd2fed service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:27.691916 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149d3c-4e38-4f2d-81ba-674f2fdd2fed service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:27.697819 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7073d-7ee1-4014-bd67-f3562b9ff3b9 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b7f384fa8644c938728f7d9780073b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '776796aed72047819d95a33c65e86ca7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:27.698552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7073d-7ee1-4014-bd67-f3562b9ff3b9 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:27.698829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7073d-7ee1-4014-bd67-f3562b9ff3b9 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:27.699109 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7073d-7ee1-4014-bd67-f3562b9ff3b9 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:27.699805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7073d-7ee1-4014-bd67-f3562b9ff3b9 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:27.701818 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7073d-7ee1-4014-bd67-f3562b9ff3b9 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:27.728075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1323/2616] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:20:27 2022] POST /identity/v3/projects => generated 354 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:20:27.732166 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468d97d-98e0-4c43-976e-c2294e786c8a tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:27.742694 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468d97d-98e0-4c43-976e-c2294e786c8a tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:27.810288 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316badb6-f233-4289-bb39-890d6a54e312 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b7f384fa8644c938728f7d9780073b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '776796aed72047819d95a33c65e86ca7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:27.810928 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316badb6-f233-4289-bb39-890d6a54e312 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:27.811213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316badb6-f233-4289-bb39-890d6a54e312 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:27.811495 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316badb6-f233-4289-bb39-890d6a54e312 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:27.812229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316badb6-f233-4289-bb39-890d6a54e312 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:20:27.812542 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316badb6-f233-4289-bb39-890d6a54e312 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:27.814270 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316badb6-f233-4289-bb39-890d6a54e312 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:27.834256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1294/2617] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:20:27.874871 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7073d-7ee1-4014-bd67-f3562b9ff3b9 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:27.887689 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7073d-7ee1-4014-bd67-f3562b9ff3b9 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:27.893463 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941a174-fb8c-40b4-95cb-0b2784ee2d23 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b7f384fa8644c938728f7d9780073b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '776796aed72047819d95a33c65e86ca7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:27.894817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941a174-fb8c-40b4-95cb-0b2784ee2d23 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:27.895189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941a174-fb8c-40b4-95cb-0b2784ee2d23 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:27.895655 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941a174-fb8c-40b4-95cb-0b2784ee2d23 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] PATH_INFO: `/v3/projects/6755d2df4a8d44fc91adccdb421dffbf` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:27.897330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941a174-fb8c-40b4-95cb-0b2784ee2d23 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6755d2df4a8d44fc91adccdb421dffbf)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:27.899978 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941a174-fb8c-40b4-95cb-0b2784ee2d23 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:27.957298 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4941a174-fb8c-40b4-95cb-0b2784ee2d23 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6755d2df4a8d44fc91adccdb421dffbf', 'request_id': 'req-4941a174-fb8c-40b4-95cb-0b2784ee2d23'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:27.967199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4941a174-fb8c-40b4-95cb-0b2784ee2d23 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6755d2df4a8d44fc91adccdb421dffbf', 'request_id': 'req-4941a174-fb8c-40b4-95cb-0b2784ee2d23'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:27.974120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4941a174-fb8c-40b4-95cb-0b2784ee2d23 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6755d2df4a8d44fc91adccdb421dffbf', 'request_id': 'req-4941a174-fb8c-40b4-95cb-0b2784ee2d23'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:27.987596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4941a174-fb8c-40b4-95cb-0b2784ee2d23 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] The token cache is being invalidate because project 6755d2df4a8d44fc91adccdb421dffbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:27.988411 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4941a174-fb8c-40b4-95cb-0b2784ee2d23 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:27.989211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4941a174-fb8c-40b4-95cb-0b2784ee2d23 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:27.991418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1324/2618] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:27 2022] DELETE /identity/v3/projects/6755d2df4a8d44fc91adccdb421dffbf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:28.203473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316badb6-f233-4289-bb39-890d6a54e312 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:28.206088 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-316badb6-f233-4289-bb39-890d6a54e312 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:28.254719 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:28.291011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316badb6-f233-4289-bb39-890d6a54e312 tempest-VolumeQuotaClassesTest-353264033 tempest-VolumeQuotaClassesTest-353264033-project-admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:28.356149 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd608671-c0bf-48c3-acb8-cb18f7038c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:28.357028 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd608671-c0bf-48c3-acb8-cb18f7038c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:28.357836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd608671-c0bf-48c3-acb8-cb18f7038c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:28.357836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd608671-c0bf-48c3-acb8-cb18f7038c5c admin admin] PATH_INFO: `/v3/users/93a9cfefedd040a9957c7a06c7d18666` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:28.358867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd608671-c0bf-48c3-acb8-cb18f7038c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a9cfefedd040a9957c7a06c7d18666)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:28.361000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd608671-c0bf-48c3-acb8-cb18f7038c5c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:28.426324 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cd608671-c0bf-48c3-acb8-cb18f7038c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a9cfefedd040a9957c7a06c7d18666'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:28.440527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cd608671-c0bf-48c3-acb8-cb18f7038c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a9cfefedd040a9957c7a06c7d18666'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:28.441738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cd608671-c0bf-48c3-acb8-cb18f7038c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a9cfefedd040a9957c7a06c7d18666'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:28.442493 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cd608671-c0bf-48c3-acb8-cb18f7038c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a9cfefedd040a9957c7a06c7d18666'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:28.450896 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cd608671-c0bf-48c3-acb8-cb18f7038c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a9cfefedd040a9957c7a06c7d18666'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:28.471769 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1295/2619] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:28 2022] DELETE /identity/v3/users/93a9cfefedd040a9957c7a06c7d18666 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:28.477985 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549adc8a-76c2-4a28-9efa-8f1696c261c6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:28.478454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549adc8a-76c2-4a28-9efa-8f1696c261c6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:28.478893 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549adc8a-76c2-4a28-9efa-8f1696c261c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:28.514507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-549adc8a-76c2-4a28-9efa-8f1696c261c6 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:28.515789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-549adc8a-76c2-4a28-9efa-8f1696c261c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:28.536588 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:28.687523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1325/2620] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:28.700253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd608671-c0bf-48c3-acb8-cb18f7038c5c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:28.706046 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cd608671-c0bf-48c3-acb8-cb18f7038c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:28.824825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd608671-c0bf-48c3-acb8-cb18f7038c5c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:28.830478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1ba16-0e81-41ed-a0d3-224fb34a5861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:28.832379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1ba16-0e81-41ed-a0d3-224fb34a5861 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:28.832845 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1ba16-0e81-41ed-a0d3-224fb34a5861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:28.837656 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1ba16-0e81-41ed-a0d3-224fb34a5861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:28.858529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1ba16-0e81-41ed-a0d3-224fb34a5861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:28.860107 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1ba16-0e81-41ed-a0d3-224fb34a5861 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:28.877015 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1296/2621] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:29.183957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549adc8a-76c2-4a28-9efa-8f1696c261c6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:29.186448 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-549adc8a-76c2-4a28-9efa-8f1696c261c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:29.199078 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549adc8a-76c2-4a28-9efa-8f1696c261c6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:29.215660 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320560cf-bf57-4553-9552-8d2408a8aeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:29.216874 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320560cf-bf57-4553-9552-8d2408a8aeb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:29.217749 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320560cf-bf57-4553-9552-8d2408a8aeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:29.218194 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320560cf-bf57-4553-9552-8d2408a8aeb7 admin admin] PATH_INFO: `/v3/projects/d6fab10ab06e4b72ba5a2dcf26c23ef1` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:29.221018 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320560cf-bf57-4553-9552-8d2408a8aeb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6fab10ab06e4b72ba5a2dcf26c23ef1)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:29.223019 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320560cf-bf57-4553-9552-8d2408a8aeb7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:29.276996 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-320560cf-bf57-4553-9552-8d2408a8aeb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6fab10ab06e4b72ba5a2dcf26c23ef1', 'request_id': 'req-320560cf-bf57-4553-9552-8d2408a8aeb7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:29.286417 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-320560cf-bf57-4553-9552-8d2408a8aeb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6fab10ab06e4b72ba5a2dcf26c23ef1', 'request_id': 'req-320560cf-bf57-4553-9552-8d2408a8aeb7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:29.294672 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-320560cf-bf57-4553-9552-8d2408a8aeb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6fab10ab06e4b72ba5a2dcf26c23ef1', 'request_id': 'req-320560cf-bf57-4553-9552-8d2408a8aeb7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:29.315963 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-320560cf-bf57-4553-9552-8d2408a8aeb7 admin admin] The token cache is being invalidate because project d6fab10ab06e4b72ba5a2dcf26c23ef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:29.316312 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-320560cf-bf57-4553-9552-8d2408a8aeb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:29.316888 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-320560cf-bf57-4553-9552-8d2408a8aeb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:29.318464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1326/2622] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:29 2022] DELETE /identity/v3/projects/d6fab10ab06e4b72ba5a2dcf26c23ef1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:29.323069 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1ba16-0e81-41ed-a0d3-224fb34a5861 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:29.333589 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1ba16-0e81-41ed-a0d3-224fb34a5861 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:29.339194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:29.415370 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daf424-d680-4763-a206-57cfff23d6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:29.416191 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daf424-d680-4763-a206-57cfff23d6da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:29.416477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daf424-d680-4763-a206-57cfff23d6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:29.416757 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daf424-d680-4763-a206-57cfff23d6da admin admin] PATH_INFO: `/v3/users/3b7f384fa8644c938728f7d9780073b6` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:29.417985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1daf424-d680-4763-a206-57cfff23d6da admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7f384fa8644c938728f7d9780073b6)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:29.419985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1daf424-d680-4763-a206-57cfff23d6da admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:29.471730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b1daf424-d680-4763-a206-57cfff23d6da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7f384fa8644c938728f7d9780073b6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:29.484820 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b1daf424-d680-4763-a206-57cfff23d6da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7f384fa8644c938728f7d9780073b6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:29.485561 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b1daf424-d680-4763-a206-57cfff23d6da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7f384fa8644c938728f7d9780073b6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:29.486180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b1daf424-d680-4763-a206-57cfff23d6da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7f384fa8644c938728f7d9780073b6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:29.494854 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b1daf424-d680-4763-a206-57cfff23d6da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7f384fa8644c938728f7d9780073b6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:29.509630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1297/2623] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:29 2022] DELETE /identity/v3/users/3b7f384fa8644c938728f7d9780073b6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:29.852871 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320560cf-bf57-4553-9552-8d2408a8aeb7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:29.854495 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-320560cf-bf57-4553-9552-8d2408a8aeb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:29.877499 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320560cf-bf57-4553-9552-8d2408a8aeb7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:30.010422 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674b263-5f22-43ca-b407-1e6fc610db61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:30.011884 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674b263-5f22-43ca-b407-1e6fc610db61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:30.012597 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674b263-5f22-43ca-b407-1e6fc610db61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:30.013167 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674b263-5f22-43ca-b407-1e6fc610db61 admin admin] PATH_INFO: `/v3/projects/776796aed72047819d95a33c65e86ca7` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:30.015120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674b263-5f22-43ca-b407-1e6fc610db61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=776796aed72047819d95a33c65e86ca7)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:30.018302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674b263-5f22-43ca-b407-1e6fc610db61 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:30.122610 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:30.150448 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3674b263-5f22-43ca-b407-1e6fc610db61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '776796aed72047819d95a33c65e86ca7', 'request_id': 'req-3674b263-5f22-43ca-b407-1e6fc610db61'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:30.174072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3674b263-5f22-43ca-b407-1e6fc610db61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '776796aed72047819d95a33c65e86ca7', 'request_id': 'req-3674b263-5f22-43ca-b407-1e6fc610db61'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:30.189731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3674b263-5f22-43ca-b407-1e6fc610db61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '776796aed72047819d95a33c65e86ca7', 'request_id': 'req-3674b263-5f22-43ca-b407-1e6fc610db61'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:30.219802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3674b263-5f22-43ca-b407-1e6fc610db61 admin admin] The token cache is being invalidate because project 776796aed72047819d95a33c65e86ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:30.220099 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3674b263-5f22-43ca-b407-1e6fc610db61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:30.220777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3674b263-5f22-43ca-b407-1e6fc610db61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:30.222353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1327/2624] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:29 2022] DELETE /identity/v3/projects/776796aed72047819d95a33c65e86ca7 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:20:30.239934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580451-0e58-4116-9451-3c3cf00e8b08 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:30.239934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580451-0e58-4116-9451-3c3cf00e8b08 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:30.239934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580451-0e58-4116-9451-3c3cf00e8b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:30.296964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cb580451-0e58-4116-9451-3c3cf00e8b08 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:30.296964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cb580451-0e58-4116-9451-3c3cf00e8b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:30.410491 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1298/2625] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:30.423037 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcc46b-726d-40f7-8876-4efb013264f2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:30.423331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcc46b-726d-40f7-8876-4efb013264f2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:30.423618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcc46b-726d-40f7-8876-4efb013264f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:30.454154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e7dcc46b-726d-40f7-8876-4efb013264f2 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:30.455667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e7dcc46b-726d-40f7-8876-4efb013264f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:30.467691 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1328/2626] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:30.468391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb580451-0e58-4116-9451-3c3cf00e8b08 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:30.481221 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb580451-0e58-4116-9451-3c3cf00e8b08 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:30.486187 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4739d-fc75-4a7e-8aff-83cda141d391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:30.487373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4739d-fc75-4a7e-8aff-83cda141d391 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:30.487471 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4739d-fc75-4a7e-8aff-83cda141d391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:30.487832 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4739d-fc75-4a7e-8aff-83cda141d391 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:30.488663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4739d-fc75-4a7e-8aff-83cda141d391 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:20:30.489137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4739d-fc75-4a7e-8aff-83cda141d391 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:30.491642 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4739d-fc75-4a7e-8aff-83cda141d391 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:30.505514 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1299/2627] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:20:30.510723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcc46b-726d-40f7-8876-4efb013264f2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:30.521523 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcc46b-726d-40f7-8876-4efb013264f2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:30.529212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8b5d8-617a-4e97-a264-45d109878caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:30.530173 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8b5d8-617a-4e97-a264-45d109878caf admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:30.530632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8b5d8-617a-4e97-a264-45d109878caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:30.531061 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8b5d8-617a-4e97-a264-45d109878caf admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:30.531901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8b5d8-617a-4e97-a264-45d109878caf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:30.534009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8b5d8-617a-4e97-a264-45d109878caf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:30.567644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1329/2628] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:20:30 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:30.572342 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4739d-fc75-4a7e-8aff-83cda141d391 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:30.585955 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4739d-fc75-4a7e-8aff-83cda141d391 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:30.596001 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:30.659626 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19868c9-4d7a-477b-b6a2-b48177b2c908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:30.660331 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19868c9-4d7a-477b-b6a2-b48177b2c908 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:30.660619 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19868c9-4d7a-477b-b6a2-b48177b2c908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:30.660898 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19868c9-4d7a-477b-b6a2-b48177b2c908 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:30.661631 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19868c9-4d7a-477b-b6a2-b48177b2c908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:30.664552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19868c9-4d7a-477b-b6a2-b48177b2c908 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:30.686580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1300/2629] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:20:30 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:30.690689 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8b5d8-617a-4e97-a264-45d109878caf admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:30.701080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8b5d8-617a-4e97-a264-45d109878caf admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:30.707162 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714aaa0-1767-497f-a53d-cf98ce4089ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:30.708287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714aaa0-1767-497f-a53d-cf98ce4089ef admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:30.708639 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714aaa0-1767-497f-a53d-cf98ce4089ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:30.708924 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714aaa0-1767-497f-a53d-cf98ce4089ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:30.710249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714aaa0-1767-497f-a53d-cf98ce4089ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:30.711848 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714aaa0-1767-497f-a53d-cf98ce4089ef admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:30.722576 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1330/2630] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:30.727267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19868c9-4d7a-477b-b6a2-b48177b2c908 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:30.737652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19868c9-4d7a-477b-b6a2-b48177b2c908 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:30.742389 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e4e6e-7004-43c3-b33c-ff1356db888e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:30.743123 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e4e6e-7004-43c3-b33c-ff1356db888e admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:30.743431 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e4e6e-7004-43c3-b33c-ff1356db888e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:30.743695 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e4e6e-7004-43c3-b33c-ff1356db888e admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:30.744419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e4e6e-7004-43c3-b33c-ff1356db888e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:30.746079 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e4e6e-7004-43c3-b33c-ff1356db888e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:30.759059 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1301/2631] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:20:30.760173 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714aaa0-1767-497f-a53d-cf98ce4089ef admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:30.770821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714aaa0-1767-497f-a53d-cf98ce4089ef admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:30.775961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80af03-ac3a-40f6-bd4c-a8fba2732a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:30.776835 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80af03-ac3a-40f6-bd4c-a8fba2732a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:30.777117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80af03-ac3a-40f6-bd4c-a8fba2732a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:30.777421 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80af03-ac3a-40f6-bd4c-a8fba2732a51 admin admin] PATH_INFO: `/v3/projects/a225741f31e840bda39fb5098114d1ea/users/0aa27f76ec064922b6f1bf80130c51af/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:30.792332 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80af03-ac3a-40f6-bd4c-a8fba2732a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a225741f31e840bda39fb5098114d1ea, user_id=0aa27f76ec064922b6f1bf80130c51af, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:30.795036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80af03-ac3a-40f6-bd4c-a8fba2732a51 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:30.813940 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1331/2632] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:30 2022] PUT /identity/v3/projects/a225741f31e840bda39fb5098114d1ea/users/0aa27f76ec064922b6f1bf80130c51af/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:20:30.820255 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54e3fd-ac5d-4a14-a1bc-1d06b930c288 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:30.820545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54e3fd-ac5d-4a14-a1bc-1d06b930c288 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:30.820825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54e3fd-ac5d-4a14-a1bc-1d06b930c288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:30.847557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4e54e3fd-ac5d-4a14-a1bc-1d06b930c288 None None] MFA Rules not processed for user `0aa27f76ec064922b6f1bf80130c51af`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:30.848768 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4e54e3fd-ac5d-4a14-a1bc-1d06b930c288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:30.914417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1302/2633] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:30.925549 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80af03-ac3a-40f6-bd4c-a8fba2732a51 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:30.927331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5b80af03-ac3a-40f6-bd4c-a8fba2732a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:30.985504 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80af03-ac3a-40f6-bd4c-a8fba2732a51 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:30.989092 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e372def-a231-4ca4-85a3-a8756bd2998a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:30.989803 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e372def-a231-4ca4-85a3-a8756bd2998a service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:30.990082 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e372def-a231-4ca4-85a3-a8756bd2998a service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:30.990354 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e372def-a231-4ca4-85a3-a8756bd2998a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:31.000543 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e372def-a231-4ca4-85a3-a8756bd2998a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:31.002024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e372def-a231-4ca4-85a3-a8756bd2998a service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:31.011988 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1332/2634] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:31.428467 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54e3fd-ac5d-4a14-a1bc-1d06b930c288 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:31.438046 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54e3fd-ac5d-4a14-a1bc-1d06b930c288 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:31.443328 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a41571-fea6-4d4f-8e65-0441ac1f7409 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:31.458110 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a41571-fea6-4d4f-8e65-0441ac1f7409 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:31.458615 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a41571-fea6-4d4f-8e65-0441ac1f7409 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:31.459061 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a41571-fea6-4d4f-8e65-0441ac1f7409 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:31.461544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c7a41571-fea6-4d4f-8e65-0441ac1f7409 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:31.554839 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a41571-fea6-4d4f-8e65-0441ac1f7409 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:31.556503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a41571-fea6-4d4f-8e65-0441ac1f7409 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:31.575323 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1303/2635] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:34.028199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e372def-a231-4ca4-85a3-a8756bd2998a service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:34.028199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7e372def-a231-4ca4-85a3-a8756bd2998a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:34.096745 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e372def-a231-4ca4-85a3-a8756bd2998a service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:34.101710 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577ab35-cba2-4d3c-9921-359dfa339bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:34.102568 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577ab35-cba2-4d3c-9921-359dfa339bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:34.102848 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577ab35-cba2-4d3c-9921-359dfa339bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:34.103120 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577ab35-cba2-4d3c-9921-359dfa339bac admin admin] PATH_INFO: `/v3/users/3ce30513dcc846fc82ec79a1d68ad4ce` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:34.104291 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577ab35-cba2-4d3c-9921-359dfa339bac admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce30513dcc846fc82ec79a1d68ad4ce)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:34.106204 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577ab35-cba2-4d3c-9921-359dfa339bac admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:34.108416 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:34.155403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e577ab35-cba2-4d3c-9921-359dfa339bac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce30513dcc846fc82ec79a1d68ad4ce'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.167453 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e577ab35-cba2-4d3c-9921-359dfa339bac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce30513dcc846fc82ec79a1d68ad4ce'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.168117 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e577ab35-cba2-4d3c-9921-359dfa339bac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce30513dcc846fc82ec79a1d68ad4ce'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.168727 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e577ab35-cba2-4d3c-9921-359dfa339bac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce30513dcc846fc82ec79a1d68ad4ce'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.175801 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e577ab35-cba2-4d3c-9921-359dfa339bac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce30513dcc846fc82ec79a1d68ad4ce'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.188761 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1333/2636] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:34 2022] DELETE /identity/v3/users/3ce30513dcc846fc82ec79a1d68ad4ce => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:34.364313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a41571-fea6-4d4f-8e65-0441ac1f7409 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:34.379297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a41571-fea6-4d4f-8e65-0441ac1f7409 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:34.391062 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:34.437893 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6a9de-d499-4ede-ab21-28a4dc87c447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:34.438756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6a9de-d499-4ede-ab21-28a4dc87c447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:34.439041 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6a9de-d499-4ede-ab21-28a4dc87c447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:34.439316 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6a9de-d499-4ede-ab21-28a4dc87c447 admin admin] PATH_INFO: `/v3/projects/1f6e17b6e64c4eb1a8e6f358c3e1bcbb` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:34.440488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6a9de-d499-4ede-ab21-28a4dc87c447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f6e17b6e64c4eb1a8e6f358c3e1bcbb)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:34.442438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6a9de-d499-4ede-ab21-28a4dc87c447 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:34.487223 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-09a6a9de-d499-4ede-ab21-28a4dc87c447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f6e17b6e64c4eb1a8e6f358c3e1bcbb', 'request_id': 'req-09a6a9de-d499-4ede-ab21-28a4dc87c447'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.493702 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-09a6a9de-d499-4ede-ab21-28a4dc87c447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f6e17b6e64c4eb1a8e6f358c3e1bcbb', 'request_id': 'req-09a6a9de-d499-4ede-ab21-28a4dc87c447'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.499733 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-09a6a9de-d499-4ede-ab21-28a4dc87c447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f6e17b6e64c4eb1a8e6f358c3e1bcbb', 'request_id': 'req-09a6a9de-d499-4ede-ab21-28a4dc87c447'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.513308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-09a6a9de-d499-4ede-ab21-28a4dc87c447 admin admin] The token cache is being invalidate because project 1f6e17b6e64c4eb1a8e6f358c3e1bcbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:34.513640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-09a6a9de-d499-4ede-ab21-28a4dc87c447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.514257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-09a6a9de-d499-4ede-ab21-28a4dc87c447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.515790 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1304/2637] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:34 2022] DELETE /identity/v3/projects/1f6e17b6e64c4eb1a8e6f358c3e1bcbb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:34.520145 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577ab35-cba2-4d3c-9921-359dfa339bac admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:34.522166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e577ab35-cba2-4d3c-9921-359dfa339bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:34.536626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577ab35-cba2-4d3c-9921-359dfa339bac admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:34.594638 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f20c9-16a4-4917-9159-539a011d00ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:34.595511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f20c9-16a4-4917-9159-539a011d00ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:34.595790 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f20c9-16a4-4917-9159-539a011d00ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:34.596063 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f20c9-16a4-4917-9159-539a011d00ea admin admin] PATH_INFO: `/v3/users/e3c2cdaa5c69445f804fcb1dc21b848f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:34.597250 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f20c9-16a4-4917-9159-539a011d00ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3c2cdaa5c69445f804fcb1dc21b848f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:34.599254 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f20c9-16a4-4917-9159-539a011d00ea admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:34.644789 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ff3f20c9-16a4-4917-9159-539a011d00ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3c2cdaa5c69445f804fcb1dc21b848f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.657941 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ff3f20c9-16a4-4917-9159-539a011d00ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3c2cdaa5c69445f804fcb1dc21b848f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.658642 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ff3f20c9-16a4-4917-9159-539a011d00ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3c2cdaa5c69445f804fcb1dc21b848f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.659251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ff3f20c9-16a4-4917-9159-539a011d00ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3c2cdaa5c69445f804fcb1dc21b848f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.666652 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ff3f20c9-16a4-4917-9159-539a011d00ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3c2cdaa5c69445f804fcb1dc21b848f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.675129 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:34.680168 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1334/2638] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:34 2022] DELETE /identity/v3/users/e3c2cdaa5c69445f804fcb1dc21b848f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:34.848907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6a9de-d499-4ede-ab21-28a4dc87c447 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:34.850366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-09a6a9de-d499-4ede-ab21-28a4dc87c447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:34.865222 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6a9de-d499-4ede-ab21-28a4dc87c447 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:34.922335 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023c10c-7f8d-4216-8af8-c390390e7f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:34.923189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023c10c-7f8d-4216-8af8-c390390e7f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:34.923470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023c10c-7f8d-4216-8af8-c390390e7f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:34.923745 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023c10c-7f8d-4216-8af8-c390390e7f93 admin admin] PATH_INFO: `/v3/projects/82befa97308542d88aa2b5a29dcb4299` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:34.924904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023c10c-7f8d-4216-8af8-c390390e7f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82befa97308542d88aa2b5a29dcb4299)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:34.926818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023c10c-7f8d-4216-8af8-c390390e7f93 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:34.970766 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:34.972109 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f023c10c-7f8d-4216-8af8-c390390e7f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82befa97308542d88aa2b5a29dcb4299', 'request_id': 'req-f023c10c-7f8d-4216-8af8-c390390e7f93'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.978868 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f023c10c-7f8d-4216-8af8-c390390e7f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82befa97308542d88aa2b5a29dcb4299', 'request_id': 'req-f023c10c-7f8d-4216-8af8-c390390e7f93'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.984929 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f023c10c-7f8d-4216-8af8-c390390e7f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82befa97308542d88aa2b5a29dcb4299', 'request_id': 'req-f023c10c-7f8d-4216-8af8-c390390e7f93'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.998224 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f023c10c-7f8d-4216-8af8-c390390e7f93 admin admin] The token cache is being invalidate because project 82befa97308542d88aa2b5a29dcb4299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:34.998509 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f023c10c-7f8d-4216-8af8-c390390e7f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:34.999120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f023c10c-7f8d-4216-8af8-c390390e7f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:35.000633 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1305/2639] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:34 2022] DELETE /identity/v3/projects/82befa97308542d88aa2b5a29dcb4299 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:39.651575 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f20c9-16a4-4917-9159-539a011d00ea admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:39.653054 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ff3f20c9-16a4-4917-9159-539a011d00ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:39.665978 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f20c9-16a4-4917-9159-539a011d00ea admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:39.724226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60575220-3afd-4270-b9be-9904cc0d6ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:39.725091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60575220-3afd-4270-b9be-9904cc0d6ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:39.725386 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60575220-3afd-4270-b9be-9904cc0d6ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:39.725695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60575220-3afd-4270-b9be-9904cc0d6ae1 admin admin] PATH_INFO: `/v3/users/4c1daaf1d00545f280999dd3d717d570` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:39.726853 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60575220-3afd-4270-b9be-9904cc0d6ae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1daaf1d00545f280999dd3d717d570)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:39.728767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60575220-3afd-4270-b9be-9904cc0d6ae1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:39.774392 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-60575220-3afd-4270-b9be-9904cc0d6ae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1daaf1d00545f280999dd3d717d570'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:39.791903 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-60575220-3afd-4270-b9be-9904cc0d6ae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1daaf1d00545f280999dd3d717d570'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:39.792628 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-60575220-3afd-4270-b9be-9904cc0d6ae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1daaf1d00545f280999dd3d717d570'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:39.793227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-60575220-3afd-4270-b9be-9904cc0d6ae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1daaf1d00545f280999dd3d717d570'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:39.808345 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-60575220-3afd-4270-b9be-9904cc0d6ae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1daaf1d00545f280999dd3d717d570'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:39.821429 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1335/2640] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:39 2022] DELETE /identity/v3/users/4c1daaf1d00545f280999dd3d717d570 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:39.825860 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21174-20ea-4a99-b583-0476ba3378af None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:39.826360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21174-20ea-4a99-b583-0476ba3378af None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:39.826570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21174-20ea-4a99-b583-0476ba3378af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:39.843812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-35a21174-20ea-4a99-b583-0476ba3378af None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:39.844996 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-35a21174-20ea-4a99-b583-0476ba3378af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:39.904781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1306/2641] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:39.915183 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60575220-3afd-4270-b9be-9904cc0d6ae1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:39.916580 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-60575220-3afd-4270-b9be-9904cc0d6ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:39.972826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60575220-3afd-4270-b9be-9904cc0d6ae1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:39.977017 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f77fc-c7ab-40fa-8ec2-3e9c4a3fd0a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:39.977687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f77fc-c7ab-40fa-8ec2-3e9c4a3fd0a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:39.977976 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f77fc-c7ab-40fa-8ec2-3e9c4a3fd0a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:39.978258 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f77fc-c7ab-40fa-8ec2-3e9c4a3fd0a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:39.987225 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f77fc-c7ab-40fa-8ec2-3e9c4a3fd0a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:39.988657 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f77fc-c7ab-40fa-8ec2-3e9c4a3fd0a0 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:39.998981 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1336/2642] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:40.262213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a21174-20ea-4a99-b583-0476ba3378af None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:40.263722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-35a21174-20ea-4a99-b583-0476ba3378af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:40.275908 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a21174-20ea-4a99-b583-0476ba3378af None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:40.280662 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af8941-af87-4f65-a0a7-00b5106de078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:40.281550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af8941-af87-4f65-a0a7-00b5106de078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:40.281828 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af8941-af87-4f65-a0a7-00b5106de078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:40.282112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af8941-af87-4f65-a0a7-00b5106de078 admin admin] PATH_INFO: `/v3/projects/8f8eafd73df84a33b635aff0ca1cdcd9` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:40.283264 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af8941-af87-4f65-a0a7-00b5106de078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8eafd73df84a33b635aff0ca1cdcd9)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:40.285155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af8941-af87-4f65-a0a7-00b5106de078 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:40.339434 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-92af8941-af87-4f65-a0a7-00b5106de078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8eafd73df84a33b635aff0ca1cdcd9', 'request_id': 'req-92af8941-af87-4f65-a0a7-00b5106de078'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.346273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-92af8941-af87-4f65-a0a7-00b5106de078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8eafd73df84a33b635aff0ca1cdcd9', 'request_id': 'req-92af8941-af87-4f65-a0a7-00b5106de078'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.352735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-92af8941-af87-4f65-a0a7-00b5106de078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8eafd73df84a33b635aff0ca1cdcd9', 'request_id': 'req-92af8941-af87-4f65-a0a7-00b5106de078'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.366927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-92af8941-af87-4f65-a0a7-00b5106de078 admin admin] The token cache is being invalidate because project 8f8eafd73df84a33b635aff0ca1cdcd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:40.367215 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-92af8941-af87-4f65-a0a7-00b5106de078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.367867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-92af8941-af87-4f65-a0a7-00b5106de078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.370173 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1307/2643] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:40 2022] DELETE /identity/v3/projects/8f8eafd73df84a33b635aff0ca1cdcd9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:40.374437 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f77fc-c7ab-40fa-8ec2-3e9c4a3fd0a0 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:40.385287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f77fc-c7ab-40fa-8ec2-3e9c4a3fd0a0 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:40.405342 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:40.448065 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08430e1-75d2-4fb7-9e11-98c3c41f8541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:40.448940 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08430e1-75d2-4fb7-9e11-98c3c41f8541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:40.449227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08430e1-75d2-4fb7-9e11-98c3c41f8541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:40.449544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08430e1-75d2-4fb7-9e11-98c3c41f8541 admin admin] PATH_INFO: `/v3/users/606c3840ac0c4b95810370819859886a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:40.450837 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08430e1-75d2-4fb7-9e11-98c3c41f8541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=606c3840ac0c4b95810370819859886a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:40.452873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08430e1-75d2-4fb7-9e11-98c3c41f8541 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:40.472004 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af8941-af87-4f65-a0a7-00b5106de078 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:40.473502 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-92af8941-af87-4f65-a0a7-00b5106de078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:40.487110 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af8941-af87-4f65-a0a7-00b5106de078 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:40.492492 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01eed59-ae8e-4afe-acac-3d5fd0660be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:40.493354 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01eed59-ae8e-4afe-acac-3d5fd0660be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:40.493660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01eed59-ae8e-4afe-acac-3d5fd0660be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:40.493935 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01eed59-ae8e-4afe-acac-3d5fd0660be2 admin admin] PATH_INFO: `/v3/users/0aa27f76ec064922b6f1bf80130c51af` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:40.495260 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01eed59-ae8e-4afe-acac-3d5fd0660be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa27f76ec064922b6f1bf80130c51af)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:40.497155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01eed59-ae8e-4afe-acac-3d5fd0660be2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:40.503250 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c08430e1-75d2-4fb7-9e11-98c3c41f8541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '606c3840ac0c4b95810370819859886a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.515801 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c08430e1-75d2-4fb7-9e11-98c3c41f8541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '606c3840ac0c4b95810370819859886a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.516539 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c08430e1-75d2-4fb7-9e11-98c3c41f8541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '606c3840ac0c4b95810370819859886a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.517153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c08430e1-75d2-4fb7-9e11-98c3c41f8541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '606c3840ac0c4b95810370819859886a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.525669 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c08430e1-75d2-4fb7-9e11-98c3c41f8541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '606c3840ac0c4b95810370819859886a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.540154 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1337/2644] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:40 2022] DELETE /identity/v3/users/606c3840ac0c4b95810370819859886a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:40.547467 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d01eed59-ae8e-4afe-acac-3d5fd0660be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa27f76ec064922b6f1bf80130c51af'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.552792 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:40.562047 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d01eed59-ae8e-4afe-acac-3d5fd0660be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa27f76ec064922b6f1bf80130c51af'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.562803 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d01eed59-ae8e-4afe-acac-3d5fd0660be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa27f76ec064922b6f1bf80130c51af'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.563783 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d01eed59-ae8e-4afe-acac-3d5fd0660be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa27f76ec064922b6f1bf80130c51af'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.571492 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d01eed59-ae8e-4afe-acac-3d5fd0660be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa27f76ec064922b6f1bf80130c51af'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.583982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1308/2645] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:20:40 2022] DELETE /identity/v3/users/0aa27f76ec064922b6f1bf80130c51af => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:20:40.588472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20268c6-887c-49ac-9ede-d298cf38a784 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:40.588764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20268c6-887c-49ac-9ede-d298cf38a784 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:40.589047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20268c6-887c-49ac-9ede-d298cf38a784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:40.606474 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c20268c6-887c-49ac-9ede-d298cf38a784 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:40.607675 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c20268c6-887c-49ac-9ede-d298cf38a784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:40.668886 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1338/2646] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:40.678453 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01eed59-ae8e-4afe-acac-3d5fd0660be2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:40.680602 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d01eed59-ae8e-4afe-acac-3d5fd0660be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:40.742233 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01eed59-ae8e-4afe-acac-3d5fd0660be2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:40.746063 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e61057-2b95-4c18-a0a2-a25c235ec916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:40.746713 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e61057-2b95-4c18-a0a2-a25c235ec916 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:40.746996 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e61057-2b95-4c18-a0a2-a25c235ec916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:40.747276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e61057-2b95-4c18-a0a2-a25c235ec916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:40.756825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e61057-2b95-4c18-a0a2-a25c235ec916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:40.758290 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e61057-2b95-4c18-a0a2-a25c235ec916 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:40.767997 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1309/2647] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:40.848501 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20268c6-887c-49ac-9ede-d298cf38a784 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:40.850059 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c20268c6-887c-49ac-9ede-d298cf38a784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:40.866006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20268c6-887c-49ac-9ede-d298cf38a784 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:40.882840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6c033-12b8-4901-9672-b741eca7753e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:40.883722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6c033-12b8-4901-9672-b741eca7753e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:40.884054 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6c033-12b8-4901-9672-b741eca7753e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:40.884489 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6c033-12b8-4901-9672-b741eca7753e admin admin] PATH_INFO: `/v3/projects/0921de55a53a49558e436e356e36c07a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:40.885745 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6c033-12b8-4901-9672-b741eca7753e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0921de55a53a49558e436e356e36c07a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:40.887469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6c033-12b8-4901-9672-b741eca7753e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:40.928001 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:40.938939 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-70c6c033-12b8-4901-9672-b741eca7753e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0921de55a53a49558e436e356e36c07a', 'request_id': 'req-70c6c033-12b8-4901-9672-b741eca7753e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.949153 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-70c6c033-12b8-4901-9672-b741eca7753e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0921de55a53a49558e436e356e36c07a', 'request_id': 'req-70c6c033-12b8-4901-9672-b741eca7753e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.956050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-70c6c033-12b8-4901-9672-b741eca7753e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0921de55a53a49558e436e356e36c07a', 'request_id': 'req-70c6c033-12b8-4901-9672-b741eca7753e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.969330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-70c6c033-12b8-4901-9672-b741eca7753e admin admin] The token cache is being invalidate because project 0921de55a53a49558e436e356e36c07a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:40.969766 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-70c6c033-12b8-4901-9672-b741eca7753e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.970536 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-70c6c033-12b8-4901-9672-b741eca7753e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:40.977895 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1339/2648] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:40 2022] DELETE /identity/v3/projects/0921de55a53a49558e436e356e36c07a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:40.979614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b600ac-e323-4163-b045-70335d6cbd9e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:40.980054 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b600ac-e323-4163-b045-70335d6cbd9e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:40.980147 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b600ac-e323-4163-b045-70335d6cbd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.000685 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-22b600ac-e323-4163-b045-70335d6cbd9e None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:41.001998 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-22b600ac-e323-4163-b045-70335d6cbd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:41.069416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1310/2649] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:41.076630 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5831d-452f-4ca7-b499-02d84372f9bc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.077197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5831d-452f-4ca7-b499-02d84372f9bc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.077525 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5831d-452f-4ca7-b499-02d84372f9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.102394 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b7b5831d-452f-4ca7-b499-02d84372f9bc None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:41.103650 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b7b5831d-452f-4ca7-b499-02d84372f9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:41.112953 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1340/2650] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:41.117276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b600ac-e323-4163-b045-70335d6cbd9e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:41.124112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5831d-452f-4ca7-b499-02d84372f9bc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:41.126758 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b7b5831d-452f-4ca7-b499-02d84372f9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:41.128904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b600ac-e323-4163-b045-70335d6cbd9e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:41.134236 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1478ea-f65b-4de3-92c5-a29cbf6553ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:41.134921 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1478ea-f65b-4de3-92c5-a29cbf6553ae admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.135202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1478ea-f65b-4de3-92c5-a29cbf6553ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.135530 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1478ea-f65b-4de3-92c5-a29cbf6553ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.136279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1478ea-f65b-4de3-92c5-a29cbf6553ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:20:41.136573 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1478ea-f65b-4de3-92c5-a29cbf6553ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:41.138371 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1478ea-f65b-4de3-92c5-a29cbf6553ae admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:41.143063 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5831d-452f-4ca7-b499-02d84372f9bc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:41.149439 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3226f-f3db-4e8f-a4b9-a6ed35f7aa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:41.151146 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3226f-f3db-4e8f-a4b9-a6ed35f7aa7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.151146 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3226f-f3db-4e8f-a4b9-a6ed35f7aa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.151352 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3226f-f3db-4e8f-a4b9-a6ed35f7aa7a admin admin] PATH_INFO: `/v3/projects/a225741f31e840bda39fb5098114d1ea` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.152407 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3226f-f3db-4e8f-a4b9-a6ed35f7aa7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a225741f31e840bda39fb5098114d1ea)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:41.154276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1311/2651] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:20:41.154386 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3226f-f3db-4e8f-a4b9-a6ed35f7aa7a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:41.158739 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1478ea-f65b-4de3-92c5-a29cbf6553ae admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:41.171176 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1478ea-f65b-4de3-92c5-a29cbf6553ae admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:41.175981 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1e9cd-2c2f-4e59-b8ca-218fa275e674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:41.176629 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1e9cd-2c2f-4e59-b8ca-218fa275e674 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.176915 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1e9cd-2c2f-4e59-b8ca-218fa275e674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.177195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1e9cd-2c2f-4e59-b8ca-218fa275e674 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.177940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1e9cd-2c2f-4e59-b8ca-218fa275e674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:41.179914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1e9cd-2c2f-4e59-b8ca-218fa275e674 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:41.205850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c5d3226f-f3db-4e8f-a4b9-a6ed35f7aa7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a225741f31e840bda39fb5098114d1ea', 'request_id': 'req-c5d3226f-f3db-4e8f-a4b9-a6ed35f7aa7a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:41.212887 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1312/2652] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:20:41 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:20:41.213161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c5d3226f-f3db-4e8f-a4b9-a6ed35f7aa7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a225741f31e840bda39fb5098114d1ea', 'request_id': 'req-c5d3226f-f3db-4e8f-a4b9-a6ed35f7aa7a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:41.216987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1e9cd-2c2f-4e59-b8ca-218fa275e674 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:41.219584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c5d3226f-f3db-4e8f-a4b9-a6ed35f7aa7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a225741f31e840bda39fb5098114d1ea', 'request_id': 'req-c5d3226f-f3db-4e8f-a4b9-a6ed35f7aa7a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:41.231596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c5d3226f-f3db-4e8f-a4b9-a6ed35f7aa7a admin admin] The token cache is being invalidate because project a225741f31e840bda39fb5098114d1ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:20:41.231916 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c5d3226f-f3db-4e8f-a4b9-a6ed35f7aa7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:41.232579 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c5d3226f-f3db-4e8f-a4b9-a6ed35f7aa7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:20:41.234161 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1341/2653] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:20:41 2022] DELETE /identity/v3/projects/a225741f31e840bda39fb5098114d1ea => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:41.239192 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a1f08-e2e3-4316-b7c9-6003e2638739 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.239480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a1f08-e2e3-4316-b7c9-6003e2638739 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.239757 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a1f08-e2e3-4316-b7c9-6003e2638739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.257212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ef2a1f08-e2e3-4316-b7c9-6003e2638739 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:41.258448 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ef2a1f08-e2e3-4316-b7c9-6003e2638739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:41.262735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:41.285818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1e9cd-2c2f-4e59-b8ca-218fa275e674 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:41.291120 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13189a67-04de-49a4-96f7-6ba4c32a4f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:41.291785 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13189a67-04de-49a4-96f7-6ba4c32a4f3c admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.292066 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13189a67-04de-49a4-96f7-6ba4c32a4f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.292336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13189a67-04de-49a4-96f7-6ba4c32a4f3c admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.293012 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13189a67-04de-49a4-96f7-6ba4c32a4f3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:41.294962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13189a67-04de-49a4-96f7-6ba4c32a4f3c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:41.317946 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1313/2654] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:20:41 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:20:41.319224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1342/2655] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:20:41.319939 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13189a67-04de-49a4-96f7-6ba4c32a4f3c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:41.321695 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-13189a67-04de-49a4-96f7-6ba4c32a4f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:41.327734 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1ef3c-fbf7-4053-a141-6677342b4de1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.328048 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1ef3c-fbf7-4053-a141-6677342b4de1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.328327 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1ef3c-fbf7-4053-a141-6677342b4de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.333798 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13189a67-04de-49a4-96f7-6ba4c32a4f3c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:41.339196 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f8974-b113-42a4-a1b6-99c7e48ef9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:41.339856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f8974-b113-42a4-a1b6-99c7e48ef9da admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.340140 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f8974-b113-42a4-a1b6-99c7e48ef9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.340440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f8974-b113-42a4-a1b6-99c7e48ef9da admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.341168 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f8974-b113-42a4-a1b6-99c7e48ef9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:41.342792 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f8974-b113-42a4-a1b6-99c7e48ef9da admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:41.346576 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-53f1ef3c-fbf7-4053-a141-6677342b4de1 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:41.348147 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-53f1ef3c-fbf7-4053-a141-6677342b4de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:41.355673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1314/2656] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:20:41.355833 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1343/2657] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:20:41.357071 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f8974-b113-42a4-a1b6-99c7e48ef9da admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:41.359621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1ef3c-fbf7-4053-a141-6677342b4de1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:41.366516 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f8974-b113-42a4-a1b6-99c7e48ef9da admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:41.368731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1ef3c-fbf7-4053-a141-6677342b4de1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:41.371523 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe475-344c-4331-bd84-f384e9840fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:41.372199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe475-344c-4331-bd84-f384e9840fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.372486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe475-344c-4331-bd84-f384e9840fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.372760 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe475-344c-4331-bd84-f384e9840fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.373321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fcaa6-9be2-4a47-9d5e-b0b6657921a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:41.373608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fe475-344c-4331-bd84-f384e9840fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:41.373980 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fcaa6-9be2-4a47-9d5e-b0b6657921a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.374261 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fcaa6-9be2-4a47-9d5e-b0b6657921a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.374534 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fcaa6-9be2-4a47-9d5e-b0b6657921a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.375217 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fe475-344c-4331-bd84-f384e9840fa7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:41.375316 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fcaa6-9be2-4a47-9d5e-b0b6657921a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:20:41.375538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fcaa6-9be2-4a47-9d5e-b0b6657921a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:41.377093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fcaa6-9be2-4a47-9d5e-b0b6657921a7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:41.386638 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1315/2658] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:20:41.389259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1344/2659] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 11:20:41.390751 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe475-344c-4331-bd84-f384e9840fa7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:41.393219 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fcaa6-9be2-4a47-9d5e-b0b6657921a7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:41.401383 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe475-344c-4331-bd84-f384e9840fa7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:41.404331 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fcaa6-9be2-4a47-9d5e-b0b6657921a7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:41.405982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f94da-5316-4b73-8993-87cd181f1522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:41.406834 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f94da-5316-4b73-8993-87cd181f1522 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.407112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f94da-5316-4b73-8993-87cd181f1522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.407435 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f94da-5316-4b73-8993-87cd181f1522 admin admin] PATH_INFO: `/v3/projects/868860169657493da9f5d1c0d546c9a9/users/70790dc353a34ca89af8c94f5980cb34/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.408931 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea56bf1-dbb3-475d-b0bf-02cc9b0043d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:41.409587 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea56bf1-dbb3-475d-b0bf-02cc9b0043d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.409874 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea56bf1-dbb3-475d-b0bf-02cc9b0043d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.410152 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea56bf1-dbb3-475d-b0bf-02cc9b0043d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.410867 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea56bf1-dbb3-475d-b0bf-02cc9b0043d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:41.412744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea56bf1-dbb3-475d-b0bf-02cc9b0043d5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:41.422288 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f94da-5316-4b73-8993-87cd181f1522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=868860169657493da9f5d1c0d546c9a9, user_id=70790dc353a34ca89af8c94f5980cb34, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:41.424888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f94da-5316-4b73-8993-87cd181f1522 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:41.432556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:41.438786 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1316/2660] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:41 2022] PUT /identity/v3/projects/868860169657493da9f5d1c0d546c9a9/users/70790dc353a34ca89af8c94f5980cb34/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:20:41.448239 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1345/2661] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:20:41 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:20:41.449300 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f94da-5316-4b73-8993-87cd181f1522 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:41.450406 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04ea8-cec2-47bf-bf11-f048f4ae113c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.450693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04ea8-cec2-47bf-bf11-f048f4ae113c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.451016 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04ea8-cec2-47bf-bf11-f048f4ae113c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.479283 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e6b04ea8-cec2-47bf-bf11-f048f4ae113c None None] MFA Rules not processed for user `70790dc353a34ca89af8c94f5980cb34`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:41.480424 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e6b04ea8-cec2-47bf-bf11-f048f4ae113c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:41.514609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f94da-5316-4b73-8993-87cd181f1522 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:41.549855 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1346/2662] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:20:41.558904 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04ea8-cec2-47bf-bf11-f048f4ae113c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:41.560206 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e6b04ea8-cec2-47bf-bf11-f048f4ae113c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:41.577178 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655ef9e-4f46-45ca-8fd3-c2bc586575de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:41.577958 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655ef9e-4f46-45ca-8fd3-c2bc586575de admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.578239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655ef9e-4f46-45ca-8fd3-c2bc586575de admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.578507 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655ef9e-4f46-45ca-8fd3-c2bc586575de admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.579263 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655ef9e-4f46-45ca-8fd3-c2bc586575de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:41.581148 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655ef9e-4f46-45ca-8fd3-c2bc586575de admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:41.602032 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1317/2663] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:20:41 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:20:41.606130 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655ef9e-4f46-45ca-8fd3-c2bc586575de admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:41.615438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655ef9e-4f46-45ca-8fd3-c2bc586575de admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:41.618552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04ea8-cec2-47bf-bf11-f048f4ae113c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:41.620841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da1e36-58f6-4d1e-a848-8fe07de6a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:41.621577 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da1e36-58f6-4d1e-a848-8fe07de6a41a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.621856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da1e36-58f6-4d1e-a848-8fe07de6a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.622127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da1e36-58f6-4d1e-a848-8fe07de6a41a admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.622307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bf142-2fa6-4e38-b8cd-50021803ef73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b6436fdd7a4977a2e02c0e1b8be2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:41.622836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da1e36-58f6-4d1e-a848-8fe07de6a41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:41.623022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bf142-2fa6-4e38-b8cd-50021803ef73 service glance] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.623243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bf142-2fa6-4e38-b8cd-50021803ef73 service glance] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.623519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bf142-2fa6-4e38-b8cd-50021803ef73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.624449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da1e36-58f6-4d1e-a848-8fe07de6a41a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:41.632064 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bf142-2fa6-4e38-b8cd-50021803ef73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:41.633532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bf142-2fa6-4e38-b8cd-50021803ef73 service glance] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:41.634467 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1318/2664] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:20:41.638141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da1e36-58f6-4d1e-a848-8fe07de6a41a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:41.646126 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1347/2665] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:20:41.647623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da1e36-58f6-4d1e-a848-8fe07de6a41a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:41.652319 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d89ea9-aa2e-4fea-95cb-3e4f4dcd3566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:41.653285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89ea9-aa2e-4fea-95cb-3e4f4dcd3566 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.653285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89ea9-aa2e-4fea-95cb-3e4f4dcd3566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.653622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89ea9-aa2e-4fea-95cb-3e4f4dcd3566 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.654360 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d89ea9-aa2e-4fea-95cb-3e4f4dcd3566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:41.655912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d89ea9-aa2e-4fea-95cb-3e4f4dcd3566 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:41.658089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:41.668428 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1319/2666] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:20:41.672027 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bf142-2fa6-4e38-b8cd-50021803ef73 service glance] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:41.683949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bf142-2fa6-4e38-b8cd-50021803ef73 service glance] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:41.688727 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87aec45-1dc7-4db0-b028-f667ed7c2e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:41.689622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87aec45-1dc7-4db0-b028-f667ed7c2e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.689908 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87aec45-1dc7-4db0-b028-f667ed7c2e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.690180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87aec45-1dc7-4db0-b028-f667ed7c2e3d admin admin] PATH_INFO: `/v3/projects/cefd8f59a11b4f18b0dacc08e60ebad2/users/da7f3ec3543d4b5bace0b410878a8bb6/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.706141 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87aec45-1dc7-4db0-b028-f667ed7c2e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cefd8f59a11b4f18b0dacc08e60ebad2, user_id=da7f3ec3543d4b5bace0b410878a8bb6, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:41.708772 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87aec45-1dc7-4db0-b028-f667ed7c2e3d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:41.723591 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1348/2667] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:20:41 2022] PUT /identity/v3/projects/cefd8f59a11b4f18b0dacc08e60ebad2/users/da7f3ec3543d4b5bace0b410878a8bb6/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:20:41.734372 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841e4ce-a58b-4d2f-a7f6-9cc97179e773 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.734625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841e4ce-a58b-4d2f-a7f6-9cc97179e773 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.734925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841e4ce-a58b-4d2f-a7f6-9cc97179e773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.760609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f841e4ce-a58b-4d2f-a7f6-9cc97179e773 None None] MFA Rules not processed for user `da7f3ec3543d4b5bace0b410878a8bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:20:41.761837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f841e4ce-a58b-4d2f-a7f6-9cc97179e773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:41.828608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1320/2668] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:20:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:20:41.839571 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87aec45-1dc7-4db0-b028-f667ed7c2e3d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:20:41.841258 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c87aec45-1dc7-4db0-b028-f667ed7c2e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:20:41.898130 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87aec45-1dc7-4db0-b028-f667ed7c2e3d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:20:41.901783 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d07c6-bb9f-4e9b-a380-de3d38256b27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:20:41.902418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d07c6-bb9f-4e9b-a380-de3d38256b27 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:20:41.902696 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d07c6-bb9f-4e9b-a380-de3d38256b27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:20:41.902976 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d07c6-bb9f-4e9b-a380-de3d38256b27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:20:41.911076 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d07c6-bb9f-4e9b-a380-de3d38256b27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:20:41.912490 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d07c6-bb9f-4e9b-a380-de3d38256b27 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:20:41.923792 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1349/2669] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:20:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:20:51.825342 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=33 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:20:51.918868 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:21:10.736327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841e4ce-a58b-4d2f-a7f6-9cc97179e773 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:10.797669 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841e4ce-a58b-4d2f-a7f6-9cc97179e773 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:10.802125 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64832d57-41e8-4c51-ba55-74ac41b95265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:10.802975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64832d57-41e8-4c51-ba55-74ac41b95265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:10.803255 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64832d57-41e8-4c51-ba55-74ac41b95265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:10.803526 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64832d57-41e8-4c51-ba55-74ac41b95265 admin admin] PATH_INFO: `/v3/users/da7f3ec3543d4b5bace0b410878a8bb6` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:10.804693 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64832d57-41e8-4c51-ba55-74ac41b95265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7f3ec3543d4b5bace0b410878a8bb6)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:10.807213 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64832d57-41e8-4c51-ba55-74ac41b95265 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:10.850384 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-64832d57-41e8-4c51-ba55-74ac41b95265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7f3ec3543d4b5bace0b410878a8bb6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:10.862587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-64832d57-41e8-4c51-ba55-74ac41b95265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7f3ec3543d4b5bace0b410878a8bb6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:10.863339 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-64832d57-41e8-4c51-ba55-74ac41b95265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7f3ec3543d4b5bace0b410878a8bb6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:10.863976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-64832d57-41e8-4c51-ba55-74ac41b95265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7f3ec3543d4b5bace0b410878a8bb6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:10.871908 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-64832d57-41e8-4c51-ba55-74ac41b95265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7f3ec3543d4b5bace0b410878a8bb6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:10.884264 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1321/2670] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:21:10 2022] DELETE /identity/v3/users/da7f3ec3543d4b5bace0b410878a8bb6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:21:10.888883 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75384b-9e86-4657-9d0f-64f78a3625c0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:10.889393 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75384b-9e86-4657-9d0f-64f78a3625c0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:10.889512 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75384b-9e86-4657-9d0f-64f78a3625c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:10.907007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9a75384b-9e86-4657-9d0f-64f78a3625c0 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:21:10.908201 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9a75384b-9e86-4657-9d0f-64f78a3625c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:10.965431 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1350/2671] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:21:10.975047 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64832d57-41e8-4c51-ba55-74ac41b95265 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:10.976416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-64832d57-41e8-4c51-ba55-74ac41b95265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:11.032099 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64832d57-41e8-4c51-ba55-74ac41b95265 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:11.035783 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c512ef-b210-49b4-9235-279895d06436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:11.036413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c512ef-b210-49b4-9235-279895d06436 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:11.036697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c512ef-b210-49b4-9235-279895d06436 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:11.036969 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c512ef-b210-49b4-9235-279895d06436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:11.046552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c512ef-b210-49b4-9235-279895d06436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:11.047985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c512ef-b210-49b4-9235-279895d06436 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:11.057739 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1322/2672] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:21:11.316754 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75384b-9e86-4657-9d0f-64f78a3625c0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:11.318259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9a75384b-9e86-4657-9d0f-64f78a3625c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:11.331130 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75384b-9e86-4657-9d0f-64f78a3625c0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:11.335873 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030fd7b-4d5c-4cc8-b93f-500a5c4e67e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:11.336820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030fd7b-4d5c-4cc8-b93f-500a5c4e67e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:11.337171 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030fd7b-4d5c-4cc8-b93f-500a5c4e67e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:11.337482 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030fd7b-4d5c-4cc8-b93f-500a5c4e67e1 admin admin] PATH_INFO: `/v3/projects/cefd8f59a11b4f18b0dacc08e60ebad2` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:11.339418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030fd7b-4d5c-4cc8-b93f-500a5c4e67e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cefd8f59a11b4f18b0dacc08e60ebad2)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:11.341335 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030fd7b-4d5c-4cc8-b93f-500a5c4e67e1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:11.387235 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3030fd7b-4d5c-4cc8-b93f-500a5c4e67e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cefd8f59a11b4f18b0dacc08e60ebad2', 'request_id': 'req-3030fd7b-4d5c-4cc8-b93f-500a5c4e67e1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:11.394547 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3030fd7b-4d5c-4cc8-b93f-500a5c4e67e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cefd8f59a11b4f18b0dacc08e60ebad2', 'request_id': 'req-3030fd7b-4d5c-4cc8-b93f-500a5c4e67e1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:11.401151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3030fd7b-4d5c-4cc8-b93f-500a5c4e67e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cefd8f59a11b4f18b0dacc08e60ebad2', 'request_id': 'req-3030fd7b-4d5c-4cc8-b93f-500a5c4e67e1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:11.412396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3030fd7b-4d5c-4cc8-b93f-500a5c4e67e1 admin admin] The token cache is being invalidate because project cefd8f59a11b4f18b0dacc08e60ebad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:21:11.412681 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3030fd7b-4d5c-4cc8-b93f-500a5c4e67e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:11.413321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3030fd7b-4d5c-4cc8-b93f-500a5c4e67e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:11.414889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1351/2673] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:21:11 2022] DELETE /identity/v3/projects/cefd8f59a11b4f18b0dacc08e60ebad2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:21:11.419809 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65e828-eb14-4dbe-b184-2b1986422d71 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:11.420094 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65e828-eb14-4dbe-b184-2b1986422d71 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:11.420371 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65e828-eb14-4dbe-b184-2b1986422d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:11.437541 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6a65e828-eb14-4dbe-b184-2b1986422d71 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:21:11.438722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6a65e828-eb14-4dbe-b184-2b1986422d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:11.466718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:21:11.513340 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1323/2674] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:21:11.522140 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef4626-a890-4ddd-836c-9bdd2b353c85 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:11.522430 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef4626-a890-4ddd-836c-9bdd2b353c85 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:11.522735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef4626-a890-4ddd-836c-9bdd2b353c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:11.541170 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0fef4626-a890-4ddd-836c-9bdd2b353c85 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:21:11.542453 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0fef4626-a890-4ddd-836c-9bdd2b353c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:11.550400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1352/2675] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:21:11.554545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65e828-eb14-4dbe-b184-2b1986422d71 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:11.564282 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65e828-eb14-4dbe-b184-2b1986422d71 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:11.568908 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe3656-73cf-45d8-b88d-180323bf8028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:11.569598 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe3656-73cf-45d8-b88d-180323bf8028 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:11.569882 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe3656-73cf-45d8-b88d-180323bf8028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:11.570159 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe3656-73cf-45d8-b88d-180323bf8028 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:11.570881 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe3656-73cf-45d8-b88d-180323bf8028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:21:11.571194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe3656-73cf-45d8-b88d-180323bf8028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:11.573253 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe3656-73cf-45d8-b88d-180323bf8028 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:11.587079 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1324/2676] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:21:11.591693 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef4626-a890-4ddd-836c-9bdd2b353c85 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:11.600960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef4626-a890-4ddd-836c-9bdd2b353c85 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:11.605717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a983e6a-f64c-4902-82ef-b7024a51f7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:11.606401 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a983e6a-f64c-4902-82ef-b7024a51f7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:11.606685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a983e6a-f64c-4902-82ef-b7024a51f7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:11.606960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a983e6a-f64c-4902-82ef-b7024a51f7f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:11.607663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a983e6a-f64c-4902-82ef-b7024a51f7f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:11.609572 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a983e6a-f64c-4902-82ef-b7024a51f7f7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:11.636619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1353/2677] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:21:11 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:21:11.641411 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe3656-73cf-45d8-b88d-180323bf8028 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:11.653230 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe3656-73cf-45d8-b88d-180323bf8028 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:11.719216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641839f-9fde-4b25-8fd0-01e25913b1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:11.719984 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641839f-9fde-4b25-8fd0-01e25913b1bd admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:11.720256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641839f-9fde-4b25-8fd0-01e25913b1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:11.720448 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641839f-9fde-4b25-8fd0-01e25913b1bd admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:11.721131 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641839f-9fde-4b25-8fd0-01e25913b1bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:11.723210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641839f-9fde-4b25-8fd0-01e25913b1bd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:11.749166 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1325/2678] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:21:11 2022] POST /identity/v3/users => generated 282 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:21:11.750647 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a983e6a-f64c-4902-82ef-b7024a51f7f7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:11.762776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a983e6a-f64c-4902-82ef-b7024a51f7f7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:11.768017 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e59101-311f-41fd-b43d-439586058024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:11.768912 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59101-311f-41fd-b43d-439586058024 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:11.769609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59101-311f-41fd-b43d-439586058024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:11.769953 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59101-311f-41fd-b43d-439586058024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:11.771083 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e59101-311f-41fd-b43d-439586058024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:11.774127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e59101-311f-41fd-b43d-439586058024 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:11.788465 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1354/2679] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:21:11.792445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641839f-9fde-4b25-8fd0-01e25913b1bd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:11.803689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641839f-9fde-4b25-8fd0-01e25913b1bd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:11.808964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5dba30-1c4c-40bc-8f7e-c5b75493f3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:11.809681 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dba30-1c4c-40bc-8f7e-c5b75493f3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:11.809968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dba30-1c4c-40bc-8f7e-c5b75493f3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:11.810249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dba30-1c4c-40bc-8f7e-c5b75493f3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:11.811000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5dba30-1c4c-40bc-8f7e-c5b75493f3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:11.812599 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5dba30-1c4c-40bc-8f7e-c5b75493f3e3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:11.823805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1326/2680] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:21:11.827890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e59101-311f-41fd-b43d-439586058024 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:11.837820 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e59101-311f-41fd-b43d-439586058024 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:11.842366 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1d19d-7c35-44cf-928f-420aa35c4407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:11.843217 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1d19d-7c35-44cf-928f-420aa35c4407 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:11.843496 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1d19d-7c35-44cf-928f-420aa35c4407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:11.843762 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1d19d-7c35-44cf-928f-420aa35c4407 admin admin] PATH_INFO: `/v3/projects/99fe880c4c7d43e3a6bf114cf8c571a9/users/a934e99ae4764feaba9e3646c7e86bea/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:11.858325 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1d19d-7c35-44cf-928f-420aa35c4407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fe880c4c7d43e3a6bf114cf8c571a9, user_id=a934e99ae4764feaba9e3646c7e86bea, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:11.861001 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1d19d-7c35-44cf-928f-420aa35c4407 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:11.874799 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1355/2681] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:21:11 2022] PUT /identity/v3/projects/99fe880c4c7d43e3a6bf114cf8c571a9/users/a934e99ae4764feaba9e3646c7e86bea/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:21:11.885496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde561f1-f32d-4941-89ec-9a9473e23fcc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:11.885788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde561f1-f32d-4941-89ec-9a9473e23fcc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:11.886067 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde561f1-f32d-4941-89ec-9a9473e23fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:11.912051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-bde561f1-f32d-4941-89ec-9a9473e23fcc None None] MFA Rules not processed for user `a934e99ae4764feaba9e3646c7e86bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:21:11.913209 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bde561f1-f32d-4941-89ec-9a9473e23fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:11.976427 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1327/2682] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:21:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:21:11.988281 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1d19d-7c35-44cf-928f-420aa35c4407 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:11.990072 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-04d1d19d-7c35-44cf-928f-420aa35c4407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:12.011710 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:21:12.047146 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1d19d-7c35-44cf-928f-420aa35c4407 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:12.050741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9d967-5cc0-4833-bae9-cd5748c193e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:12.051372 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9d967-5cc0-4833-bae9-cd5748c193e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:12.051653 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9d967-5cc0-4833-bae9-cd5748c193e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:12.051927 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9d967-5cc0-4833-bae9-cd5748c193e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:12.060735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9d967-5cc0-4833-bae9-cd5748c193e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:12.062205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9d967-5cc0-4833-bae9-cd5748c193e5 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:12.071256 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1356/2683] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:21:11 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:21:21.973693 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:21:22.067096 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=17 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:21:37.868476 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde561f1-f32d-4941-89ec-9a9473e23fcc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:37.869893 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bde561f1-f32d-4941-89ec-9a9473e23fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:37.935279 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde561f1-f32d-4941-89ec-9a9473e23fcc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:37.939743 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df65bd8-27e9-4ad8-af58-cfe43dc14d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:37.940598 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df65bd8-27e9-4ad8-af58-cfe43dc14d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:37.940876 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df65bd8-27e9-4ad8-af58-cfe43dc14d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:37.941139 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df65bd8-27e9-4ad8-af58-cfe43dc14d10 admin admin] PATH_INFO: `/v3/users/70790dc353a34ca89af8c94f5980cb34` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:37.942330 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df65bd8-27e9-4ad8-af58-cfe43dc14d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70790dc353a34ca89af8c94f5980cb34)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:37.944227 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df65bd8-27e9-4ad8-af58-cfe43dc14d10 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:37.990300 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0df65bd8-27e9-4ad8-af58-cfe43dc14d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70790dc353a34ca89af8c94f5980cb34'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:38.002179 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0df65bd8-27e9-4ad8-af58-cfe43dc14d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70790dc353a34ca89af8c94f5980cb34'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:38.002832 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0df65bd8-27e9-4ad8-af58-cfe43dc14d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70790dc353a34ca89af8c94f5980cb34'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:38.003433 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0df65bd8-27e9-4ad8-af58-cfe43dc14d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70790dc353a34ca89af8c94f5980cb34'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:38.010771 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0df65bd8-27e9-4ad8-af58-cfe43dc14d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70790dc353a34ca89af8c94f5980cb34'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:38.023665 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1328/2684] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:21:37 2022] DELETE /identity/v3/users/70790dc353a34ca89af8c94f5980cb34 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:21:38.028958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7b843-6a45-41de-81bf-2e41e4a0acfe None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:38.029483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7b843-6a45-41de-81bf-2e41e4a0acfe None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:38.029593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7b843-6a45-41de-81bf-2e41e4a0acfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:38.051084 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d5e7b843-6a45-41de-81bf-2e41e4a0acfe None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:21:38.052263 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d5e7b843-6a45-41de-81bf-2e41e4a0acfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:38.115296 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1357/2685] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:21:38.125527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df65bd8-27e9-4ad8-af58-cfe43dc14d10 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:38.126964 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0df65bd8-27e9-4ad8-af58-cfe43dc14d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:38.188519 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df65bd8-27e9-4ad8-af58-cfe43dc14d10 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:38.192241 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0ce2e-fa2e-4444-90cd-f23d12f03426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:38.192885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ce2e-fa2e-4444-90cd-f23d12f03426 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:38.193171 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ce2e-fa2e-4444-90cd-f23d12f03426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:38.193467 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ce2e-fa2e-4444-90cd-f23d12f03426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:38.204473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0ce2e-fa2e-4444-90cd-f23d12f03426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:38.205991 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0ce2e-fa2e-4444-90cd-f23d12f03426 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:38.215927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1329/2686] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:21:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:21:38.501380 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7b843-6a45-41de-81bf-2e41e4a0acfe None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:38.503029 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d5e7b843-6a45-41de-81bf-2e41e4a0acfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:38.518174 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7b843-6a45-41de-81bf-2e41e4a0acfe None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:38.523478 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e81153-e126-44aa-b8cf-26a242931b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:38.524342 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e81153-e126-44aa-b8cf-26a242931b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:38.524616 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e81153-e126-44aa-b8cf-26a242931b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:38.524911 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e81153-e126-44aa-b8cf-26a242931b38 admin admin] PATH_INFO: `/v3/projects/868860169657493da9f5d1c0d546c9a9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:38.526100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e81153-e126-44aa-b8cf-26a242931b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=868860169657493da9f5d1c0d546c9a9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:38.528642 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e81153-e126-44aa-b8cf-26a242931b38 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:38.579460 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a2e81153-e126-44aa-b8cf-26a242931b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868860169657493da9f5d1c0d546c9a9', 'request_id': 'req-a2e81153-e126-44aa-b8cf-26a242931b38'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:38.586699 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a2e81153-e126-44aa-b8cf-26a242931b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868860169657493da9f5d1c0d546c9a9', 'request_id': 'req-a2e81153-e126-44aa-b8cf-26a242931b38'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:38.592384 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a2e81153-e126-44aa-b8cf-26a242931b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868860169657493da9f5d1c0d546c9a9', 'request_id': 'req-a2e81153-e126-44aa-b8cf-26a242931b38'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:38.603479 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a2e81153-e126-44aa-b8cf-26a242931b38 admin admin] The token cache is being invalidate because project 868860169657493da9f5d1c0d546c9a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:21:38.603768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a2e81153-e126-44aa-b8cf-26a242931b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:38.604403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a2e81153-e126-44aa-b8cf-26a242931b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:21:38.606012 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1358/2687] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:21:38 2022] DELETE /identity/v3/projects/868860169657493da9f5d1c0d546c9a9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:21:38.611093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9464a9-fb61-4466-b88c-f38e647b12c0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:38.611404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9464a9-fb61-4466-b88c-f38e647b12c0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:38.611682 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9464a9-fb61-4466-b88c-f38e647b12c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:38.629550 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-be9464a9-fb61-4466-b88c-f38e647b12c0 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:21:38.630672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-be9464a9-fb61-4466-b88c-f38e647b12c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:38.647941 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:21:38.691154 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1330/2688] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:21:38.700166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380bc15-de09-49a6-887b-59e30db16e7a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:38.700458 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380bc15-de09-49a6-887b-59e30db16e7a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:38.700743 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380bc15-de09-49a6-887b-59e30db16e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:38.724236 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8380bc15-de09-49a6-887b-59e30db16e7a None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:21:38.725478 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8380bc15-de09-49a6-887b-59e30db16e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:38.733423 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1359/2689] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:21:38.737647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9464a9-fb61-4466-b88c-f38e647b12c0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:38.748205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9464a9-fb61-4466-b88c-f38e647b12c0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:38.752933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbeef0a-8b5c-4d74-8401-94d602b4dfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:38.753626 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbeef0a-8b5c-4d74-8401-94d602b4dfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:38.753912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbeef0a-8b5c-4d74-8401-94d602b4dfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:38.754216 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbeef0a-8b5c-4d74-8401-94d602b4dfe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:38.754961 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbeef0a-8b5c-4d74-8401-94d602b4dfe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:21:38.755264 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbeef0a-8b5c-4d74-8401-94d602b4dfe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:38.756918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbeef0a-8b5c-4d74-8401-94d602b4dfe0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:38.769164 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1331/2690] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:21:38.773754 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380bc15-de09-49a6-887b-59e30db16e7a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:38.783206 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380bc15-de09-49a6-887b-59e30db16e7a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:38.788141 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15e06f-bf3f-475c-8960-977c236aba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:38.788783 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15e06f-bf3f-475c-8960-977c236aba11 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:38.789065 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15e06f-bf3f-475c-8960-977c236aba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:38.789342 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15e06f-bf3f-475c-8960-977c236aba11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:38.790059 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15e06f-bf3f-475c-8960-977c236aba11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:38.791952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15e06f-bf3f-475c-8960-977c236aba11 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:38.818089 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1360/2691] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:21:38 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:21:38.822077 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbeef0a-8b5c-4d74-8401-94d602b4dfe0 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:38.832560 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbeef0a-8b5c-4d74-8401-94d602b4dfe0 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:38.886613 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5a2eb-db4a-4a11-9fa8-e17dea5db69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:38.887204 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5a2eb-db4a-4a11-9fa8-e17dea5db69d admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:38.888076 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5a2eb-db4a-4a11-9fa8-e17dea5db69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:38.888357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5a2eb-db4a-4a11-9fa8-e17dea5db69d admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:38.889043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5a2eb-db4a-4a11-9fa8-e17dea5db69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:38.891011 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5a2eb-db4a-4a11-9fa8-e17dea5db69d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:38.910638 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1332/2692] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:21:38 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:21:38.914685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15e06f-bf3f-475c-8960-977c236aba11 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:38.925814 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15e06f-bf3f-475c-8960-977c236aba11 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:38.930422 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c46042-5011-4dc8-89c7-d41f7214ec51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:38.931077 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c46042-5011-4dc8-89c7-d41f7214ec51 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:38.931381 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c46042-5011-4dc8-89c7-d41f7214ec51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:38.931636 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c46042-5011-4dc8-89c7-d41f7214ec51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:38.932358 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c46042-5011-4dc8-89c7-d41f7214ec51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:38.933989 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c46042-5011-4dc8-89c7-d41f7214ec51 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:38.944816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1361/2693] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:21:38.948526 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5a2eb-db4a-4a11-9fa8-e17dea5db69d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:38.958439 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5a2eb-db4a-4a11-9fa8-e17dea5db69d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:38.963065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01220a99-bf0c-406e-934f-5f502e3f6ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:38.963708 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01220a99-bf0c-406e-934f-5f502e3f6ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:38.963994 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01220a99-bf0c-406e-934f-5f502e3f6ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:38.964273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01220a99-bf0c-406e-934f-5f502e3f6ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:38.964989 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01220a99-bf0c-406e-934f-5f502e3f6ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:38.966597 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01220a99-bf0c-406e-934f-5f502e3f6ab3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:38.976424 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1333/2694] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:21:38.980235 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c46042-5011-4dc8-89c7-d41f7214ec51 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:38.990489 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c46042-5011-4dc8-89c7-d41f7214ec51 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:38.995016 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eba7bd-2f91-4b63-b216-ae0dae378082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:38.995865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eba7bd-2f91-4b63-b216-ae0dae378082 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:38.996144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eba7bd-2f91-4b63-b216-ae0dae378082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:38.996671 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eba7bd-2f91-4b63-b216-ae0dae378082 admin admin] PATH_INFO: `/v3/projects/2d465b0147884d30874442fcf596df3d/users/a465c88cf6764892b610a609b0add2c2/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:39.012312 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eba7bd-2f91-4b63-b216-ae0dae378082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d465b0147884d30874442fcf596df3d, user_id=a465c88cf6764892b610a609b0add2c2, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:39.014991 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eba7bd-2f91-4b63-b216-ae0dae378082 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:39.027462 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1362/2695] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:21:38 2022] PUT /identity/v3/projects/2d465b0147884d30874442fcf596df3d/users/a465c88cf6764892b610a609b0add2c2/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:21:39.032275 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75569e80-92e1-4330-b558-a9b5868e3707 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:39.032589 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75569e80-92e1-4330-b558-a9b5868e3707 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:39.032867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75569e80-92e1-4330-b558-a9b5868e3707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:39.050677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-75569e80-92e1-4330-b558-a9b5868e3707 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:21:39.051855 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-75569e80-92e1-4330-b558-a9b5868e3707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:39.110532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1334/2696] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:21:39.119904 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eba7bd-2f91-4b63-b216-ae0dae378082 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:39.121634 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-48eba7bd-2f91-4b63-b216-ae0dae378082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:39.143443 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:21:39.183146 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eba7bd-2f91-4b63-b216-ae0dae378082 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:39.183727 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c06cf5-9e53-4ea0-9a6e-c617009e4fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:39.184975 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c06cf5-9e53-4ea0-9a6e-c617009e4fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:39.185255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c06cf5-9e53-4ea0-9a6e-c617009e4fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:39.185556 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c06cf5-9e53-4ea0-9a6e-c617009e4fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:39.194887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c06cf5-9e53-4ea0-9a6e-c617009e4fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:39.196293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c06cf5-9e53-4ea0-9a6e-c617009e4fc0 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:39.206030 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1363/2697] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:21:39.882158 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6e8ec-0b11-4957-b5cf-b6ee54189428 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:39.882505 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6e8ec-0b11-4957-b5cf-b6ee54189428 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:39.882988 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6e8ec-0b11-4957-b5cf-b6ee54189428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:39.910876 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-42a6e8ec-0b11-4957-b5cf-b6ee54189428 None None] MFA Rules not processed for user `a465c88cf6764892b610a609b0add2c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:21:39.912145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-42a6e8ec-0b11-4957-b5cf-b6ee54189428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:39.929294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:21:39.982549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1335/2698] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:21:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:21:39.994112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c06cf5-9e53-4ea0-9a6e-c617009e4fc0 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:39.995517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c0c06cf5-9e53-4ea0-9a6e-c617009e4fc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:40.054600 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c06cf5-9e53-4ea0-9a6e-c617009e4fc0 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:40.058552 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dddaee-4d79-46e9-9ad7-6ea548d4432f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:40.059721 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dddaee-4d79-46e9-9ad7-6ea548d4432f service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:40.060033 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dddaee-4d79-46e9-9ad7-6ea548d4432f service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:40.060308 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dddaee-4d79-46e9-9ad7-6ea548d4432f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:40.069190 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dddaee-4d79-46e9-9ad7-6ea548d4432f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:40.070659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dddaee-4d79-46e9-9ad7-6ea548d4432f service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:40.080104 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1364/2699] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:21:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:21:41.427943 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9e6e6-016a-4d65-85ac-09d66896de06 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:41.428421 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9e6e6-016a-4d65-85ac-09d66896de06 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:41.428540 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9e6e6-016a-4d65-85ac-09d66896de06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:41.446597 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c2c9e6e6-016a-4d65-85ac-09d66896de06 None None] MFA Rules not processed for user `a465c88cf6764892b610a609b0add2c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:21:41.447795 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c2c9e6e6-016a-4d65-85ac-09d66896de06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:41.455155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1336/2700] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:21:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:21:41.688596 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dddaee-4d79-46e9-9ad7-6ea548d4432f service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:41.690034 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-63dddaee-4d79-46e9-9ad7-6ea548d4432f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:41.702266 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dddaee-4d79-46e9-9ad7-6ea548d4432f service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:41.705802 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb04b7-9bde-4d4c-bf46-198c618bfe9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:41.706369 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb04b7-9bde-4d4c-bf46-198c618bfe9b service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:41.706649 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb04b7-9bde-4d4c-bf46-198c618bfe9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:41.706923 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb04b7-9bde-4d4c-bf46-198c618bfe9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:41.708721 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5ceb04b7-9bde-4d4c-bf46-198c618bfe9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:41.718453 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb04b7-9bde-4d4c-bf46-198c618bfe9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:41.719896 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb04b7-9bde-4d4c-bf46-198c618bfe9b service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:41.728032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1365/2701] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:21:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:21:42.058670 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9e6e6-016a-4d65-85ac-09d66896de06 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:42.060725 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c2c9e6e6-016a-4d65-85ac-09d66896de06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:42.137798 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9e6e6-016a-4d65-85ac-09d66896de06 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:42.142820 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9828317-5b76-4aae-9e7e-31d61875d9ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8673c91abf14c0b9a237f0499fdf20e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:42.143629 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9828317-5b76-4aae-9e7e-31d61875d9ac service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:42.143940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9828317-5b76-4aae-9e7e-31d61875d9ac service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:42.144230 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9828317-5b76-4aae-9e7e-31d61875d9ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:42.146466 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d9828317-5b76-4aae-9e7e-31d61875d9ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:42.158569 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9828317-5b76-4aae-9e7e-31d61875d9ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:42.160175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9828317-5b76-4aae-9e7e-31d61875d9ac service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:42.171214 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1337/2702] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:21:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:21:51.724383 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=49 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:21:51.763863 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb04b7-9bde-4d4c-bf46-198c618bfe9b service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:21:51.765340 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5ceb04b7-9bde-4d4c-bf46-198c618bfe9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:51.845380 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb04b7-9bde-4d4c-bf46-198c618bfe9b service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:21:51.850920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6c9bc-835e-4405-a9b5-1d7d7114117a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:21:51.851569 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6c9bc-835e-4405-a9b5-1d7d7114117a service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:21:51.851857 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6c9bc-835e-4405-a9b5-1d7d7114117a service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:21:51.852137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6c9bc-835e-4405-a9b5-1d7d7114117a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:21:51.853913 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f5a6c9bc-835e-4405-a9b5-1d7d7114117a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:21:51.866330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6c9bc-835e-4405-a9b5-1d7d7114117a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:21:51.867905 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6c9bc-835e-4405-a9b5-1d7d7114117a service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:21:51.879080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1366/2703] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:21:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:21:52.165820 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=54 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:22:01.874618 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=34 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:22:08.865778 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9828317-5b76-4aae-9e7e-31d61875d9ac service placement] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:08.867192 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d9828317-5b76-4aae-9e7e-31d61875d9ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:08.944557 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9828317-5b76-4aae-9e7e-31d61875d9ac service placement] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:08.949451 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e13a6e-db15-43c6-9353-1f684350f2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:08.950330 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13a6e-db15-43c6-9353-1f684350f2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:08.950608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13a6e-db15-43c6-9353-1f684350f2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:08.950884 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13a6e-db15-43c6-9353-1f684350f2e9 admin admin] PATH_INFO: `/v3/users/a934e99ae4764feaba9e3646c7e86bea` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:08.952609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e13a6e-db15-43c6-9353-1f684350f2e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a934e99ae4764feaba9e3646c7e86bea)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:08.954788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e13a6e-db15-43c6-9353-1f684350f2e9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:09.001580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-82e13a6e-db15-43c6-9353-1f684350f2e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a934e99ae4764feaba9e3646c7e86bea'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:22:09.013046 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-82e13a6e-db15-43c6-9353-1f684350f2e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a934e99ae4764feaba9e3646c7e86bea'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:22:09.014268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-82e13a6e-db15-43c6-9353-1f684350f2e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a934e99ae4764feaba9e3646c7e86bea'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:22:09.014900 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-82e13a6e-db15-43c6-9353-1f684350f2e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a934e99ae4764feaba9e3646c7e86bea'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:22:09.021911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-82e13a6e-db15-43c6-9353-1f684350f2e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a934e99ae4764feaba9e3646c7e86bea'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:22:09.034535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1338/2704] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:22:08 2022] DELETE /identity/v3/users/a934e99ae4764feaba9e3646c7e86bea => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:22:09.038940 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ed3d8-373f-4373-804e-8ceb66bb6c15 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:09.039397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ed3d8-373f-4373-804e-8ceb66bb6c15 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:09.039508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ed3d8-373f-4373-804e-8ceb66bb6c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:09.064850 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-dc1ed3d8-373f-4373-804e-8ceb66bb6c15 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:22:09.066073 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dc1ed3d8-373f-4373-804e-8ceb66bb6c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:09.124042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1367/2705] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:22:09.133603 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e13a6e-db15-43c6-9353-1f684350f2e9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:09.135075 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-82e13a6e-db15-43c6-9353-1f684350f2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:09.208223 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:22:09.229219 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e13a6e-db15-43c6-9353-1f684350f2e9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:09.232904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61dc6a-66b6-4221-a5d5-84131a9c325a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:09.233597 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61dc6a-66b6-4221-a5d5-84131a9c325a service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:09.233879 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61dc6a-66b6-4221-a5d5-84131a9c325a service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:09.234149 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61dc6a-66b6-4221-a5d5-84131a9c325a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:09.242986 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61dc6a-66b6-4221-a5d5-84131a9c325a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:09.244406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61dc6a-66b6-4221-a5d5-84131a9c325a service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:09.254185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1339/2706] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:22:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:22:09.516518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ed3d8-373f-4373-804e-8ceb66bb6c15 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:09.518049 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dc1ed3d8-373f-4373-804e-8ceb66bb6c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:09.530989 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ed3d8-373f-4373-804e-8ceb66bb6c15 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:09.535644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139dc857-c2dc-4342-82bd-4d59e29c6eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:09.536500 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dc857-c2dc-4342-82bd-4d59e29c6eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:09.536779 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dc857-c2dc-4342-82bd-4d59e29c6eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:09.537053 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dc857-c2dc-4342-82bd-4d59e29c6eed admin admin] PATH_INFO: `/v3/projects/99fe880c4c7d43e3a6bf114cf8c571a9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:09.538274 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139dc857-c2dc-4342-82bd-4d59e29c6eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=99fe880c4c7d43e3a6bf114cf8c571a9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:09.540193 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139dc857-c2dc-4342-82bd-4d59e29c6eed admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:09.586516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-139dc857-c2dc-4342-82bd-4d59e29c6eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99fe880c4c7d43e3a6bf114cf8c571a9', 'request_id': 'req-139dc857-c2dc-4342-82bd-4d59e29c6eed'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:22:09.593871 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-139dc857-c2dc-4342-82bd-4d59e29c6eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99fe880c4c7d43e3a6bf114cf8c571a9', 'request_id': 'req-139dc857-c2dc-4342-82bd-4d59e29c6eed'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:22:09.599690 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-139dc857-c2dc-4342-82bd-4d59e29c6eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99fe880c4c7d43e3a6bf114cf8c571a9', 'request_id': 'req-139dc857-c2dc-4342-82bd-4d59e29c6eed'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:22:09.610483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-139dc857-c2dc-4342-82bd-4d59e29c6eed admin admin] The token cache is being invalidate because project 99fe880c4c7d43e3a6bf114cf8c571a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:22:09.610771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-139dc857-c2dc-4342-82bd-4d59e29c6eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:22:09.611396 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-139dc857-c2dc-4342-82bd-4d59e29c6eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:22:09.612962 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1368/2707] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:22:09 2022] DELETE /identity/v3/projects/99fe880c4c7d43e3a6bf114cf8c571a9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:22:09.617885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043ef92-025c-4e7b-9df5-2a46667f5f01 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:09.618201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043ef92-025c-4e7b-9df5-2a46667f5f01 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:09.618554 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043ef92-025c-4e7b-9df5-2a46667f5f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:09.655165 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5043ef92-025c-4e7b-9df5-2a46667f5f01 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:22:09.656269 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5043ef92-025c-4e7b-9df5-2a46667f5f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:09.712983 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1340/2708] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:22:09.722094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abac17f-5b0d-4411-8df6-4e941031d2c7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:09.722391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abac17f-5b0d-4411-8df6-4e941031d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:09.722669 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abac17f-5b0d-4411-8df6-4e941031d2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:09.740565 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4abac17f-5b0d-4411-8df6-4e941031d2c7 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:22:09.741770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4abac17f-5b0d-4411-8df6-4e941031d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:09.749764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1369/2709] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:22:09.753924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043ef92-025c-4e7b-9df5-2a46667f5f01 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:09.763363 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043ef92-025c-4e7b-9df5-2a46667f5f01 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:09.768407 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6fb0a-ad09-4ce4-afc9-1e41e1eb49e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:09.769043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6fb0a-ad09-4ce4-afc9-1e41e1eb49e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:09.769327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6fb0a-ad09-4ce4-afc9-1e41e1eb49e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:09.769632 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6fb0a-ad09-4ce4-afc9-1e41e1eb49e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:09.770616 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6fb0a-ad09-4ce4-afc9-1e41e1eb49e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:22:09.770925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6fb0a-ad09-4ce4-afc9-1e41e1eb49e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:09.772520 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6fb0a-ad09-4ce4-afc9-1e41e1eb49e4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:09.784651 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1341/2710] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:22:09.788538 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abac17f-5b0d-4411-8df6-4e941031d2c7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:09.797612 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abac17f-5b0d-4411-8df6-4e941031d2c7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:09.802178 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc145ccf-136c-421e-9ece-13b42f14ae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:09.802807 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc145ccf-136c-421e-9ece-13b42f14ae0d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:09.803089 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc145ccf-136c-421e-9ece-13b42f14ae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:09.803359 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc145ccf-136c-421e-9ece-13b42f14ae0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:09.804041 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc145ccf-136c-421e-9ece-13b42f14ae0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:09.805954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc145ccf-136c-421e-9ece-13b42f14ae0d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:09.831464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1370/2711] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:22:09 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:22:09.834901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6fb0a-ad09-4ce4-afc9-1e41e1eb49e4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:09.845296 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6fb0a-ad09-4ce4-afc9-1e41e1eb49e4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:09.899652 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536f220-9a77-453e-a53e-9bb3b2985730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:09.900337 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536f220-9a77-453e-a53e-9bb3b2985730 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:09.900620 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536f220-9a77-453e-a53e-9bb3b2985730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:09.900896 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536f220-9a77-453e-a53e-9bb3b2985730 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:09.901635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536f220-9a77-453e-a53e-9bb3b2985730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:09.903535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536f220-9a77-453e-a53e-9bb3b2985730 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:09.923559 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1342/2712] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:22:09 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:22:09.927512 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc145ccf-136c-421e-9ece-13b42f14ae0d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:09.937667 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc145ccf-136c-421e-9ece-13b42f14ae0d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:09.942219 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9be0e8-4e9b-4ab9-9c25-2021a4f24f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:09.942862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be0e8-4e9b-4ab9-9c25-2021a4f24f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:09.943142 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be0e8-4e9b-4ab9-9c25-2021a4f24f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:09.943417 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be0e8-4e9b-4ab9-9c25-2021a4f24f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:09.944130 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9be0e8-4e9b-4ab9-9c25-2021a4f24f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:09.945764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9be0e8-4e9b-4ab9-9c25-2021a4f24f9f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:09.956509 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1371/2713] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:22:09.960188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536f220-9a77-453e-a53e-9bb3b2985730 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:09.970503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536f220-9a77-453e-a53e-9bb3b2985730 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:09.975116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfa9f1-10df-4e8a-b569-992f830cfaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:09.976580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfa9f1-10df-4e8a-b569-992f830cfaba admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:09.976580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfa9f1-10df-4e8a-b569-992f830cfaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:09.976580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfa9f1-10df-4e8a-b569-992f830cfaba admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:09.977080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfa9f1-10df-4e8a-b569-992f830cfaba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:09.978808 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfa9f1-10df-4e8a-b569-992f830cfaba admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:09.991665 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1343/2714] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:22:09.992764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9be0e8-4e9b-4ab9-9c25-2021a4f24f9f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:10.003481 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9be0e8-4e9b-4ab9-9c25-2021a4f24f9f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:10.008341 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616d4c8-303a-412a-b35e-d4ee160ad6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:10.009213 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616d4c8-303a-412a-b35e-d4ee160ad6d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:10.009521 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616d4c8-303a-412a-b35e-d4ee160ad6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:10.009798 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616d4c8-303a-412a-b35e-d4ee160ad6d0 admin admin] PATH_INFO: `/v3/projects/35c6cf9fd7c841a29a12adccfc9b2c60/users/4db906a7c80340fa93d5657155b96490/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:10.025251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616d4c8-303a-412a-b35e-d4ee160ad6d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c6cf9fd7c841a29a12adccfc9b2c60, user_id=4db906a7c80340fa93d5657155b96490, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:10.027958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616d4c8-303a-412a-b35e-d4ee160ad6d0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:10.040152 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1372/2715] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:22:09 2022] PUT /identity/v3/projects/35c6cf9fd7c841a29a12adccfc9b2c60/users/4db906a7c80340fa93d5657155b96490/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:22:10.045205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bbe92-f0fa-49eb-a697-621603175bc2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:10.045535 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bbe92-f0fa-49eb-a697-621603175bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:10.045812 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bbe92-f0fa-49eb-a697-621603175bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:10.063509 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a27bbe92-f0fa-49eb-a697-621603175bc2 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:22:10.064687 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a27bbe92-f0fa-49eb-a697-621603175bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:10.088148 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:22:10.124881 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1344/2716] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:22:10.134525 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616d4c8-303a-412a-b35e-d4ee160ad6d0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:10.136207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7616d4c8-303a-412a-b35e-d4ee160ad6d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:10.152668 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:22:10.196948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616d4c8-303a-412a-b35e-d4ee160ad6d0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:10.200632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43089a-36d1-4e42-9fef-65e8c679b9fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:10.201298 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43089a-36d1-4e42-9fef-65e8c679b9fd service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:10.202122 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43089a-36d1-4e42-9fef-65e8c679b9fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:10.202400 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43089a-36d1-4e42-9fef-65e8c679b9fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:10.211642 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43089a-36d1-4e42-9fef-65e8c679b9fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:10.213071 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43089a-36d1-4e42-9fef-65e8c679b9fd service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:10.222501 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1373/2717] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:22:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:22:14.023553 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913521b-da67-439a-a679-e93bd7636d40 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:14.024005 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913521b-da67-439a-a679-e93bd7636d40 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:14.024101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913521b-da67-439a-a679-e93bd7636d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:14.053860 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c913521b-da67-439a-a679-e93bd7636d40 None None] MFA Rules not processed for user `4db906a7c80340fa93d5657155b96490`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:22:14.055008 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c913521b-da67-439a-a679-e93bd7636d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:14.121613 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1345/2718] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:22:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:22:14.126116 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43089a-36d1-4e42-9fef-65e8c679b9fd service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:14.137039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43089a-36d1-4e42-9fef-65e8c679b9fd service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:14.142184 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ea106-8d67-4aa1-9670-f9088cb93ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:14.142831 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ea106-8d67-4aa1-9670-f9088cb93ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:14.143113 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ea106-8d67-4aa1-9670-f9088cb93ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:14.143418 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ea106-8d67-4aa1-9670-f9088cb93ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:14.144115 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ea106-8d67-4aa1-9670-f9088cb93ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:14.146327 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ea106-8d67-4aa1-9670-f9088cb93ad6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:14.173039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1374/2719] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:22:14 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:22:14.177531 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913521b-da67-439a-a679-e93bd7636d40 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:14.195534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913521b-da67-439a-a679-e93bd7636d40 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:14.275650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7224fd-3c45-4122-8e53-146298882d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:14.276327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7224fd-3c45-4122-8e53-146298882d60 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:14.276612 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7224fd-3c45-4122-8e53-146298882d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:14.276892 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7224fd-3c45-4122-8e53-146298882d60 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:14.277626 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7224fd-3c45-4122-8e53-146298882d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:14.280165 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7224fd-3c45-4122-8e53-146298882d60 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:14.301406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1346/2720] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:22:14 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:22:14.305879 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ea106-8d67-4aa1-9670-f9088cb93ad6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:14.317103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ea106-8d67-4aa1-9670-f9088cb93ad6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:14.322127 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40dde9-1fe7-43f9-a9dd-14b1ac50d9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:14.322932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40dde9-1fe7-43f9-a9dd-14b1ac50d9ed admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:14.323220 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40dde9-1fe7-43f9-a9dd-14b1ac50d9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:14.323501 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40dde9-1fe7-43f9-a9dd-14b1ac50d9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:14.324269 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40dde9-1fe7-43f9-a9dd-14b1ac50d9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:14.325928 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40dde9-1fe7-43f9-a9dd-14b1ac50d9ed admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:14.337500 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1375/2721] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:22:14.341635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7224fd-3c45-4122-8e53-146298882d60 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:14.352288 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7224fd-3c45-4122-8e53-146298882d60 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:14.356972 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec1b76-f969-4280-92ec-75b97cc61a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:14.357911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec1b76-f969-4280-92ec-75b97cc61a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:14.358194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec1b76-f969-4280-92ec-75b97cc61a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:14.358472 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec1b76-f969-4280-92ec-75b97cc61a48 admin admin] PATH_INFO: `/v3/projects/02876f4401704bd1ab982f527821de6f/users/f5f184f25d794c4d95e7eb7993d86e8e/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:14.373865 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec1b76-f969-4280-92ec-75b97cc61a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02876f4401704bd1ab982f527821de6f, user_id=f5f184f25d794c4d95e7eb7993d86e8e, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:14.376452 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec1b76-f969-4280-92ec-75b97cc61a48 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:14.390746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1347/2722] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:22:14 2022] PUT /identity/v3/projects/02876f4401704bd1ab982f527821de6f/users/f5f184f25d794c4d95e7eb7993d86e8e/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:22:14.394665 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40dde9-1fe7-43f9-a9dd-14b1ac50d9ed admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:14.406062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40dde9-1fe7-43f9-a9dd-14b1ac50d9ed admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:14.489716 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d8d3f-c301-46fb-908d-e0631cdb4012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:14.490410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d8d3f-c301-46fb-908d-e0631cdb4012 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:14.490694 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d8d3f-c301-46fb-908d-e0631cdb4012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:14.490961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d8d3f-c301-46fb-908d-e0631cdb4012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:14.491914 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d8d3f-c301-46fb-908d-e0631cdb4012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:14.493553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d8d3f-c301-46fb-908d-e0631cdb4012 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:14.504751 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1376/2723] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:22:14.508927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec1b76-f969-4280-92ec-75b97cc61a48 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:14.520731 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec1b76-f969-4280-92ec-75b97cc61a48 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:14.525719 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f88e3-9682-4a75-afdc-02989d69d7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:14.526624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f88e3-9682-4a75-afdc-02989d69d7b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:14.526900 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f88e3-9682-4a75-afdc-02989d69d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:14.527176 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f88e3-9682-4a75-afdc-02989d69d7b4 admin admin] PATH_INFO: `/v3/projects/02876f4401704bd1ab982f527821de6f/users/f5f184f25d794c4d95e7eb7993d86e8e/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:14.529180 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f88e3-9682-4a75-afdc-02989d69d7b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02876f4401704bd1ab982f527821de6f, user_id=f5f184f25d794c4d95e7eb7993d86e8e, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:14.531967 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f88e3-9682-4a75-afdc-02989d69d7b4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:14.543028 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1348/2724] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:22:14 2022] PUT /identity/v3/projects/02876f4401704bd1ab982f527821de6f/users/f5f184f25d794c4d95e7eb7993d86e8e/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:22:15.848408 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d8d3f-c301-46fb-908d-e0631cdb4012 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:15.851217 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-602d8d3f-c301-46fb-908d-e0631cdb4012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:15.934105 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d8d3f-c301-46fb-908d-e0631cdb4012 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:15.975603 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:22:15.996605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253973d-f6b3-4a64-8502-0007ffef52a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:15.997348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253973d-f6b3-4a64-8502-0007ffef52a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:15.997727 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253973d-f6b3-4a64-8502-0007ffef52a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:15.998151 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253973d-f6b3-4a64-8502-0007ffef52a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:16.000823 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0253973d-f6b3-4a64-8502-0007ffef52a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:16.112059 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253973d-f6b3-4a64-8502-0007ffef52a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:16.113706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253973d-f6b3-4a64-8502-0007ffef52a1 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:16.134067 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1377/2725] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:22:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:22:19.656519 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372225f-1ed6-49f6-94bb-c1cd89ca6ae9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:19.662473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372225f-1ed6-49f6-94bb-c1cd89ca6ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:19.664847 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372225f-1ed6-49f6-94bb-c1cd89ca6ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:19.708645 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:22:19.720825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e372225f-1ed6-49f6-94bb-c1cd89ca6ae9 None None] MFA Rules not processed for user `f5f184f25d794c4d95e7eb7993d86e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:22:19.722548 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e372225f-1ed6-49f6-94bb-c1cd89ca6ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:19.851480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253973d-f6b3-4a64-8502-0007ffef52a1 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:19.853723 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0253973d-f6b3-4a64-8502-0007ffef52a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:19.855837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1349/2726] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:22:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:22:19.974219 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253973d-f6b3-4a64-8502-0007ffef52a1 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:19.986768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bc050-b195-42cf-8196-e8eeb835ea86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:19.987779 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bc050-b195-42cf-8196-e8eeb835ea86 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:19.988305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bc050-b195-42cf-8196-e8eeb835ea86 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:19.989347 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bc050-b195-42cf-8196-e8eeb835ea86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:20.083113 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bc050-b195-42cf-8196-e8eeb835ea86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:20.084883 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bc050-b195-42cf-8196-e8eeb835ea86 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:20.097880 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1378/2727] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:22:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:22:21.463083 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ffec3-877d-4c66-9bf7-7848e107f411 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:21.463588 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ffec3-877d-4c66-9bf7-7848e107f411 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:21.463697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ffec3-877d-4c66-9bf7-7848e107f411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:21.483979 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f03ffec3-877d-4c66-9bf7-7848e107f411 None None] MFA Rules not processed for user `4db906a7c80340fa93d5657155b96490`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:22:21.485488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f03ffec3-877d-4c66-9bf7-7848e107f411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:21.496635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1350/2728] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:22:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:22:24.508583 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dc2df-b46d-400c-9c17-a10ba46d1634 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:24.509450 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dc2df-b46d-400c-9c17-a10ba46d1634 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:24.509801 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dc2df-b46d-400c-9c17-a10ba46d1634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:24.530328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-047dc2df-b46d-400c-9c17-a10ba46d1634 None None] MFA Rules not processed for user `b1c9bf7e450e4b7f95c0e50116fd8b34`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:22:24.531522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-047dc2df-b46d-400c-9c17-a10ba46d1634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:24.539339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1379/2729] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:22:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:22:24.863722 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ffec3-877d-4c66-9bf7-7848e107f411 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:24.926919 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ffec3-877d-4c66-9bf7-7848e107f411 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:24.931146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d498e2-ae3a-4098-a2ae-f0faecb7b891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:24.931795 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d498e2-ae3a-4098-a2ae-f0faecb7b891 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:24.932075 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d498e2-ae3a-4098-a2ae-f0faecb7b891 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:24.932345 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d498e2-ae3a-4098-a2ae-f0faecb7b891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:24.934257 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d2d498e2-ae3a-4098-a2ae-f0faecb7b891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:24.944842 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d498e2-ae3a-4098-a2ae-f0faecb7b891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:24.946283 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d498e2-ae3a-4098-a2ae-f0faecb7b891 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:24.954901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1351/2730] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:22:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:22:26.760663 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dc2df-b46d-400c-9c17-a10ba46d1634 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:26.765091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-047dc2df-b46d-400c-9c17-a10ba46d1634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:26.792416 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:22:26.877246 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dc2df-b46d-400c-9c17-a10ba46d1634 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:26.882575 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d95f82-74db-45f8-9107-e5b57be01406 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8673c91abf14c0b9a237f0499fdf20e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:26.883286 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d95f82-74db-45f8-9107-e5b57be01406 service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:26.883599 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d95f82-74db-45f8-9107-e5b57be01406 service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:26.883897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d95f82-74db-45f8-9107-e5b57be01406 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:26.885811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b8d95f82-74db-45f8-9107-e5b57be01406 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:26.897971 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d95f82-74db-45f8-9107-e5b57be01406 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:26.899493 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d95f82-74db-45f8-9107-e5b57be01406 service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:26.910285 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1380/2731] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:22:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:22:34.951263 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=58 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:22:36.905750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=32 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:22:53.790814 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d498e2-ae3a-4098-a2ae-f0faecb7b891 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:22:53.807525 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d498e2-ae3a-4098-a2ae-f0faecb7b891 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:22:53.814647 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fb1c2-874f-4804-89b0-30dba07a9288 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:22:53.815297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fb1c2-874f-4804-89b0-30dba07a9288 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:22:53.815576 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fb1c2-874f-4804-89b0-30dba07a9288 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:22:53.815849 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fb1c2-874f-4804-89b0-30dba07a9288 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:22:53.818692 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8f0fb1c2-874f-4804-89b0-30dba07a9288 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:22:53.830771 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fb1c2-874f-4804-89b0-30dba07a9288 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:22:53.832356 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fb1c2-874f-4804-89b0-30dba07a9288 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:22:53.845303 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1352/2732] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:22:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:23:03.840157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=6 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:23:09.013851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe5e4d-e758-430b-9938-45dd7ae48633 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:23:09.014385 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe5e4d-e758-430b-9938-45dd7ae48633 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:23:09.014385 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe5e4d-e758-430b-9938-45dd7ae48633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:23:09.032695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6abe5e4d-e758-430b-9938-45dd7ae48633 None None] MFA Rules not processed for user `a465c88cf6764892b610a609b0add2c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:23:09.033907 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6abe5e4d-e758-430b-9938-45dd7ae48633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:23:09.089518 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1381/2733] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:23:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:23:17.656402 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fb1c2-874f-4804-89b0-30dba07a9288 service nova] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:23:17.657966 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8f0fb1c2-874f-4804-89b0-30dba07a9288 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:23:17.670155 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fb1c2-874f-4804-89b0-30dba07a9288 service nova] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:23:17.673753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6bc71-5ee4-4fb7-8d48-0199d57e897c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:23:17.674394 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6bc71-5ee4-4fb7-8d48-0199d57e897c service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:23:17.674704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6bc71-5ee4-4fb7-8d48-0199d57e897c service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:23:17.674982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6bc71-5ee4-4fb7-8d48-0199d57e897c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:23:17.684549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6bc71-5ee4-4fb7-8d48-0199d57e897c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:23:17.686007 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6bc71-5ee4-4fb7-8d48-0199d57e897c service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:23:17.696035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1353/2734] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:23:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:23:19.082910 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=25 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:23:27.691731 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=6 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:24:14.381436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe5e4d-e758-430b-9938-45dd7ae48633 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:24:14.393647 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe5e4d-e758-430b-9938-45dd7ae48633 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:24:14.398894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ca4ec-1da0-401f-89ca-a1f7ad9b67fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8673c91abf14c0b9a237f0499fdf20e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:24:14.400189 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ca4ec-1da0-401f-89ca-a1f7ad9b67fd service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:24:14.400480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ca4ec-1da0-401f-89ca-a1f7ad9b67fd service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:24:14.400764 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ca4ec-1da0-401f-89ca-a1f7ad9b67fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:24:14.402544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-da0ca4ec-1da0-401f-89ca-a1f7ad9b67fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:24:14.414771 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ca4ec-1da0-401f-89ca-a1f7ad9b67fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:24:14.416379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ca4ec-1da0-401f-89ca-a1f7ad9b67fd service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:24:14.427499 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1382/2735] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:24:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:24:14.445644 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6bc71-5ee4-4fb7-8d48-0199d57e897c service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:24:14.447079 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5de6bc71-5ee4-4fb7-8d48-0199d57e897c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:24:14.512577 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6bc71-5ee4-4fb7-8d48-0199d57e897c service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:24:14.517072 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90b159-70a0-4e0b-9510-cb8e56383a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:24:14.517980 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90b159-70a0-4e0b-9510-cb8e56383a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:24:14.518268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90b159-70a0-4e0b-9510-cb8e56383a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:24:14.518543 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90b159-70a0-4e0b-9510-cb8e56383a6c admin admin] PATH_INFO: `/v3/users/a465c88cf6764892b610a609b0add2c2` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:24:14.519704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90b159-70a0-4e0b-9510-cb8e56383a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a465c88cf6764892b610a609b0add2c2)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:24:14.521630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90b159-70a0-4e0b-9510-cb8e56383a6c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:24:14.568143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9b90b159-70a0-4e0b-9510-cb8e56383a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a465c88cf6764892b610a609b0add2c2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:24:14.579555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9b90b159-70a0-4e0b-9510-cb8e56383a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a465c88cf6764892b610a609b0add2c2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:24:14.580201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9b90b159-70a0-4e0b-9510-cb8e56383a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a465c88cf6764892b610a609b0add2c2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:24:14.580829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9b90b159-70a0-4e0b-9510-cb8e56383a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a465c88cf6764892b610a609b0add2c2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:24:14.588227 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9b90b159-70a0-4e0b-9510-cb8e56383a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a465c88cf6764892b610a609b0add2c2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:24:14.601092 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1354/2736] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:24:14 2022] DELETE /identity/v3/users/a465c88cf6764892b610a609b0add2c2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:24:14.770402 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ca4ec-1da0-401f-89ca-a1f7ad9b67fd service placement] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:24:14.781006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ca4ec-1da0-401f-89ca-a1f7ad9b67fd service placement] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:24:14.843005 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94f8ba-75f7-4022-9a6f-26606f666d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:24:14.844401 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94f8ba-75f7-4022-9a6f-26606f666d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:24:14.844854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94f8ba-75f7-4022-9a6f-26606f666d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:24:14.845541 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94f8ba-75f7-4022-9a6f-26606f666d01 admin admin] PATH_INFO: `/v3/projects/2d465b0147884d30874442fcf596df3d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:24:14.847920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94f8ba-75f7-4022-9a6f-26606f666d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d465b0147884d30874442fcf596df3d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:24:14.851090 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94f8ba-75f7-4022-9a6f-26606f666d01 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:24:14.901856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1c94f8ba-75f7-4022-9a6f-26606f666d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d465b0147884d30874442fcf596df3d', 'request_id': 'req-1c94f8ba-75f7-4022-9a6f-26606f666d01'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:24:14.909513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1c94f8ba-75f7-4022-9a6f-26606f666d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d465b0147884d30874442fcf596df3d', 'request_id': 'req-1c94f8ba-75f7-4022-9a6f-26606f666d01'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:24:14.914950 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1c94f8ba-75f7-4022-9a6f-26606f666d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d465b0147884d30874442fcf596df3d', 'request_id': 'req-1c94f8ba-75f7-4022-9a6f-26606f666d01'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:24:14.925881 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1c94f8ba-75f7-4022-9a6f-26606f666d01 admin admin] The token cache is being invalidate because project 2d465b0147884d30874442fcf596df3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:24:14.926175 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1c94f8ba-75f7-4022-9a6f-26606f666d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:24:14.926804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1c94f8ba-75f7-4022-9a6f-26606f666d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:24:14.928363 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1383/2737] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:24:14 2022] DELETE /identity/v3/projects/2d465b0147884d30874442fcf596df3d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:24:24.597549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:24:24.922744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:24:36.044364 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90b159-70a0-4e0b-9510-cb8e56383a6c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:24:36.045817 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9b90b159-70a0-4e0b-9510-cb8e56383a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:24:36.125330 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90b159-70a0-4e0b-9510-cb8e56383a6c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:24:36.172663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103dec9-483b-4f12-8d97-f9ccaceb0c49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:24:36.173298 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103dec9-483b-4f12-8d97-f9ccaceb0c49 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:24:36.173597 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103dec9-483b-4f12-8d97-f9ccaceb0c49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:24:36.173868 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103dec9-483b-4f12-8d97-f9ccaceb0c49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:24:36.176177 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6103dec9-483b-4f12-8d97-f9ccaceb0c49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:24:36.261917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103dec9-483b-4f12-8d97-f9ccaceb0c49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:24:36.263346 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103dec9-483b-4f12-8d97-f9ccaceb0c49 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:24:36.283988 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1355/2738] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:24:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:24:45.417755 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94f8ba-75f7-4022-9a6f-26606f666d01 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:24:45.419150 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1c94f8ba-75f7-4022-9a6f-26606f666d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:24:45.432135 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94f8ba-75f7-4022-9a6f-26606f666d01 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:24:45.435695 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc90a7d-a7a2-49dd-8dda-09d9aeecd823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:24:45.436332 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc90a7d-a7a2-49dd-8dda-09d9aeecd823 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:24:45.436619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc90a7d-a7a2-49dd-8dda-09d9aeecd823 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:24:45.436896 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc90a7d-a7a2-49dd-8dda-09d9aeecd823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:24:45.438765 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9fc90a7d-a7a2-49dd-8dda-09d9aeecd823 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:24:45.455588 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc90a7d-a7a2-49dd-8dda-09d9aeecd823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:24:45.456955 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc90a7d-a7a2-49dd-8dda-09d9aeecd823 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:24:45.469575 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1384/2739] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:24:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:24:46.280826 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:24:55.464363 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:04.095485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103dec9-483b-4f12-8d97-f9ccaceb0c49 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:04.096909 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6103dec9-483b-4f12-8d97-f9ccaceb0c49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:04.153569 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103dec9-483b-4f12-8d97-f9ccaceb0c49 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:04.157160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921c84f-3b1d-4963-a914-4fefc86410f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:04.157831 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921c84f-3b1d-4963-a914-4fefc86410f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:04.158114 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921c84f-3b1d-4963-a914-4fefc86410f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:04.158389 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921c84f-3b1d-4963-a914-4fefc86410f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:04.160116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d921c84f-3b1d-4963-a914-4fefc86410f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:04.221989 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921c84f-3b1d-4963-a914-4fefc86410f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:04.223478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921c84f-3b1d-4963-a914-4fefc86410f0 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:04.233030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1356/2740] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:25:07.346010 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc90a7d-a7a2-49dd-8dda-09d9aeecd823 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:07.347532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9fc90a7d-a7a2-49dd-8dda-09d9aeecd823 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:07.364915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc90a7d-a7a2-49dd-8dda-09d9aeecd823 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:07.369685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49323b-45c3-4c77-803c-fe6db3867e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:07.370654 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49323b-45c3-4c77-803c-fe6db3867e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:07.371094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49323b-45c3-4c77-803c-fe6db3867e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:07.371379 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49323b-45c3-4c77-803c-fe6db3867e81 admin admin] PATH_INFO: `/v3/users/b1c9bf7e450e4b7f95c0e50116fd8b34` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:07.372617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49323b-45c3-4c77-803c-fe6db3867e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1c9bf7e450e4b7f95c0e50116fd8b34)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:07.374768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49323b-45c3-4c77-803c-fe6db3867e81 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:07.421735 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3a49323b-45c3-4c77-803c-fe6db3867e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c9bf7e450e4b7f95c0e50116fd8b34'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:07.434302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3a49323b-45c3-4c77-803c-fe6db3867e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c9bf7e450e4b7f95c0e50116fd8b34'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:07.435056 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3a49323b-45c3-4c77-803c-fe6db3867e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c9bf7e450e4b7f95c0e50116fd8b34'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:07.435750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3a49323b-45c3-4c77-803c-fe6db3867e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c9bf7e450e4b7f95c0e50116fd8b34'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:07.444304 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3a49323b-45c3-4c77-803c-fe6db3867e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c9bf7e450e4b7f95c0e50116fd8b34'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:07.456638 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1385/2741] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:25:07 2022] DELETE /identity/v3/users/b1c9bf7e450e4b7f95c0e50116fd8b34 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:07.629379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921c84f-3b1d-4963-a914-4fefc86410f0 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:07.639235 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921c84f-3b1d-4963-a914-4fefc86410f0 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:07.694844 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11484dd5-0b7a-47ea-a47e-c6566dd73180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:07.695697 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11484dd5-0b7a-47ea-a47e-c6566dd73180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:07.695980 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11484dd5-0b7a-47ea-a47e-c6566dd73180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:07.696256 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11484dd5-0b7a-47ea-a47e-c6566dd73180 admin admin] PATH_INFO: `/v3/projects/ab3acd3335534462ba418e37ee809534` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:07.697459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11484dd5-0b7a-47ea-a47e-c6566dd73180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3acd3335534462ba418e37ee809534)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:07.699375 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11484dd5-0b7a-47ea-a47e-c6566dd73180 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:07.743626 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-11484dd5-0b7a-47ea-a47e-c6566dd73180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3acd3335534462ba418e37ee809534', 'request_id': 'req-11484dd5-0b7a-47ea-a47e-c6566dd73180'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:07.745491 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:07.750037 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-11484dd5-0b7a-47ea-a47e-c6566dd73180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3acd3335534462ba418e37ee809534', 'request_id': 'req-11484dd5-0b7a-47ea-a47e-c6566dd73180'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:07.755789 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-11484dd5-0b7a-47ea-a47e-c6566dd73180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3acd3335534462ba418e37ee809534', 'request_id': 'req-11484dd5-0b7a-47ea-a47e-c6566dd73180'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:07.767376 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-11484dd5-0b7a-47ea-a47e-c6566dd73180 admin admin] The token cache is being invalidate because project ab3acd3335534462ba418e37ee809534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:25:07.767696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-11484dd5-0b7a-47ea-a47e-c6566dd73180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:07.768322 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-11484dd5-0b7a-47ea-a47e-c6566dd73180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:07.769903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1357/2742] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:25:07 2022] DELETE /identity/v3/projects/ab3acd3335534462ba418e37ee809534 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:07.775062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b513c22-8b51-4c14-b757-775504f86c07 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:07.775403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b513c22-8b51-4c14-b757-775504f86c07 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:07.775683 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b513c22-8b51-4c14-b757-775504f86c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:07.806460 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1b513c22-8b51-4c14-b757-775504f86c07 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:07.807665 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1b513c22-8b51-4c14-b757-775504f86c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:07.866131 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1386/2743] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:07.874721 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3f4ee-d87c-4bc9-9f76-e948119c6eb4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:07.875035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3f4ee-d87c-4bc9-9f76-e948119c6eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:07.875313 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3f4ee-d87c-4bc9-9f76-e948119c6eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:07.893843 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-22a3f4ee-d87c-4bc9-9f76-e948119c6eb4 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:07.894965 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-22a3f4ee-d87c-4bc9-9f76-e948119c6eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:07.903327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1358/2744] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:07.907422 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b513c22-8b51-4c14-b757-775504f86c07 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:07.917635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b513c22-8b51-4c14-b757-775504f86c07 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:07.922128 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88756273-ae15-4490-a38e-8b1587150f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:07.922766 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88756273-ae15-4490-a38e-8b1587150f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:07.923045 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88756273-ae15-4490-a38e-8b1587150f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:07.923313 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88756273-ae15-4490-a38e-8b1587150f4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:07.924033 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88756273-ae15-4490-a38e-8b1587150f4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:25:07.924323 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88756273-ae15-4490-a38e-8b1587150f4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:07.925968 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88756273-ae15-4490-a38e-8b1587150f4e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:07.937099 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1387/2745] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:25:07.941396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3f4ee-d87c-4bc9-9f76-e948119c6eb4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:07.950525 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3f4ee-d87c-4bc9-9f76-e948119c6eb4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:07.955160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aadb6a-7e13-41b6-86a5-93eb0c7d5649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:07.956311 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aadb6a-7e13-41b6-86a5-93eb0c7d5649 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:07.956592 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aadb6a-7e13-41b6-86a5-93eb0c7d5649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:07.956866 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aadb6a-7e13-41b6-86a5-93eb0c7d5649 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:07.957586 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aadb6a-7e13-41b6-86a5-93eb0c7d5649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:07.959465 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aadb6a-7e13-41b6-86a5-93eb0c7d5649 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:07.984024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1359/2746] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:25:07 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:07.988028 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88756273-ae15-4490-a38e-8b1587150f4e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:07.998101 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88756273-ae15-4490-a38e-8b1587150f4e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:08.043223 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:08.053871 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a789a-fec2-4c4b-afbe-738cf36b7c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:08.054522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a789a-fec2-4c4b-afbe-738cf36b7c31 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:08.054800 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a789a-fec2-4c4b-afbe-738cf36b7c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:08.055071 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a789a-fec2-4c4b-afbe-738cf36b7c31 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:08.055765 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a789a-fec2-4c4b-afbe-738cf36b7c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:08.057685 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a789a-fec2-4c4b-afbe-738cf36b7c31 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:08.076986 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1388/2747] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:25:07 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:25:08.081605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aadb6a-7e13-41b6-86a5-93eb0c7d5649 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:08.091731 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aadb6a-7e13-41b6-86a5-93eb0c7d5649 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:08.096886 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9efffa-2619-48a5-b93a-1e226ad9b4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:08.097576 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9efffa-2619-48a5-b93a-1e226ad9b4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:08.097861 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9efffa-2619-48a5-b93a-1e226ad9b4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:08.098136 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9efffa-2619-48a5-b93a-1e226ad9b4d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:08.098883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9efffa-2619-48a5-b93a-1e226ad9b4d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:08.100806 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9efffa-2619-48a5-b93a-1e226ad9b4d6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:08.111732 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1360/2748] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:08.115759 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a789a-fec2-4c4b-afbe-738cf36b7c31 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:08.128436 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a789a-fec2-4c4b-afbe-738cf36b7c31 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:08.133028 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfcaaf-e889-43b3-aee9-dea4368c2799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:08.133706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfcaaf-e889-43b3-aee9-dea4368c2799 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:08.133987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfcaaf-e889-43b3-aee9-dea4368c2799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:08.134273 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfcaaf-e889-43b3-aee9-dea4368c2799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:08.135007 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfcaaf-e889-43b3-aee9-dea4368c2799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:08.136593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfcaaf-e889-43b3-aee9-dea4368c2799 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:08.147089 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1389/2749] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:08.151398 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9efffa-2619-48a5-b93a-1e226ad9b4d6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:08.161793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9efffa-2619-48a5-b93a-1e226ad9b4d6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:08.166383 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9211c-6f91-4385-8f0b-55666ca2f561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:08.167250 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9211c-6f91-4385-8f0b-55666ca2f561 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:08.167533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9211c-6f91-4385-8f0b-55666ca2f561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:08.167805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9211c-6f91-4385-8f0b-55666ca2f561 admin admin] PATH_INFO: `/v3/projects/609fdf8a8fdc4931bed42ead9fb5fb18/users/0f8d1c4c7a4a4f6183fc551fe9a9ede3/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:08.182033 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9211c-6f91-4385-8f0b-55666ca2f561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=609fdf8a8fdc4931bed42ead9fb5fb18, user_id=0f8d1c4c7a4a4f6183fc551fe9a9ede3, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:08.184798 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9211c-6f91-4385-8f0b-55666ca2f561 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:08.197663 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1361/2750] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:08 2022] PUT /identity/v3/projects/609fdf8a8fdc4931bed42ead9fb5fb18/users/0f8d1c4c7a4a4f6183fc551fe9a9ede3/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:08.208190 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126d5fc-a651-44bc-a767-c95b6f653ac3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:08.208480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126d5fc-a651-44bc-a767-c95b6f653ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:08.208791 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126d5fc-a651-44bc-a767-c95b6f653ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:08.234640 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6126d5fc-a651-44bc-a767-c95b6f653ac3 None None] MFA Rules not processed for user `0f8d1c4c7a4a4f6183fc551fe9a9ede3`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:08.235816 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6126d5fc-a651-44bc-a767-c95b6f653ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:08.298743 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1390/2751] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:08.303145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9211c-6f91-4385-8f0b-55666ca2f561 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:08.363321 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9211c-6f91-4385-8f0b-55666ca2f561 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:08.367902 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3e636-9695-4b88-9757-dfe025a562b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:08.368549 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3e636-9695-4b88-9757-dfe025a562b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:08.368832 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3e636-9695-4b88-9757-dfe025a562b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:08.369111 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3e636-9695-4b88-9757-dfe025a562b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:08.369823 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3e636-9695-4b88-9757-dfe025a562b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:08.371723 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3e636-9695-4b88-9757-dfe025a562b4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:08.398106 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1362/2752] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:25:08 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:08.402253 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126d5fc-a651-44bc-a767-c95b6f653ac3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:08.413026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126d5fc-a651-44bc-a767-c95b6f653ac3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:08.467687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d77fa2-e54b-439f-821e-0cd961535395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:08.468344 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d77fa2-e54b-439f-821e-0cd961535395 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:08.468626 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d77fa2-e54b-439f-821e-0cd961535395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:08.468902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d77fa2-e54b-439f-821e-0cd961535395 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:08.469621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d77fa2-e54b-439f-821e-0cd961535395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:08.471550 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d77fa2-e54b-439f-821e-0cd961535395 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:08.492356 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1391/2753] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:25:08 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:08.496439 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3e636-9695-4b88-9757-dfe025a562b4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:08.507095 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3e636-9695-4b88-9757-dfe025a562b4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:08.511668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643b102-a3de-4c89-a5a7-fbecb7f4a466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:08.512315 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643b102-a3de-4c89-a5a7-fbecb7f4a466 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:08.512598 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643b102-a3de-4c89-a5a7-fbecb7f4a466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:08.512874 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643b102-a3de-4c89-a5a7-fbecb7f4a466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:08.513625 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643b102-a3de-4c89-a5a7-fbecb7f4a466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:08.515208 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643b102-a3de-4c89-a5a7-fbecb7f4a466 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:08.526370 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1363/2754] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:08.530287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d77fa2-e54b-439f-821e-0cd961535395 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:08.540054 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d77fa2-e54b-439f-821e-0cd961535395 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:08.544555 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26aa728-154c-4c33-a87a-c2cd2f060dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:08.545439 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aa728-154c-4c33-a87a-c2cd2f060dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:08.545717 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aa728-154c-4c33-a87a-c2cd2f060dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:08.545983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aa728-154c-4c33-a87a-c2cd2f060dc8 admin admin] PATH_INFO: `/v3/projects/cdfefee1db524340a5b613eca99865a5/users/7e36e6ce7e874bc28755a2282d512d73/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:08.560165 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26aa728-154c-4c33-a87a-c2cd2f060dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfefee1db524340a5b613eca99865a5, user_id=7e36e6ce7e874bc28755a2282d512d73, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:08.562827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26aa728-154c-4c33-a87a-c2cd2f060dc8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:08.575692 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1392/2755] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:08 2022] PUT /identity/v3/projects/cdfefee1db524340a5b613eca99865a5/users/7e36e6ce7e874bc28755a2282d512d73/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:25:08.579487 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643b102-a3de-4c89-a5a7-fbecb7f4a466 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:08.589895 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643b102-a3de-4c89-a5a7-fbecb7f4a466 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:08.637612 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:08.650165 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c363dc-9fff-4b89-8248-6b3e16f828db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:08.650762 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c363dc-9fff-4b89-8248-6b3e16f828db admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:08.651045 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c363dc-9fff-4b89-8248-6b3e16f828db admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:08.651317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c363dc-9fff-4b89-8248-6b3e16f828db admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:08.652035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c363dc-9fff-4b89-8248-6b3e16f828db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:08.653665 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c363dc-9fff-4b89-8248-6b3e16f828db admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:08.663771 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1364/2756] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:08.667765 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26aa728-154c-4c33-a87a-c2cd2f060dc8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:08.678719 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26aa728-154c-4c33-a87a-c2cd2f060dc8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:08.683655 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6793603-333a-4c36-88cf-e42ca217cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:08.684533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6793603-333a-4c36-88cf-e42ca217cfcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:08.684813 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6793603-333a-4c36-88cf-e42ca217cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:08.685087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6793603-333a-4c36-88cf-e42ca217cfcf admin admin] PATH_INFO: `/v3/projects/cdfefee1db524340a5b613eca99865a5/users/7e36e6ce7e874bc28755a2282d512d73/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:08.687111 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6793603-333a-4c36-88cf-e42ca217cfcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfefee1db524340a5b613eca99865a5, user_id=7e36e6ce7e874bc28755a2282d512d73, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:08.690399 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6793603-333a-4c36-88cf-e42ca217cfcf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:08.700948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1393/2757] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:08 2022] PUT /identity/v3/projects/cdfefee1db524340a5b613eca99865a5/users/7e36e6ce7e874bc28755a2282d512d73/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:08.711101 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6f971-5ffe-4605-997c-0ffb821bdb98 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:08.711392 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6f971-5ffe-4605-997c-0ffb821bdb98 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:08.711667 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6f971-5ffe-4605-997c-0ffb821bdb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:08.741056 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-45f6f971-5ffe-4605-997c-0ffb821bdb98 None None] MFA Rules not processed for user `7e36e6ce7e874bc28755a2282d512d73`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:08.742214 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-45f6f971-5ffe-4605-997c-0ffb821bdb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:08.809007 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1365/2758] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:08 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:08.820662 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6793603-333a-4c36-88cf-e42ca217cfcf admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:08.822386 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b6793603-333a-4c36-88cf-e42ca217cfcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:08.835531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:08.879255 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6793603-333a-4c36-88cf-e42ca217cfcf admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:08.882898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778a5f7-7998-4078-96f2-96f6ca433119 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:08.883533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778a5f7-7998-4078-96f2-96f6ca433119 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:08.883815 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778a5f7-7998-4078-96f2-96f6ca433119 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:08.884090 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778a5f7-7998-4078-96f2-96f6ca433119 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:08.893009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778a5f7-7998-4078-96f2-96f6ca433119 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:08.894464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778a5f7-7998-4078-96f2-96f6ca433119 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:08.904058 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1394/2759] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 11:25:09.270719 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6f971-5ffe-4605-997c-0ffb821bdb98 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:09.332485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6f971-5ffe-4605-997c-0ffb821bdb98 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:09.337028 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa6434-3784-470b-97ec-4e14b8251440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:09.337932 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6434-3784-470b-97ec-4e14b8251440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:09.338209 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6434-3784-470b-97ec-4e14b8251440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:09.338490 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6434-3784-470b-97ec-4e14b8251440 admin admin] PATH_INFO: `/v3/users/0f8d1c4c7a4a4f6183fc551fe9a9ede3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:09.339670 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa6434-3784-470b-97ec-4e14b8251440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f8d1c4c7a4a4f6183fc551fe9a9ede3)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:09.341614 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa6434-3784-470b-97ec-4e14b8251440 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:09.387357 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e3aa6434-3784-470b-97ec-4e14b8251440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f8d1c4c7a4a4f6183fc551fe9a9ede3'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:09.400588 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e3aa6434-3784-470b-97ec-4e14b8251440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f8d1c4c7a4a4f6183fc551fe9a9ede3'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:09.401247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e3aa6434-3784-470b-97ec-4e14b8251440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f8d1c4c7a4a4f6183fc551fe9a9ede3'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:09.402211 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e3aa6434-3784-470b-97ec-4e14b8251440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f8d1c4c7a4a4f6183fc551fe9a9ede3'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:09.409824 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e3aa6434-3784-470b-97ec-4e14b8251440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f8d1c4c7a4a4f6183fc551fe9a9ede3'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:09.411814 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:09.424893 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1366/2760] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:25:09 2022] DELETE /identity/v3/users/0f8d1c4c7a4a4f6183fc551fe9a9ede3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:09.429356 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c27de8-2d26-481b-96ad-38d7932a7908 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:09.429860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c27de8-2d26-481b-96ad-38d7932a7908 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:09.429968 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c27de8-2d26-481b-96ad-38d7932a7908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:09.447133 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e6c27de8-2d26-481b-96ad-38d7932a7908 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:09.448321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e6c27de8-2d26-481b-96ad-38d7932a7908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:09.505427 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1395/2761] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:09.514944 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa6434-3784-470b-97ec-4e14b8251440 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:09.516359 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e3aa6434-3784-470b-97ec-4e14b8251440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:09.572276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa6434-3784-470b-97ec-4e14b8251440 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:09.575920 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69edd7-7471-4148-bb49-aad5552ecbf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:09.576556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69edd7-7471-4148-bb49-aad5552ecbf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:09.576837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69edd7-7471-4148-bb49-aad5552ecbf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:09.577113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69edd7-7471-4148-bb49-aad5552ecbf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:09.587006 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69edd7-7471-4148-bb49-aad5552ecbf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:09.588430 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69edd7-7471-4148-bb49-aad5552ecbf9 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:09.598470 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1367/2762] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:25:09.862087 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c27de8-2d26-481b-96ad-38d7932a7908 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:09.863599 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e6c27de8-2d26-481b-96ad-38d7932a7908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:09.876376 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c27de8-2d26-481b-96ad-38d7932a7908 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:09.881520 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae12f55-571b-4205-aadb-8720ca6ffbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:09.882411 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae12f55-571b-4205-aadb-8720ca6ffbe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:09.882691 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae12f55-571b-4205-aadb-8720ca6ffbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:09.882968 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae12f55-571b-4205-aadb-8720ca6ffbe5 admin admin] PATH_INFO: `/v3/projects/609fdf8a8fdc4931bed42ead9fb5fb18` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:09.884148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae12f55-571b-4205-aadb-8720ca6ffbe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=609fdf8a8fdc4931bed42ead9fb5fb18)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:09.886091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae12f55-571b-4205-aadb-8720ca6ffbe5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:09.931613 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8ae12f55-571b-4205-aadb-8720ca6ffbe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609fdf8a8fdc4931bed42ead9fb5fb18', 'request_id': 'req-8ae12f55-571b-4205-aadb-8720ca6ffbe5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:09.938810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8ae12f55-571b-4205-aadb-8720ca6ffbe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609fdf8a8fdc4931bed42ead9fb5fb18', 'request_id': 'req-8ae12f55-571b-4205-aadb-8720ca6ffbe5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:09.944928 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8ae12f55-571b-4205-aadb-8720ca6ffbe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609fdf8a8fdc4931bed42ead9fb5fb18', 'request_id': 'req-8ae12f55-571b-4205-aadb-8720ca6ffbe5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:09.956309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8ae12f55-571b-4205-aadb-8720ca6ffbe5 admin admin] The token cache is being invalidate because project 609fdf8a8fdc4931bed42ead9fb5fb18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:25:09.956599 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8ae12f55-571b-4205-aadb-8720ca6ffbe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:09.957228 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8ae12f55-571b-4205-aadb-8720ca6ffbe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:09.958777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1396/2763] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:25:09 2022] DELETE /identity/v3/projects/609fdf8a8fdc4931bed42ead9fb5fb18 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:09.962849 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69edd7-7471-4148-bb49-aad5552ecbf9 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:09.972310 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69edd7-7471-4148-bb49-aad5552ecbf9 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:10.027334 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09399e95-3ae8-444f-b084-8ec398fb392f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:10.028193 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09399e95-3ae8-444f-b084-8ec398fb392f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:10.028473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09399e95-3ae8-444f-b084-8ec398fb392f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:10.028746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09399e95-3ae8-444f-b084-8ec398fb392f admin admin] PATH_INFO: `/v3/users/7e36e6ce7e874bc28755a2282d512d73` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:10.029939 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09399e95-3ae8-444f-b084-8ec398fb392f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e36e6ce7e874bc28755a2282d512d73)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:10.031836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09399e95-3ae8-444f-b084-8ec398fb392f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:10.075528 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-09399e95-3ae8-444f-b084-8ec398fb392f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e36e6ce7e874bc28755a2282d512d73'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:10.087703 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-09399e95-3ae8-444f-b084-8ec398fb392f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e36e6ce7e874bc28755a2282d512d73'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:10.088375 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-09399e95-3ae8-444f-b084-8ec398fb392f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e36e6ce7e874bc28755a2282d512d73'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:10.089010 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-09399e95-3ae8-444f-b084-8ec398fb392f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e36e6ce7e874bc28755a2282d512d73'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:10.096238 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-09399e95-3ae8-444f-b084-8ec398fb392f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e36e6ce7e874bc28755a2282d512d73'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:10.108970 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1368/2764] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:25:09 2022] DELETE /identity/v3/users/7e36e6ce7e874bc28755a2282d512d73 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:10.382826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae12f55-571b-4205-aadb-8720ca6ffbe5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:10.384344 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8ae12f55-571b-4205-aadb-8720ca6ffbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:10.398016 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae12f55-571b-4205-aadb-8720ca6ffbe5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:10.432591 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:10.457697 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c39b3-a732-4512-8e8a-8f2f98a7760e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:10.458487 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c39b3-a732-4512-8e8a-8f2f98a7760e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:10.458766 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c39b3-a732-4512-8e8a-8f2f98a7760e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:10.459047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c39b3-a732-4512-8e8a-8f2f98a7760e admin admin] PATH_INFO: `/v3/projects/cdfefee1db524340a5b613eca99865a5` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:10.460207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c39b3-a732-4512-8e8a-8f2f98a7760e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdfefee1db524340a5b613eca99865a5)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:10.462130 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c39b3-a732-4512-8e8a-8f2f98a7760e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:10.507755 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-079c39b3-a732-4512-8e8a-8f2f98a7760e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdfefee1db524340a5b613eca99865a5', 'request_id': 'req-079c39b3-a732-4512-8e8a-8f2f98a7760e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:10.514578 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-079c39b3-a732-4512-8e8a-8f2f98a7760e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdfefee1db524340a5b613eca99865a5', 'request_id': 'req-079c39b3-a732-4512-8e8a-8f2f98a7760e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:10.519987 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-079c39b3-a732-4512-8e8a-8f2f98a7760e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdfefee1db524340a5b613eca99865a5', 'request_id': 'req-079c39b3-a732-4512-8e8a-8f2f98a7760e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:10.530832 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-079c39b3-a732-4512-8e8a-8f2f98a7760e admin admin] The token cache is being invalidate because project cdfefee1db524340a5b613eca99865a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:25:10.531111 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-079c39b3-a732-4512-8e8a-8f2f98a7760e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:10.531729 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-079c39b3-a732-4512-8e8a-8f2f98a7760e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:10.533233 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1397/2765] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:25:10 2022] DELETE /identity/v3/projects/cdfefee1db524340a5b613eca99865a5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:10.538930 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb65911-9466-40c9-a359-3df3536b8dbe None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:10.539246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb65911-9466-40c9-a359-3df3536b8dbe None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:10.539522 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb65911-9466-40c9-a359-3df3536b8dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:10.557012 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6fb65911-9466-40c9-a359-3df3536b8dbe None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:10.558225 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6fb65911-9466-40c9-a359-3df3536b8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:10.566302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:10.620084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1369/2766] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:10.629397 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0de0c-7c40-4566-af96-19654be2aa64 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:10.629694 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0de0c-7c40-4566-af96-19654be2aa64 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:10.629970 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0de0c-7c40-4566-af96-19654be2aa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:10.648079 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bfc0de0c-7c40-4566-af96-19654be2aa64 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:10.649259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bfc0de0c-7c40-4566-af96-19654be2aa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:10.657020 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1398/2767] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:10.661740 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb65911-9466-40c9-a359-3df3536b8dbe None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:10.671230 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb65911-9466-40c9-a359-3df3536b8dbe None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:10.676365 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff2b2f-582e-4b44-be53-e3d21be975c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:10.677000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff2b2f-582e-4b44-be53-e3d21be975c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:10.677280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff2b2f-582e-4b44-be53-e3d21be975c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:10.677586 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff2b2f-582e-4b44-be53-e3d21be975c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:10.678297 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff2b2f-582e-4b44-be53-e3d21be975c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:25:10.678600 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff2b2f-582e-4b44-be53-e3d21be975c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:10.680161 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff2b2f-582e-4b44-be53-e3d21be975c6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:10.691703 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1370/2768] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:25:10.695659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0de0c-7c40-4566-af96-19654be2aa64 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:10.704729 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0de0c-7c40-4566-af96-19654be2aa64 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:10.709348 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9fbe0-8aa7-42a4-a637-9b9e31e4b386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:10.709955 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9fbe0-8aa7-42a4-a637-9b9e31e4b386 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:10.710233 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9fbe0-8aa7-42a4-a637-9b9e31e4b386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:10.710501 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9fbe0-8aa7-42a4-a637-9b9e31e4b386 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:10.711177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9fbe0-8aa7-42a4-a637-9b9e31e4b386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:10.713047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9fbe0-8aa7-42a4-a637-9b9e31e4b386 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:10.738346 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1399/2769] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:25:10 2022] POST /identity/v3/projects => generated 357 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:10.742533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff2b2f-582e-4b44-be53-e3d21be975c6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:10.752689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff2b2f-582e-4b44-be53-e3d21be975c6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:10.807202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f541950-1b9e-4c05-b44a-6a7e4b6cc97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:10.807873 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f541950-1b9e-4c05-b44a-6a7e4b6cc97a admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:10.808141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f541950-1b9e-4c05-b44a-6a7e4b6cc97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:10.808418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f541950-1b9e-4c05-b44a-6a7e4b6cc97a admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:10.809084 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f541950-1b9e-4c05-b44a-6a7e4b6cc97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:10.811015 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f541950-1b9e-4c05-b44a-6a7e4b6cc97a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:10.828982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1371/2770] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:25:10 2022] POST /identity/v3/users => generated 279 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:25:10.833075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9fbe0-8aa7-42a4-a637-9b9e31e4b386 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:10.843157 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9fbe0-8aa7-42a4-a637-9b9e31e4b386 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:10.848434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a06bf-e96c-402d-a8ac-0343e10cb567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:10.849090 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a06bf-e96c-402d-a8ac-0343e10cb567 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:10.849388 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a06bf-e96c-402d-a8ac-0343e10cb567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:10.849679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a06bf-e96c-402d-a8ac-0343e10cb567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:10.850410 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a06bf-e96c-402d-a8ac-0343e10cb567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:10.852025 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a06bf-e96c-402d-a8ac-0343e10cb567 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:10.863012 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1400/2771] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:10.866740 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f541950-1b9e-4c05-b44a-6a7e4b6cc97a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:10.876421 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f541950-1b9e-4c05-b44a-6a7e4b6cc97a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:10.880947 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33cf130-b07e-419b-9504-1cf8c1cfb830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:10.881613 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cf130-b07e-419b-9504-1cf8c1cfb830 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:10.881889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cf130-b07e-419b-9504-1cf8c1cfb830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:10.882157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cf130-b07e-419b-9504-1cf8c1cfb830 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:10.882858 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33cf130-b07e-419b-9504-1cf8c1cfb830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:10.884413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33cf130-b07e-419b-9504-1cf8c1cfb830 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:10.895100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1372/2772] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:10.899179 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a06bf-e96c-402d-a8ac-0343e10cb567 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:10.910042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a06bf-e96c-402d-a8ac-0343e10cb567 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:10.914927 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56843ba-85f9-4442-963f-4f183cac08bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:10.915869 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56843ba-85f9-4442-963f-4f183cac08bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:10.916370 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56843ba-85f9-4442-963f-4f183cac08bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:10.916576 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56843ba-85f9-4442-963f-4f183cac08bf admin admin] PATH_INFO: `/v3/projects/da4df42db83b4202945b7b800079f3b4/users/d287baf1c70c428488b2849bcfdc238d/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:10.931042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56843ba-85f9-4442-963f-4f183cac08bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4df42db83b4202945b7b800079f3b4, user_id=d287baf1c70c428488b2849bcfdc238d, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:10.933708 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56843ba-85f9-4442-963f-4f183cac08bf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:10.947431 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1401/2773] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:10 2022] PUT /identity/v3/projects/da4df42db83b4202945b7b800079f3b4/users/d287baf1c70c428488b2849bcfdc238d/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:25:10.958031 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82cffd-763f-4d8f-bb40-44a4ce630642 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:10.958318 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82cffd-763f-4d8f-bb40-44a4ce630642 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:10.958594 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82cffd-763f-4d8f-bb40-44a4ce630642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:10.984189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-fd82cffd-763f-4d8f-bb40-44a4ce630642 None None] MFA Rules not processed for user `d287baf1c70c428488b2849bcfdc238d`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:10.985308 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fd82cffd-763f-4d8f-bb40-44a4ce630642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:11.048801 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1373/2774] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:10 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:11.053847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56843ba-85f9-4442-963f-4f183cac08bf admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:11.119312 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56843ba-85f9-4442-963f-4f183cac08bf admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:11.124012 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b087e10-46a4-481a-8bd6-f77827f7db6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:11.124666 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b087e10-46a4-481a-8bd6-f77827f7db6b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:11.124952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b087e10-46a4-481a-8bd6-f77827f7db6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:11.125231 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b087e10-46a4-481a-8bd6-f77827f7db6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:11.125960 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b087e10-46a4-481a-8bd6-f77827f7db6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:11.128530 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b087e10-46a4-481a-8bd6-f77827f7db6b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:11.136557 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:11.155333 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1402/2775] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:25:11 2022] POST /identity/v3/projects => generated 357 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:11.159637 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82cffd-763f-4d8f-bb40-44a4ce630642 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:11.171391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82cffd-763f-4d8f-bb40-44a4ce630642 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:11.176527 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:11.229875 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c3f4b-dc8d-4d98-a746-9e0bea031de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:11.230541 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c3f4b-dc8d-4d98-a746-9e0bea031de7 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:11.230818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c3f4b-dc8d-4d98-a746-9e0bea031de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:11.231116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c3f4b-dc8d-4d98-a746-9e0bea031de7 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:11.231793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c3f4b-dc8d-4d98-a746-9e0bea031de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:11.233725 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c3f4b-dc8d-4d98-a746-9e0bea031de7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:11.253681 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1374/2776] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:25:11 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:11.257545 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b087e10-46a4-481a-8bd6-f77827f7db6b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:11.267768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b087e10-46a4-481a-8bd6-f77827f7db6b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:11.272647 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340e7ac-dac0-4d5e-9995-c851fec82ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:11.273303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340e7ac-dac0-4d5e-9995-c851fec82ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:11.273615 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340e7ac-dac0-4d5e-9995-c851fec82ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:11.273889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340e7ac-dac0-4d5e-9995-c851fec82ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:11.274615 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340e7ac-dac0-4d5e-9995-c851fec82ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:11.276201 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340e7ac-dac0-4d5e-9995-c851fec82ca7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:11.287088 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1403/2777] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:11.291191 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c3f4b-dc8d-4d98-a746-9e0bea031de7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:11.301813 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c3f4b-dc8d-4d98-a746-9e0bea031de7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:11.306323 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadb95d-97ab-4eb6-882d-3429e0293e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:11.307236 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadb95d-97ab-4eb6-882d-3429e0293e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:11.307552 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadb95d-97ab-4eb6-882d-3429e0293e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:11.307933 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadb95d-97ab-4eb6-882d-3429e0293e4c admin admin] PATH_INFO: `/v3/projects/d5abb74466b34f64b003dc692456d688/users/dcfb1541a9654ddba7aa6534a27d1444/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:11.322698 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadb95d-97ab-4eb6-882d-3429e0293e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5abb74466b34f64b003dc692456d688, user_id=dcfb1541a9654ddba7aa6534a27d1444, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:11.325309 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadb95d-97ab-4eb6-882d-3429e0293e4c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:11.337876 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1375/2778] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:11 2022] PUT /identity/v3/projects/d5abb74466b34f64b003dc692456d688/users/dcfb1541a9654ddba7aa6534a27d1444/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:11.341701 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340e7ac-dac0-4d5e-9995-c851fec82ca7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:11.352287 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340e7ac-dac0-4d5e-9995-c851fec82ca7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:11.407913 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db58c2-df6e-4cf0-a905-0ba4e1b1d365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:11.409138 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db58c2-df6e-4cf0-a905-0ba4e1b1d365 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:11.409467 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db58c2-df6e-4cf0-a905-0ba4e1b1d365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:11.409747 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db58c2-df6e-4cf0-a905-0ba4e1b1d365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:11.410471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db58c2-df6e-4cf0-a905-0ba4e1b1d365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:11.412078 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db58c2-df6e-4cf0-a905-0ba4e1b1d365 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:11.421728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1404/2779] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:11.426454 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadb95d-97ab-4eb6-882d-3429e0293e4c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:11.436427 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadb95d-97ab-4eb6-882d-3429e0293e4c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:11.441450 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5111926-8796-4f5e-94cd-9dd560548854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:11.442311 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5111926-8796-4f5e-94cd-9dd560548854 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:11.442587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5111926-8796-4f5e-94cd-9dd560548854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:11.442856 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5111926-8796-4f5e-94cd-9dd560548854 admin admin] PATH_INFO: `/v3/projects/d5abb74466b34f64b003dc692456d688/users/dcfb1541a9654ddba7aa6534a27d1444/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:11.444804 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5111926-8796-4f5e-94cd-9dd560548854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5abb74466b34f64b003dc692456d688, user_id=dcfb1541a9654ddba7aa6534a27d1444, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:11.447415 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5111926-8796-4f5e-94cd-9dd560548854 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:11.458067 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1376/2780] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:11 2022] PUT /identity/v3/projects/d5abb74466b34f64b003dc692456d688/users/dcfb1541a9654ddba7aa6534a27d1444/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:11.467856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a7e92-2b86-4c4d-b9fe-ba660aa038f2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:11.468335 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a7e92-2b86-4c4d-b9fe-ba660aa038f2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:11.468447 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a7e92-2b86-4c4d-b9fe-ba660aa038f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:11.493557 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-299a7e92-2b86-4c4d-b9fe-ba660aa038f2 None None] MFA Rules not processed for user `dcfb1541a9654ddba7aa6534a27d1444`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:11.494742 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-299a7e92-2b86-4c4d-b9fe-ba660aa038f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:11.561353 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1405/2781] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:11 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:11.574100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5111926-8796-4f5e-94cd-9dd560548854 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:11.575825 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b5111926-8796-4f5e-94cd-9dd560548854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:11.632529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5111926-8796-4f5e-94cd-9dd560548854 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:11.636210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4180a4-610a-4657-b7ec-a4f933ece743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:11.636844 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4180a4-610a-4657-b7ec-a4f933ece743 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:11.637126 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4180a4-610a-4657-b7ec-a4f933ece743 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:11.637429 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4180a4-610a-4657-b7ec-a4f933ece743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:11.647079 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4180a4-610a-4657-b7ec-a4f933ece743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:11.648791 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4180a4-610a-4657-b7ec-a4f933ece743 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:11.658243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1377/2782] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:11 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:25:11.727342 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a7e92-2b86-4c4d-b9fe-ba660aa038f2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:11.737490 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a7e92-2b86-4c4d-b9fe-ba660aa038f2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:11.741069 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82747e-ea1c-4665-bf7f-89baf2333da7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:11.741741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82747e-ea1c-4665-bf7f-89baf2333da7 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:11.742023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82747e-ea1c-4665-bf7f-89baf2333da7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:11.742299 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82747e-ea1c-4665-bf7f-89baf2333da7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:11.797164 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82747e-ea1c-4665-bf7f-89baf2333da7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:11.798636 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82747e-ea1c-4665-bf7f-89baf2333da7 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:11.802719 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:11.809100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1406/2783] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:11 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:25:21.654123 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=66,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:21.811365 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:26.555127 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4180a4-610a-4657-b7ec-a4f933ece743 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:26.615742 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4180a4-610a-4657-b7ec-a4f933ece743 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:26.620175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71879015-7ff8-4660-a502-964a230fef48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:26.621024 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71879015-7ff8-4660-a502-964a230fef48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:26.621330 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71879015-7ff8-4660-a502-964a230fef48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:26.621629 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71879015-7ff8-4660-a502-964a230fef48 admin admin] PATH_INFO: `/v3/users/d287baf1c70c428488b2849bcfdc238d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:26.622788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71879015-7ff8-4660-a502-964a230fef48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d287baf1c70c428488b2849bcfdc238d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:26.624793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71879015-7ff8-4660-a502-964a230fef48 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:26.669756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-71879015-7ff8-4660-a502-964a230fef48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd287baf1c70c428488b2849bcfdc238d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:26.681463 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-71879015-7ff8-4660-a502-964a230fef48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd287baf1c70c428488b2849bcfdc238d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:26.682137 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-71879015-7ff8-4660-a502-964a230fef48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd287baf1c70c428488b2849bcfdc238d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:26.682738 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-71879015-7ff8-4660-a502-964a230fef48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd287baf1c70c428488b2849bcfdc238d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:26.689753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-71879015-7ff8-4660-a502-964a230fef48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd287baf1c70c428488b2849bcfdc238d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:26.701653 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1378/2784] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:25:26 2022] DELETE /identity/v3/users/d287baf1c70c428488b2849bcfdc238d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:25:26.706660 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364553ef-34bb-496d-b1b3-bf8059e340ea None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:26.707140 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364553ef-34bb-496d-b1b3-bf8059e340ea None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:26.707243 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364553ef-34bb-496d-b1b3-bf8059e340ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:26.724677 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-364553ef-34bb-496d-b1b3-bf8059e340ea None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:26.725847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-364553ef-34bb-496d-b1b3-bf8059e340ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:26.786342 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1407/2785] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:26.796277 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71879015-7ff8-4660-a502-964a230fef48 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:26.797749 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-71879015-7ff8-4660-a502-964a230fef48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:26.854075 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71879015-7ff8-4660-a502-964a230fef48 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:26.857741 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaaf18-3bdd-4d80-b264-11d5f41b920a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:26.858376 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaaf18-3bdd-4d80-b264-11d5f41b920a service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:26.858653 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaaf18-3bdd-4d80-b264-11d5f41b920a service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:26.858925 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaaf18-3bdd-4d80-b264-11d5f41b920a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:26.867714 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaaf18-3bdd-4d80-b264-11d5f41b920a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:26.869135 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaaf18-3bdd-4d80-b264-11d5f41b920a service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:26.878473 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1379/2786] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:25:27.139231 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364553ef-34bb-496d-b1b3-bf8059e340ea None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:27.140661 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-364553ef-34bb-496d-b1b3-bf8059e340ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:27.153587 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364553ef-34bb-496d-b1b3-bf8059e340ea None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:27.158722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ddc28-3801-4b47-968f-618f238897b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:27.159595 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ddc28-3801-4b47-968f-618f238897b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:27.159854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ddc28-3801-4b47-968f-618f238897b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:27.160125 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ddc28-3801-4b47-968f-618f238897b3 admin admin] PATH_INFO: `/v3/projects/da4df42db83b4202945b7b800079f3b4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:27.161294 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ddc28-3801-4b47-968f-618f238897b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da4df42db83b4202945b7b800079f3b4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:27.163257 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ddc28-3801-4b47-968f-618f238897b3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:27.209711 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0d3ddc28-3801-4b47-968f-618f238897b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da4df42db83b4202945b7b800079f3b4', 'request_id': 'req-0d3ddc28-3801-4b47-968f-618f238897b3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:27.216911 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0d3ddc28-3801-4b47-968f-618f238897b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da4df42db83b4202945b7b800079f3b4', 'request_id': 'req-0d3ddc28-3801-4b47-968f-618f238897b3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:27.223026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0d3ddc28-3801-4b47-968f-618f238897b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da4df42db83b4202945b7b800079f3b4', 'request_id': 'req-0d3ddc28-3801-4b47-968f-618f238897b3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:27.233878 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0d3ddc28-3801-4b47-968f-618f238897b3 admin admin] The token cache is being invalidate because project da4df42db83b4202945b7b800079f3b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:25:27.234173 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0d3ddc28-3801-4b47-968f-618f238897b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:27.234830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0d3ddc28-3801-4b47-968f-618f238897b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:27.236983 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1408/2787] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:25:27 2022] DELETE /identity/v3/projects/da4df42db83b4202945b7b800079f3b4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:27.240949 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaaf18-3bdd-4d80-b264-11d5f41b920a service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:27.250483 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaaf18-3bdd-4d80-b264-11d5f41b920a service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:27.271546 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:27.312303 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b168c-c10d-4b44-9139-72253f0eed5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:27.313162 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b168c-c10d-4b44-9139-72253f0eed5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:27.313471 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b168c-c10d-4b44-9139-72253f0eed5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:27.313744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b168c-c10d-4b44-9139-72253f0eed5d admin admin] PATH_INFO: `/v3/users/dcfb1541a9654ddba7aa6534a27d1444` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:27.314904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b168c-c10d-4b44-9139-72253f0eed5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcfb1541a9654ddba7aa6534a27d1444)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:27.316792 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b168c-c10d-4b44-9139-72253f0eed5d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:27.360613 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-585b168c-c10d-4b44-9139-72253f0eed5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcfb1541a9654ddba7aa6534a27d1444'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:27.372620 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-585b168c-c10d-4b44-9139-72253f0eed5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcfb1541a9654ddba7aa6534a27d1444'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:27.373276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-585b168c-c10d-4b44-9139-72253f0eed5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcfb1541a9654ddba7aa6534a27d1444'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:27.373910 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-585b168c-c10d-4b44-9139-72253f0eed5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcfb1541a9654ddba7aa6534a27d1444'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:27.380894 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-585b168c-c10d-4b44-9139-72253f0eed5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcfb1541a9654ddba7aa6534a27d1444'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:27.393232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1380/2788] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:25:27 2022] DELETE /identity/v3/users/dcfb1541a9654ddba7aa6534a27d1444 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:27.657043 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ddc28-3801-4b47-968f-618f238897b3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:27.659595 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0d3ddc28-3801-4b47-968f-618f238897b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:27.675411 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ddc28-3801-4b47-968f-618f238897b3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:27.732180 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2d453-f85e-406a-93ba-9e4d77378c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:27.733036 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2d453-f85e-406a-93ba-9e4d77378c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:27.733314 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2d453-f85e-406a-93ba-9e4d77378c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:27.733616 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2d453-f85e-406a-93ba-9e4d77378c16 admin admin] PATH_INFO: `/v3/projects/d5abb74466b34f64b003dc692456d688` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:27.734787 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2d453-f85e-406a-93ba-9e4d77378c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5abb74466b34f64b003dc692456d688)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:27.736734 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2d453-f85e-406a-93ba-9e4d77378c16 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:27.767894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:27.789874 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-afe2d453-f85e-406a-93ba-9e4d77378c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5abb74466b34f64b003dc692456d688', 'request_id': 'req-afe2d453-f85e-406a-93ba-9e4d77378c16'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:27.797259 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-afe2d453-f85e-406a-93ba-9e4d77378c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5abb74466b34f64b003dc692456d688', 'request_id': 'req-afe2d453-f85e-406a-93ba-9e4d77378c16'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:27.802962 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-afe2d453-f85e-406a-93ba-9e4d77378c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5abb74466b34f64b003dc692456d688', 'request_id': 'req-afe2d453-f85e-406a-93ba-9e4d77378c16'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:27.813913 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-afe2d453-f85e-406a-93ba-9e4d77378c16 admin admin] The token cache is being invalidate because project d5abb74466b34f64b003dc692456d688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:25:27.814202 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-afe2d453-f85e-406a-93ba-9e4d77378c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:27.815340 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-afe2d453-f85e-406a-93ba-9e4d77378c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:27.816880 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1409/2789] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:25:27 2022] DELETE /identity/v3/projects/d5abb74466b34f64b003dc692456d688 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:27.822054 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef7296-d1a3-4716-9659-c6916e6a1152 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:27.822542 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef7296-d1a3-4716-9659-c6916e6a1152 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:27.822665 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef7296-d1a3-4716-9659-c6916e6a1152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:27.840428 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a1ef7296-d1a3-4716-9659-c6916e6a1152 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:27.841679 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a1ef7296-d1a3-4716-9659-c6916e6a1152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:27.899871 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1381/2790] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:27.907605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f32142-1d12-4659-928c-8b325368fbea None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:27.907887 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f32142-1d12-4659-928c-8b325368fbea None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:27.908187 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f32142-1d12-4659-928c-8b325368fbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:27.925704 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f4f32142-1d12-4659-928c-8b325368fbea None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:27.926934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f4f32142-1d12-4659-928c-8b325368fbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:27.934701 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1410/2791] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:27.938832 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef7296-d1a3-4716-9659-c6916e6a1152 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:27.949068 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef7296-d1a3-4716-9659-c6916e6a1152 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:27.953691 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6eddce-4db5-4fd9-bf50-a77c80882161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:27.954337 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eddce-4db5-4fd9-bf50-a77c80882161 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:27.954620 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eddce-4db5-4fd9-bf50-a77c80882161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:27.954897 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eddce-4db5-4fd9-bf50-a77c80882161 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:27.956214 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6eddce-4db5-4fd9-bf50-a77c80882161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:25:27.956517 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6eddce-4db5-4fd9-bf50-a77c80882161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:27.958167 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6eddce-4db5-4fd9-bf50-a77c80882161 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:27.970276 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1382/2792] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:25:27.974292 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f32142-1d12-4659-928c-8b325368fbea None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:27.983371 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f32142-1d12-4659-928c-8b325368fbea None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:27.988000 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233dbac-a22f-47f0-90eb-8da6f4b8bc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:27.988632 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233dbac-a22f-47f0-90eb-8da6f4b8bc59 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:27.988915 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233dbac-a22f-47f0-90eb-8da6f4b8bc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:27.989193 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233dbac-a22f-47f0-90eb-8da6f4b8bc59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:27.989914 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233dbac-a22f-47f0-90eb-8da6f4b8bc59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:27.991787 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233dbac-a22f-47f0-90eb-8da6f4b8bc59 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:28.019326 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1411/2793] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:25:27 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:25:28.026366 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6eddce-4db5-4fd9-bf50-a77c80882161 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:28.037245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6eddce-4db5-4fd9-bf50-a77c80882161 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:28.065194 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:28.097763 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895d28b-e71e-4181-b518-d7815b3295b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:28.098437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895d28b-e71e-4181-b518-d7815b3295b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:28.098718 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895d28b-e71e-4181-b518-d7815b3295b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:28.099018 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895d28b-e71e-4181-b518-d7815b3295b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:28.099700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895d28b-e71e-4181-b518-d7815b3295b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:28.101717 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895d28b-e71e-4181-b518-d7815b3295b7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:28.125077 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1383/2794] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:25:28 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:28.129778 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233dbac-a22f-47f0-90eb-8da6f4b8bc59 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:28.140006 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233dbac-a22f-47f0-90eb-8da6f4b8bc59 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:28.145282 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773de21e-c47e-48b6-a2ba-c49fdd2406aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:28.145966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773de21e-c47e-48b6-a2ba-c49fdd2406aa admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:28.146252 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773de21e-c47e-48b6-a2ba-c49fdd2406aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:28.146531 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773de21e-c47e-48b6-a2ba-c49fdd2406aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:28.147260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773de21e-c47e-48b6-a2ba-c49fdd2406aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:28.149106 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773de21e-c47e-48b6-a2ba-c49fdd2406aa admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:28.159817 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1412/2795] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:28.163597 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895d28b-e71e-4181-b518-d7815b3295b7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:28.173396 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895d28b-e71e-4181-b518-d7815b3295b7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:28.178443 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158f473-2e7d-4695-9c34-8ebb7a4a237c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:28.179088 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158f473-2e7d-4695-9c34-8ebb7a4a237c admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:28.179364 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158f473-2e7d-4695-9c34-8ebb7a4a237c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:28.179635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158f473-2e7d-4695-9c34-8ebb7a4a237c admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:28.180349 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158f473-2e7d-4695-9c34-8ebb7a4a237c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:28.181954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158f473-2e7d-4695-9c34-8ebb7a4a237c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:28.193050 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1384/2796] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:28.197299 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773de21e-c47e-48b6-a2ba-c49fdd2406aa admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:28.207460 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773de21e-c47e-48b6-a2ba-c49fdd2406aa admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:28.212139 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9271830-2a4a-49de-bbe3-6139d6436c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:28.213073 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9271830-2a4a-49de-bbe3-6139d6436c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:28.213354 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9271830-2a4a-49de-bbe3-6139d6436c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:28.213659 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9271830-2a4a-49de-bbe3-6139d6436c49 admin admin] PATH_INFO: `/v3/projects/6f18f4ed0fc44f83bb2511ab5ac07e62/users/b31c75dd8e7744e0b5b38322d95c008c/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:28.227780 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9271830-2a4a-49de-bbe3-6139d6436c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f18f4ed0fc44f83bb2511ab5ac07e62, user_id=b31c75dd8e7744e0b5b38322d95c008c, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:28.230479 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9271830-2a4a-49de-bbe3-6139d6436c49 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:28.243270 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1413/2797] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:28 2022] PUT /identity/v3/projects/6f18f4ed0fc44f83bb2511ab5ac07e62/users/b31c75dd8e7744e0b5b38322d95c008c/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:28.254074 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695dd7b-230b-417b-92da-aab5d316af28 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:28.254367 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695dd7b-230b-417b-92da-aab5d316af28 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:28.254646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695dd7b-230b-417b-92da-aab5d316af28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:28.281410 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4695dd7b-230b-417b-92da-aab5d316af28 None None] MFA Rules not processed for user `b31c75dd8e7744e0b5b38322d95c008c`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:28.282616 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4695dd7b-230b-417b-92da-aab5d316af28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:28.348268 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1385/2798] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:25:28.352605 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9271830-2a4a-49de-bbe3-6139d6436c49 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:28.413643 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9271830-2a4a-49de-bbe3-6139d6436c49 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:28.418260 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30621581-7ae2-487e-ab90-cb6da87f92c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:28.418917 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30621581-7ae2-487e-ab90-cb6da87f92c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:28.419207 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30621581-7ae2-487e-ab90-cb6da87f92c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:28.419480 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30621581-7ae2-487e-ab90-cb6da87f92c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:28.420166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30621581-7ae2-487e-ab90-cb6da87f92c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:28.422142 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30621581-7ae2-487e-ab90-cb6da87f92c6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:28.449222 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1414/2799] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:25:28 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:28.453285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695dd7b-230b-417b-92da-aab5d316af28 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:28.464195 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695dd7b-230b-417b-92da-aab5d316af28 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:28.524934 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6419417-9f6b-4c22-ac9a-f769a9da7b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:28.525639 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6419417-9f6b-4c22-ac9a-f769a9da7b92 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:28.525929 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6419417-9f6b-4c22-ac9a-f769a9da7b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:28.526206 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6419417-9f6b-4c22-ac9a-f769a9da7b92 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:28.526894 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6419417-9f6b-4c22-ac9a-f769a9da7b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:28.528798 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6419417-9f6b-4c22-ac9a-f769a9da7b92 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:28.547905 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1386/2800] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:25:28 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:28.552507 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30621581-7ae2-487e-ab90-cb6da87f92c6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:28.562616 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30621581-7ae2-487e-ab90-cb6da87f92c6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:28.567186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e63636-f126-48de-b4a2-ce3d6d5e326d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:28.567830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e63636-f126-48de-b4a2-ce3d6d5e326d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:28.568111 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e63636-f126-48de-b4a2-ce3d6d5e326d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:28.568382 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e63636-f126-48de-b4a2-ce3d6d5e326d admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:28.569094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e63636-f126-48de-b4a2-ce3d6d5e326d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:28.570711 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e63636-f126-48de-b4a2-ce3d6d5e326d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:28.580932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1415/2801] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:28.584919 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6419417-9f6b-4c22-ac9a-f769a9da7b92 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:28.594758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6419417-9f6b-4c22-ac9a-f769a9da7b92 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:28.599968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a444ac9-8108-4da5-ab3e-007d65950987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:28.600776 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a444ac9-8108-4da5-ab3e-007d65950987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:28.601054 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a444ac9-8108-4da5-ab3e-007d65950987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:28.601328 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a444ac9-8108-4da5-ab3e-007d65950987 admin admin] PATH_INFO: `/v3/projects/9bc72c9665d045e991b80f72180c1363/users/8dac518bb14644c5b15a29018601235a/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:28.616383 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a444ac9-8108-4da5-ab3e-007d65950987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc72c9665d045e991b80f72180c1363, user_id=8dac518bb14644c5b15a29018601235a, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:28.619052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a444ac9-8108-4da5-ab3e-007d65950987 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:28.632487 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1387/2802] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:28 2022] PUT /identity/v3/projects/9bc72c9665d045e991b80f72180c1363/users/8dac518bb14644c5b15a29018601235a/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:28.636533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e63636-f126-48de-b4a2-ce3d6d5e326d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:28.647193 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e63636-f126-48de-b4a2-ce3d6d5e326d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:28.666834 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:28.703566 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fccb0-945f-4934-990c-50a8c01286a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:28.704272 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fccb0-945f-4934-990c-50a8c01286a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:28.704562 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fccb0-945f-4934-990c-50a8c01286a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:28.704843 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fccb0-945f-4934-990c-50a8c01286a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:28.706211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fccb0-945f-4934-990c-50a8c01286a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:28.707811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fccb0-945f-4934-990c-50a8c01286a0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:28.717403 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1416/2803] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:28.721760 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a444ac9-8108-4da5-ab3e-007d65950987 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:28.727148 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:28.733793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a444ac9-8108-4da5-ab3e-007d65950987 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:28.741488 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218f4c2-bead-4de5-be06-50b1fbf5ad35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:28.742553 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218f4c2-bead-4de5-be06-50b1fbf5ad35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:28.742903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218f4c2-bead-4de5-be06-50b1fbf5ad35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:28.743247 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218f4c2-bead-4de5-be06-50b1fbf5ad35 admin admin] PATH_INFO: `/v3/projects/9bc72c9665d045e991b80f72180c1363/users/8dac518bb14644c5b15a29018601235a/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:28.745477 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218f4c2-bead-4de5-be06-50b1fbf5ad35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc72c9665d045e991b80f72180c1363, user_id=8dac518bb14644c5b15a29018601235a, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:28.748108 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218f4c2-bead-4de5-be06-50b1fbf5ad35 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:28.759096 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1388/2804] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:28 2022] PUT /identity/v3/projects/9bc72c9665d045e991b80f72180c1363/users/8dac518bb14644c5b15a29018601235a/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:28.770577 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33740615-9c3f-4771-b177-2180de4e0be9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:28.771047 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33740615-9c3f-4771-b177-2180de4e0be9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:28.771166 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33740615-9c3f-4771-b177-2180de4e0be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:28.797488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-33740615-9c3f-4771-b177-2180de4e0be9 None None] MFA Rules not processed for user `8dac518bb14644c5b15a29018601235a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:28.798743 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-33740615-9c3f-4771-b177-2180de4e0be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:28.868190 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1417/2805] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:28.879784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218f4c2-bead-4de5-be06-50b1fbf5ad35 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:28.881630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5218f4c2-bead-4de5-be06-50b1fbf5ad35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:28.937078 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218f4c2-bead-4de5-be06-50b1fbf5ad35 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:28.941265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1251deb-2480-4cf2-bf19-6ceee063fddb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:28.941922 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1251deb-2480-4cf2-bf19-6ceee063fddb service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:28.942203 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1251deb-2480-4cf2-bf19-6ceee063fddb service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:28.942479 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1251deb-2480-4cf2-bf19-6ceee063fddb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:28.951227 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1251deb-2480-4cf2-bf19-6ceee063fddb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:28.952646 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1251deb-2480-4cf2-bf19-6ceee063fddb service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:28.961898 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1389/2806] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:25:28.989514 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33740615-9c3f-4771-b177-2180de4e0be9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:29.051271 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33740615-9c3f-4771-b177-2180de4e0be9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:29.055769 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb056e3-7946-4d8d-9eea-4e51ac2a49a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:29.056658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb056e3-7946-4d8d-9eea-4e51ac2a49a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:29.056938 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb056e3-7946-4d8d-9eea-4e51ac2a49a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:29.057211 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb056e3-7946-4d8d-9eea-4e51ac2a49a9 admin admin] PATH_INFO: `/v3/users/b31c75dd8e7744e0b5b38322d95c008c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:29.058414 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb056e3-7946-4d8d-9eea-4e51ac2a49a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b31c75dd8e7744e0b5b38322d95c008c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:29.060346 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb056e3-7946-4d8d-9eea-4e51ac2a49a9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:29.107941 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-afb056e3-7946-4d8d-9eea-4e51ac2a49a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b31c75dd8e7744e0b5b38322d95c008c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:29.109026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:29.120901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-afb056e3-7946-4d8d-9eea-4e51ac2a49a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b31c75dd8e7744e0b5b38322d95c008c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:29.121560 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-afb056e3-7946-4d8d-9eea-4e51ac2a49a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b31c75dd8e7744e0b5b38322d95c008c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:29.122191 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-afb056e3-7946-4d8d-9eea-4e51ac2a49a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b31c75dd8e7744e0b5b38322d95c008c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:29.128898 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-afb056e3-7946-4d8d-9eea-4e51ac2a49a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b31c75dd8e7744e0b5b38322d95c008c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:29.140876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1418/2807] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:25:28 2022] DELETE /identity/v3/users/b31c75dd8e7744e0b5b38322d95c008c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:29.145924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173b87e-dfb5-4b0e-b00c-3a5f3676af6f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:29.146220 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173b87e-dfb5-4b0e-b00c-3a5f3676af6f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:29.146496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173b87e-dfb5-4b0e-b00c-3a5f3676af6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:29.165243 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2173b87e-dfb5-4b0e-b00c-3a5f3676af6f None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:29.166443 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2173b87e-dfb5-4b0e-b00c-3a5f3676af6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:29.224394 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1390/2808] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:29.233949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb056e3-7946-4d8d-9eea-4e51ac2a49a9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:29.235328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-afb056e3-7946-4d8d-9eea-4e51ac2a49a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:29.296928 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb056e3-7946-4d8d-9eea-4e51ac2a49a9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:29.301192 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4b119-bd3d-44eb-8e33-88f86b303db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:29.301861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4b119-bd3d-44eb-8e33-88f86b303db3 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:29.302143 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4b119-bd3d-44eb-8e33-88f86b303db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:29.302416 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4b119-bd3d-44eb-8e33-88f86b303db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:29.311309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4b119-bd3d-44eb-8e33-88f86b303db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:29.312767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4b119-bd3d-44eb-8e33-88f86b303db3 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:29.322063 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1419/2809] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:25:29.576609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173b87e-dfb5-4b0e-b00c-3a5f3676af6f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:29.578093 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2173b87e-dfb5-4b0e-b00c-3a5f3676af6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:29.590352 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173b87e-dfb5-4b0e-b00c-3a5f3676af6f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:29.595242 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:29.596145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:29.596426 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:29.596701 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d admin admin] PATH_INFO: `/v3/projects/6f18f4ed0fc44f83bb2511ab5ac07e62` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:29.598404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f18f4ed0fc44f83bb2511ab5ac07e62)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:29.600289 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:29.647143 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f18f4ed0fc44f83bb2511ab5ac07e62', 'request_id': 'req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:29.653455 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f18f4ed0fc44f83bb2511ab5ac07e62', 'request_id': 'req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:29.659046 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f18f4ed0fc44f83bb2511ab5ac07e62', 'request_id': 'req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:29.671576 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d admin admin] The token cache is being invalidate because project 6f18f4ed0fc44f83bb2511ab5ac07e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:25:29.671863 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:29.672487 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:29.674046 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1391/2810] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:25:29 2022] DELETE /identity/v3/projects/6f18f4ed0fc44f83bb2511ab5ac07e62 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:29.677995 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4b119-bd3d-44eb-8e33-88f86b303db3 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:29.687740 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4b119-bd3d-44eb-8e33-88f86b303db3 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:29.742354 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932f162-2da2-4705-9eec-09e11c212e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:29.743205 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932f162-2da2-4705-9eec-09e11c212e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:29.743483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932f162-2da2-4705-9eec-09e11c212e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:29.743754 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932f162-2da2-4705-9eec-09e11c212e58 admin admin] PATH_INFO: `/v3/users/8dac518bb14644c5b15a29018601235a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:29.744900 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932f162-2da2-4705-9eec-09e11c212e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dac518bb14644c5b15a29018601235a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:29.746826 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932f162-2da2-4705-9eec-09e11c212e58 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:29.790952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9932f162-2da2-4705-9eec-09e11c212e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dac518bb14644c5b15a29018601235a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:29.802607 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9932f162-2da2-4705-9eec-09e11c212e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dac518bb14644c5b15a29018601235a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:29.803248 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9932f162-2da2-4705-9eec-09e11c212e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dac518bb14644c5b15a29018601235a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:29.803834 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9932f162-2da2-4705-9eec-09e11c212e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dac518bb14644c5b15a29018601235a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:29.807316 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:29.812076 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9932f162-2da2-4705-9eec-09e11c212e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dac518bb14644c5b15a29018601235a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:29.826100 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1420/2811] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:25:29 2022] DELETE /identity/v3/users/8dac518bb14644c5b15a29018601235a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:30.090385 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:30.091913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:30.105665 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f43f1-c674-4c4e-90b4-55d4bfda7d1d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:30.118585 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:30.164526 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb8e91-b3a0-41e1-b502-118b9a0deb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:30.165384 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb8e91-b3a0-41e1-b502-118b9a0deb0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:30.165680 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb8e91-b3a0-41e1-b502-118b9a0deb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:30.165955 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb8e91-b3a0-41e1-b502-118b9a0deb0e admin admin] PATH_INFO: `/v3/projects/9bc72c9665d045e991b80f72180c1363` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:30.167107 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb8e91-b3a0-41e1-b502-118b9a0deb0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc72c9665d045e991b80f72180c1363)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:30.169043 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb8e91-b3a0-41e1-b502-118b9a0deb0e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:30.214835 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ddcb8e91-b3a0-41e1-b502-118b9a0deb0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc72c9665d045e991b80f72180c1363', 'request_id': 'req-ddcb8e91-b3a0-41e1-b502-118b9a0deb0e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:30.220952 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ddcb8e91-b3a0-41e1-b502-118b9a0deb0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc72c9665d045e991b80f72180c1363', 'request_id': 'req-ddcb8e91-b3a0-41e1-b502-118b9a0deb0e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:30.226570 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ddcb8e91-b3a0-41e1-b502-118b9a0deb0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc72c9665d045e991b80f72180c1363', 'request_id': 'req-ddcb8e91-b3a0-41e1-b502-118b9a0deb0e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:30.238278 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ddcb8e91-b3a0-41e1-b502-118b9a0deb0e admin admin] The token cache is being invalidate because project 9bc72c9665d045e991b80f72180c1363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:25:30.238566 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ddcb8e91-b3a0-41e1-b502-118b9a0deb0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:30.239202 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ddcb8e91-b3a0-41e1-b502-118b9a0deb0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:30.240720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1392/2812] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:25:30 2022] DELETE /identity/v3/projects/9bc72c9665d045e991b80f72180c1363 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:30.245551 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003160ff-f29c-4fb9-bcad-2485ad2660b5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:30.245838 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003160ff-f29c-4fb9-bcad-2485ad2660b5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:30.246111 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003160ff-f29c-4fb9-bcad-2485ad2660b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:30.263679 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-003160ff-f29c-4fb9-bcad-2485ad2660b5 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:30.264865 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-003160ff-f29c-4fb9-bcad-2485ad2660b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:30.322703 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1421/2813] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:30.330844 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b86b1d-73dc-4a0a-8576-ab7545fe1fc3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:30.331129 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b86b1d-73dc-4a0a-8576-ab7545fe1fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:30.331404 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b86b1d-73dc-4a0a-8576-ab7545fe1fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:30.349802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d8b86b1d-73dc-4a0a-8576-ab7545fe1fc3 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:30.351000 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d8b86b1d-73dc-4a0a-8576-ab7545fe1fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:30.359765 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1393/2814] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:25:30.364709 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003160ff-f29c-4fb9-bcad-2485ad2660b5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:30.375483 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003160ff-f29c-4fb9-bcad-2485ad2660b5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:30.380794 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb64230-9ce5-4245-b7d0-f6a84475d66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:30.381484 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb64230-9ce5-4245-b7d0-f6a84475d66f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:30.381767 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb64230-9ce5-4245-b7d0-f6a84475d66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:30.382041 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb64230-9ce5-4245-b7d0-f6a84475d66f admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:30.382763 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb64230-9ce5-4245-b7d0-f6a84475d66f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:25:30.383073 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb64230-9ce5-4245-b7d0-f6a84475d66f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:30.384661 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb64230-9ce5-4245-b7d0-f6a84475d66f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:30.396513 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1422/2815] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:25:30.401170 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b86b1d-73dc-4a0a-8576-ab7545fe1fc3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:30.410289 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b86b1d-73dc-4a0a-8576-ab7545fe1fc3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:30.414828 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac8803-cf9c-4bed-9924-d19f530e9dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:30.415468 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac8803-cf9c-4bed-9924-d19f530e9dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:30.415748 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac8803-cf9c-4bed-9924-d19f530e9dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:30.416021 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac8803-cf9c-4bed-9924-d19f530e9dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:30.416700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac8803-cf9c-4bed-9924-d19f530e9dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:30.418624 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac8803-cf9c-4bed-9924-d19f530e9dd0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:30.444258 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1394/2816] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:25:30 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:30.448218 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb64230-9ce5-4245-b7d0-f6a84475d66f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:30.458454 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb64230-9ce5-4245-b7d0-f6a84475d66f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:30.513278 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ca685-ae3a-474e-acea-3642d1ea3bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:30.513964 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ca685-ae3a-474e-acea-3642d1ea3bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:30.514249 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ca685-ae3a-474e-acea-3642d1ea3bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:30.514530 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ca685-ae3a-474e-acea-3642d1ea3bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:30.515201 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ca685-ae3a-474e-acea-3642d1ea3bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:30.517413 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ca685-ae3a-474e-acea-3642d1ea3bf8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:30.537144 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1423/2817] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:25:30 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:30.541173 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac8803-cf9c-4bed-9924-d19f530e9dd0 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:30.551942 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac8803-cf9c-4bed-9924-d19f530e9dd0 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:30.556582 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dedcd-12a8-487b-945e-8f59dd025e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:30.557231 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dedcd-12a8-487b-945e-8f59dd025e5c admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:30.557559 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dedcd-12a8-487b-945e-8f59dd025e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:30.557838 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dedcd-12a8-487b-945e-8f59dd025e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:30.558555 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2dedcd-12a8-487b-945e-8f59dd025e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:30.560132 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2dedcd-12a8-487b-945e-8f59dd025e5c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:30.570830 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1395/2818] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:30.574511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ca685-ae3a-474e-acea-3642d1ea3bf8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:30.584420 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ca685-ae3a-474e-acea-3642d1ea3bf8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:30.588969 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a5d8f-5c64-45c0-b319-992c2ea3b67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:30.589639 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a5d8f-5c64-45c0-b319-992c2ea3b67e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:30.589925 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a5d8f-5c64-45c0-b319-992c2ea3b67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:30.590201 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a5d8f-5c64-45c0-b319-992c2ea3b67e admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:30.590954 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a5d8f-5c64-45c0-b319-992c2ea3b67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:30.592529 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a5d8f-5c64-45c0-b319-992c2ea3b67e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:30.602203 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1424/2819] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:30.606135 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dedcd-12a8-487b-945e-8f59dd025e5c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:30.616314 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dedcd-12a8-487b-945e-8f59dd025e5c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:30.620865 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c6571-15e5-4f55-9056-a84bebe8167b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:30.621759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c6571-15e5-4f55-9056-a84bebe8167b admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:30.622037 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c6571-15e5-4f55-9056-a84bebe8167b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:30.622338 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c6571-15e5-4f55-9056-a84bebe8167b admin admin] PATH_INFO: `/v3/projects/c1c01c177a564b519df3f7b5bfe328dc/users/8dcc83e3a4c04417a604c84a0a036f33/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:30.638703 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c6571-15e5-4f55-9056-a84bebe8167b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c01c177a564b519df3f7b5bfe328dc, user_id=8dcc83e3a4c04417a604c84a0a036f33, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:30.641309 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c6571-15e5-4f55-9056-a84bebe8167b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:30.654280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1396/2820] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:30 2022] PUT /identity/v3/projects/c1c01c177a564b519df3f7b5bfe328dc/users/8dcc83e3a4c04417a604c84a0a036f33/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:25:30.664553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453b0e8-4482-4bde-8eb3-e492ff1bd4d1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:30.664845 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453b0e8-4482-4bde-8eb3-e492ff1bd4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:30.665126 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453b0e8-4482-4bde-8eb3-e492ff1bd4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:30.692075 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2453b0e8-4482-4bde-8eb3-e492ff1bd4d1 None None] MFA Rules not processed for user `8dcc83e3a4c04417a604c84a0a036f33`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:30.693293 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2453b0e8-4482-4bde-8eb3-e492ff1bd4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:30.733486 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:30.757008 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1425/2821] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:30.761433 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c6571-15e5-4f55-9056-a84bebe8167b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:30.805205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:30.823332 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c6571-15e5-4f55-9056-a84bebe8167b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:30.827995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aa320-02e0-4524-a2b5-3237892d2999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:30.828642 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aa320-02e0-4524-a2b5-3237892d2999 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:30.828918 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aa320-02e0-4524-a2b5-3237892d2999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:30.829191 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aa320-02e0-4524-a2b5-3237892d2999 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:30.829907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3aa320-02e0-4524-a2b5-3237892d2999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:30.831832 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3aa320-02e0-4524-a2b5-3237892d2999 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:30.856023 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1397/2822] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:25:30 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:30.859952 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453b0e8-4482-4bde-8eb3-e492ff1bd4d1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:30.871184 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453b0e8-4482-4bde-8eb3-e492ff1bd4d1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:30.925489 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2b781-caf9-4e05-a5da-605812b77256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:30.926751 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2b781-caf9-4e05-a5da-605812b77256 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:30.927032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2b781-caf9-4e05-a5da-605812b77256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:30.927309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2b781-caf9-4e05-a5da-605812b77256 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:30.927995 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2b781-caf9-4e05-a5da-605812b77256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:30.929934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2b781-caf9-4e05-a5da-605812b77256 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:30.948890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1426/2823] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:25:30 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:30.952968 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aa320-02e0-4524-a2b5-3237892d2999 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:30.963029 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aa320-02e0-4524-a2b5-3237892d2999 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:30.967605 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca3384-9556-49ab-aa1a-bb884adeb5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:30.968246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3384-9556-49ab-aa1a-bb884adeb5db admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:30.968521 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3384-9556-49ab-aa1a-bb884adeb5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:30.968793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3384-9556-49ab-aa1a-bb884adeb5db admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:30.969545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca3384-9556-49ab-aa1a-bb884adeb5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:30.971142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca3384-9556-49ab-aa1a-bb884adeb5db admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:30.981746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1398/2824] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:30.985429 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2b781-caf9-4e05-a5da-605812b77256 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:30.995739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2b781-caf9-4e05-a5da-605812b77256 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:31.000253 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0601831-72d3-4667-a762-cc2bd87dafbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:31.000892 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0601831-72d3-4667-a762-cc2bd87dafbf admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:31.001176 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0601831-72d3-4667-a762-cc2bd87dafbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:31.001492 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0601831-72d3-4667-a762-cc2bd87dafbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:31.002215 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0601831-72d3-4667-a762-cc2bd87dafbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:31.003835 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0601831-72d3-4667-a762-cc2bd87dafbf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:31.013583 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1427/2825] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:31.017264 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca3384-9556-49ab-aa1a-bb884adeb5db admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:31.027067 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca3384-9556-49ab-aa1a-bb884adeb5db admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:31.031587 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ffc17-2bfb-44b5-8ec9-1d34fd037efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:31.032465 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ffc17-2bfb-44b5-8ec9-1d34fd037efa admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:31.032744 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ffc17-2bfb-44b5-8ec9-1d34fd037efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:31.033016 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ffc17-2bfb-44b5-8ec9-1d34fd037efa admin admin] PATH_INFO: `/v3/projects/205108f3f4cf4b6da7f1b8251814fe6e/users/82dc44ee728b4afb8bf1347db8b4f151/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:31.047781 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ffc17-2bfb-44b5-8ec9-1d34fd037efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=205108f3f4cf4b6da7f1b8251814fe6e, user_id=82dc44ee728b4afb8bf1347db8b4f151, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:31.050423 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ffc17-2bfb-44b5-8ec9-1d34fd037efa admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:31.062867 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1399/2826] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:31 2022] PUT /identity/v3/projects/205108f3f4cf4b6da7f1b8251814fe6e/users/82dc44ee728b4afb8bf1347db8b4f151/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:25:31.124494 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327871a2-6c81-4ec7-b927-a96513b982dd None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:31.124790 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327871a2-6c81-4ec7-b927-a96513b982dd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:31.125098 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327871a2-6c81-4ec7-b927-a96513b982dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:31.155251 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-327871a2-6c81-4ec7-b927-a96513b982dd None None] MFA Rules not processed for user `82dc44ee728b4afb8bf1347db8b4f151`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:31.156479 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-327871a2-6c81-4ec7-b927-a96513b982dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:31.219698 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1428/2827] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:31.224783 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ffc17-2bfb-44b5-8ec9-1d34fd037efa admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:31.283650 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ffc17-2bfb-44b5-8ec9-1d34fd037efa admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:31.288752 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921285d-808b-45af-9039-207cf2d52cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:31.289417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921285d-808b-45af-9039-207cf2d52cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:31.289701 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921285d-808b-45af-9039-207cf2d52cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:31.289976 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921285d-808b-45af-9039-207cf2d52cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:31.290640 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921285d-808b-45af-9039-207cf2d52cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:31.292523 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921285d-808b-45af-9039-207cf2d52cd9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:31.316653 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1400/2828] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:25:31 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:31.320730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327871a2-6c81-4ec7-b927-a96513b982dd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:31.331777 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327871a2-6c81-4ec7-b927-a96513b982dd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:31.377616 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:31.387686 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65379d7-bdb3-4522-9475-6da0050380c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:31.388338 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65379d7-bdb3-4522-9475-6da0050380c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:31.388620 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65379d7-bdb3-4522-9475-6da0050380c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:31.388894 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65379d7-bdb3-4522-9475-6da0050380c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:31.389608 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65379d7-bdb3-4522-9475-6da0050380c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:31.391505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65379d7-bdb3-4522-9475-6da0050380c1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:31.415780 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1429/2829] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:25:31 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:31.419580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921285d-808b-45af-9039-207cf2d52cd9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:31.429879 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921285d-808b-45af-9039-207cf2d52cd9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:31.434440 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a82906-b805-43c5-8a05-f0c6e39765fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:31.435085 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a82906-b805-43c5-8a05-f0c6e39765fd admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:31.435365 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a82906-b805-43c5-8a05-f0c6e39765fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:31.435636 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a82906-b805-43c5-8a05-f0c6e39765fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:31.436372 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a82906-b805-43c5-8a05-f0c6e39765fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:31.437982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a82906-b805-43c5-8a05-f0c6e39765fd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:31.448246 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1401/2830] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:31.452592 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65379d7-bdb3-4522-9475-6da0050380c1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:31.463227 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65379d7-bdb3-4522-9475-6da0050380c1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:31.468118 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a003e-e4f6-40a7-ac64-126c2939c996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:31.469023 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a003e-e4f6-40a7-ac64-126c2939c996 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:31.469309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a003e-e4f6-40a7-ac64-126c2939c996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:31.469616 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a003e-e4f6-40a7-ac64-126c2939c996 admin admin] PATH_INFO: `/v3/projects/3525517119eb41588a9c556b4591b7b5/users/d16b8c4c0ea8445e92cc95cd649a6d6c/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:31.484653 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a003e-e4f6-40a7-ac64-126c2939c996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3525517119eb41588a9c556b4591b7b5, user_id=d16b8c4c0ea8445e92cc95cd649a6d6c, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:31.487334 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a003e-e4f6-40a7-ac64-126c2939c996 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:31.499840 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1430/2831] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:31 2022] PUT /identity/v3/projects/3525517119eb41588a9c556b4591b7b5/users/d16b8c4c0ea8445e92cc95cd649a6d6c/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:31.504267 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a82906-b805-43c5-8a05-f0c6e39765fd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:31.514575 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a82906-b805-43c5-8a05-f0c6e39765fd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:31.570189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b72544-996e-465b-bcc6-598736fc042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:31.570848 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b72544-996e-465b-bcc6-598736fc042c admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:31.571160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b72544-996e-465b-bcc6-598736fc042c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:31.571438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b72544-996e-465b-bcc6-598736fc042c admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:31.572156 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b72544-996e-465b-bcc6-598736fc042c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:31.573793 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b72544-996e-465b-bcc6-598736fc042c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:31.583874 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1402/2832] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:31.587976 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a003e-e4f6-40a7-ac64-126c2939c996 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:31.598328 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a003e-e4f6-40a7-ac64-126c2939c996 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:31.602939 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec446473-4d70-47cc-869d-dff60ae9628b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:31.603811 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec446473-4d70-47cc-869d-dff60ae9628b admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:31.604093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec446473-4d70-47cc-869d-dff60ae9628b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:31.604365 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec446473-4d70-47cc-869d-dff60ae9628b admin admin] PATH_INFO: `/v3/projects/3525517119eb41588a9c556b4591b7b5/users/d16b8c4c0ea8445e92cc95cd649a6d6c/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:31.606451 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec446473-4d70-47cc-869d-dff60ae9628b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3525517119eb41588a9c556b4591b7b5, user_id=d16b8c4c0ea8445e92cc95cd649a6d6c, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:31.609162 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec446473-4d70-47cc-869d-dff60ae9628b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:31.619286 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1431/2833] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:31 2022] PUT /identity/v3/projects/3525517119eb41588a9c556b4591b7b5/users/d16b8c4c0ea8445e92cc95cd649a6d6c/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:31.629619 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b51510-26b0-4dd3-bf8c-ef7f206e5cf8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:31.629904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b51510-26b0-4dd3-bf8c-ef7f206e5cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:31.630178 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b51510-26b0-4dd3-bf8c-ef7f206e5cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:31.635905 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:31.663064 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-96b51510-26b0-4dd3-bf8c-ef7f206e5cf8 None None] MFA Rules not processed for user `d16b8c4c0ea8445e92cc95cd649a6d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:31.664273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-96b51510-26b0-4dd3-bf8c-ef7f206e5cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:31.729802 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1403/2834] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:31.741406 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec446473-4d70-47cc-869d-dff60ae9628b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:31.743091 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ec446473-4d70-47cc-869d-dff60ae9628b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:31.801294 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec446473-4d70-47cc-869d-dff60ae9628b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:31.804920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913d0de-3757-43d5-b2f5-a0f40ea1d6af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:31.805593 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913d0de-3757-43d5-b2f5-a0f40ea1d6af service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:31.805875 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913d0de-3757-43d5-b2f5-a0f40ea1d6af service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:31.806159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913d0de-3757-43d5-b2f5-a0f40ea1d6af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:31.815215 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913d0de-3757-43d5-b2f5-a0f40ea1d6af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:31.817223 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913d0de-3757-43d5-b2f5-a0f40ea1d6af service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:31.826676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1432/2835] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:25:31.865581 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b51510-26b0-4dd3-bf8c-ef7f206e5cf8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:31.866957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-96b51510-26b0-4dd3-bf8c-ef7f206e5cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:31.879435 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b51510-26b0-4dd3-bf8c-ef7f206e5cf8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:31.883025 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be1aed-112f-4c3c-b0cc-c7066fb40fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:31.883664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1aed-112f-4c3c-b0cc-c7066fb40fbc service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:31.883929 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1aed-112f-4c3c-b0cc-c7066fb40fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:31.884207 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1aed-112f-4c3c-b0cc-c7066fb40fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:31.938689 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be1aed-112f-4c3c-b0cc-c7066fb40fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:31.940141 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be1aed-112f-4c3c-b0cc-c7066fb40fbc service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:31.949750 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1404/2836] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:25:34.794198 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913d0de-3757-43d5-b2f5-a0f40ea1d6af service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:34.855137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913d0de-3757-43d5-b2f5-a0f40ea1d6af service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:34.859619 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f4a3e-6f18-4e74-a689-40ac0908bceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:34.860472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f4a3e-6f18-4e74-a689-40ac0908bceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:34.860758 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f4a3e-6f18-4e74-a689-40ac0908bceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:34.861032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f4a3e-6f18-4e74-a689-40ac0908bceb admin admin] PATH_INFO: `/v3/users/8dcc83e3a4c04417a604c84a0a036f33` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:34.862224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f4a3e-6f18-4e74-a689-40ac0908bceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dcc83e3a4c04417a604c84a0a036f33)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:34.864617 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f4a3e-6f18-4e74-a689-40ac0908bceb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:34.909475 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e6f4a3e-6f18-4e74-a689-40ac0908bceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dcc83e3a4c04417a604c84a0a036f33'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:34.910541 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:34.923355 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e6f4a3e-6f18-4e74-a689-40ac0908bceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dcc83e3a4c04417a604c84a0a036f33'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:34.924015 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e6f4a3e-6f18-4e74-a689-40ac0908bceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dcc83e3a4c04417a604c84a0a036f33'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:34.924614 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e6f4a3e-6f18-4e74-a689-40ac0908bceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dcc83e3a4c04417a604c84a0a036f33'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:34.932244 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e6f4a3e-6f18-4e74-a689-40ac0908bceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dcc83e3a4c04417a604c84a0a036f33'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:34.945062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1433/2837] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:25:34 2022] DELETE /identity/v3/users/8dcc83e3a4c04417a604c84a0a036f33 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:34.949694 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972704ee-abd5-403f-b25d-f5f92152ef89 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:34.950176 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972704ee-abd5-403f-b25d-f5f92152ef89 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:34.950289 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972704ee-abd5-403f-b25d-f5f92152ef89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:34.966961 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-972704ee-abd5-403f-b25d-f5f92152ef89 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:34.968146 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-972704ee-abd5-403f-b25d-f5f92152ef89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:35.025753 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1405/2838] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:35.035330 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f4a3e-6f18-4e74-a689-40ac0908bceb admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:35.036876 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3e6f4a3e-6f18-4e74-a689-40ac0908bceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:35.094347 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f4a3e-6f18-4e74-a689-40ac0908bceb admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:35.098317 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16974e09-0da0-4e2b-a6f9-af0530540191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:35.098957 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16974e09-0da0-4e2b-a6f9-af0530540191 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:35.099244 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16974e09-0da0-4e2b-a6f9-af0530540191 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:35.099532 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16974e09-0da0-4e2b-a6f9-af0530540191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:35.110744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16974e09-0da0-4e2b-a6f9-af0530540191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:35.112447 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16974e09-0da0-4e2b-a6f9-af0530540191 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:35.122471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1434/2839] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:25:35.392982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972704ee-abd5-403f-b25d-f5f92152ef89 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:35.394576 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-972704ee-abd5-403f-b25d-f5f92152ef89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:35.410696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972704ee-abd5-403f-b25d-f5f92152ef89 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:35.415438 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07fc94-f1dd-4c46-9c0c-336276d2143a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:35.416362 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07fc94-f1dd-4c46-9c0c-336276d2143a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:35.416659 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07fc94-f1dd-4c46-9c0c-336276d2143a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:35.416908 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07fc94-f1dd-4c46-9c0c-336276d2143a admin admin] PATH_INFO: `/v3/projects/c1c01c177a564b519df3f7b5bfe328dc` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:35.418100 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07fc94-f1dd-4c46-9c0c-336276d2143a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c01c177a564b519df3f7b5bfe328dc)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:35.420163 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07fc94-f1dd-4c46-9c0c-336276d2143a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:35.443709 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:35.465657 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5c07fc94-f1dd-4c46-9c0c-336276d2143a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c01c177a564b519df3f7b5bfe328dc', 'request_id': 'req-5c07fc94-f1dd-4c46-9c0c-336276d2143a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:35.471688 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5c07fc94-f1dd-4c46-9c0c-336276d2143a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c01c177a564b519df3f7b5bfe328dc', 'request_id': 'req-5c07fc94-f1dd-4c46-9c0c-336276d2143a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:35.477584 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5c07fc94-f1dd-4c46-9c0c-336276d2143a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c01c177a564b519df3f7b5bfe328dc', 'request_id': 'req-5c07fc94-f1dd-4c46-9c0c-336276d2143a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:35.489982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5c07fc94-f1dd-4c46-9c0c-336276d2143a admin admin] The token cache is being invalidate because project c1c01c177a564b519df3f7b5bfe328dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:25:35.490272 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5c07fc94-f1dd-4c46-9c0c-336276d2143a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:35.490950 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5c07fc94-f1dd-4c46-9c0c-336276d2143a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:35.492558 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1406/2840] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:25:35 2022] DELETE /identity/v3/projects/c1c01c177a564b519df3f7b5bfe328dc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:35.496623 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16974e09-0da0-4e2b-a6f9-af0530540191 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:35.506224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16974e09-0da0-4e2b-a6f9-af0530540191 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:35.562102 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b0d86-af14-4902-9895-69cfe3350c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:35.562962 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b0d86-af14-4902-9895-69cfe3350c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:35.563241 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b0d86-af14-4902-9895-69cfe3350c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:35.563516 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b0d86-af14-4902-9895-69cfe3350c2d admin admin] PATH_INFO: `/v3/users/82dc44ee728b4afb8bf1347db8b4f151` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:35.564715 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b0d86-af14-4902-9895-69cfe3350c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=82dc44ee728b4afb8bf1347db8b4f151)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:35.566655 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b0d86-af14-4902-9895-69cfe3350c2d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:35.610810 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f3b0d86-af14-4902-9895-69cfe3350c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82dc44ee728b4afb8bf1347db8b4f151'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:35.622934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f3b0d86-af14-4902-9895-69cfe3350c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82dc44ee728b4afb8bf1347db8b4f151'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:35.623592 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f3b0d86-af14-4902-9895-69cfe3350c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82dc44ee728b4afb8bf1347db8b4f151'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:35.624201 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f3b0d86-af14-4902-9895-69cfe3350c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82dc44ee728b4afb8bf1347db8b4f151'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:35.627918 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:35.632042 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f3b0d86-af14-4902-9895-69cfe3350c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82dc44ee728b4afb8bf1347db8b4f151'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:35.646203 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1435/2841] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:25:35 2022] DELETE /identity/v3/users/82dc44ee728b4afb8bf1347db8b4f151 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:35.910745 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07fc94-f1dd-4c46-9c0c-336276d2143a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:35.912251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5c07fc94-f1dd-4c46-9c0c-336276d2143a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:35.925816 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07fc94-f1dd-4c46-9c0c-336276d2143a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:35.983904 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b022494-7c84-4d82-bf99-df629077d931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:35.984757 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b022494-7c84-4d82-bf99-df629077d931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:35.985042 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b022494-7c84-4d82-bf99-df629077d931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:35.985318 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b022494-7c84-4d82-bf99-df629077d931 admin admin] PATH_INFO: `/v3/projects/205108f3f4cf4b6da7f1b8251814fe6e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:35.986513 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b022494-7c84-4d82-bf99-df629077d931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=205108f3f4cf4b6da7f1b8251814fe6e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:35.988449 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b022494-7c84-4d82-bf99-df629077d931 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:36.039220 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8b022494-7c84-4d82-bf99-df629077d931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '205108f3f4cf4b6da7f1b8251814fe6e', 'request_id': 'req-8b022494-7c84-4d82-bf99-df629077d931'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:36.045422 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8b022494-7c84-4d82-bf99-df629077d931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '205108f3f4cf4b6da7f1b8251814fe6e', 'request_id': 'req-8b022494-7c84-4d82-bf99-df629077d931'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:36.050775 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8b022494-7c84-4d82-bf99-df629077d931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '205108f3f4cf4b6da7f1b8251814fe6e', 'request_id': 'req-8b022494-7c84-4d82-bf99-df629077d931'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:36.062859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8b022494-7c84-4d82-bf99-df629077d931 admin admin] The token cache is being invalidate because project 205108f3f4cf4b6da7f1b8251814fe6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:25:36.063145 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8b022494-7c84-4d82-bf99-df629077d931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:36.063758 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8b022494-7c84-4d82-bf99-df629077d931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:36.065294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1407/2842] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:25:35 2022] DELETE /identity/v3/projects/205108f3f4cf4b6da7f1b8251814fe6e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:36.069847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b0d86-af14-4902-9895-69cfe3350c2d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:36.071519 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2f3b0d86-af14-4902-9895-69cfe3350c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:36.084550 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b0d86-af14-4902-9895-69cfe3350c2d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:36.140597 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ecfdb-6db4-4e00-a1ce-081d0cf244cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:36.141497 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ecfdb-6db4-4e00-a1ce-081d0cf244cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:36.141783 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ecfdb-6db4-4e00-a1ce-081d0cf244cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:36.142060 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ecfdb-6db4-4e00-a1ce-081d0cf244cd admin admin] PATH_INFO: `/v3/users/d16b8c4c0ea8445e92cc95cd649a6d6c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:36.143233 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ecfdb-6db4-4e00-a1ce-081d0cf244cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d16b8c4c0ea8445e92cc95cd649a6d6c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:36.145866 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ecfdb-6db4-4e00-a1ce-081d0cf244cd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:36.190803 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd2ecfdb-6db4-4e00-a1ce-081d0cf244cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd16b8c4c0ea8445e92cc95cd649a6d6c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:36.203113 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd2ecfdb-6db4-4e00-a1ce-081d0cf244cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd16b8c4c0ea8445e92cc95cd649a6d6c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:36.203787 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd2ecfdb-6db4-4e00-a1ce-081d0cf244cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd16b8c4c0ea8445e92cc95cd649a6d6c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:36.204385 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd2ecfdb-6db4-4e00-a1ce-081d0cf244cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd16b8c4c0ea8445e92cc95cd649a6d6c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:36.213377 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd2ecfdb-6db4-4e00-a1ce-081d0cf244cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd16b8c4c0ea8445e92cc95cd649a6d6c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:36.225609 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1436/2843] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:25:36 2022] DELETE /identity/v3/users/d16b8c4c0ea8445e92cc95cd649a6d6c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:36.494229 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b022494-7c84-4d82-bf99-df629077d931 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:36.495719 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8b022494-7c84-4d82-bf99-df629077d931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:36.508972 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b022494-7c84-4d82-bf99-df629077d931 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:36.547494 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:36.567876 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71175a-423b-4852-9106-1b4b1a76dbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:36.568764 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71175a-423b-4852-9106-1b4b1a76dbf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:36.569049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71175a-423b-4852-9106-1b4b1a76dbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:36.569327 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71175a-423b-4852-9106-1b4b1a76dbf1 admin admin] PATH_INFO: `/v3/projects/3525517119eb41588a9c556b4591b7b5` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:36.570533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71175a-423b-4852-9106-1b4b1a76dbf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3525517119eb41588a9c556b4591b7b5)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:36.572415 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71175a-423b-4852-9106-1b4b1a76dbf1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:36.616784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-df71175a-423b-4852-9106-1b4b1a76dbf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3525517119eb41588a9c556b4591b7b5', 'request_id': 'req-df71175a-423b-4852-9106-1b4b1a76dbf1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:36.622940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-df71175a-423b-4852-9106-1b4b1a76dbf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3525517119eb41588a9c556b4591b7b5', 'request_id': 'req-df71175a-423b-4852-9106-1b4b1a76dbf1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:36.629330 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-df71175a-423b-4852-9106-1b4b1a76dbf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3525517119eb41588a9c556b4591b7b5', 'request_id': 'req-df71175a-423b-4852-9106-1b4b1a76dbf1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:36.641326 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-df71175a-423b-4852-9106-1b4b1a76dbf1 admin admin] The token cache is being invalidate because project 3525517119eb41588a9c556b4591b7b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:25:36.641675 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-df71175a-423b-4852-9106-1b4b1a76dbf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:36.642305 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-df71175a-423b-4852-9106-1b4b1a76dbf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:36.643829 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1408/2844] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:25:36 2022] DELETE /identity/v3/projects/3525517119eb41588a9c556b4591b7b5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:25:36.649992 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437c0c2-9d75-4ca8-b09e-2cabf162e3bb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:36.650312 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437c0c2-9d75-4ca8-b09e-2cabf162e3bb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:36.650591 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437c0c2-9d75-4ca8-b09e-2cabf162e3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:36.668320 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3437c0c2-9d75-4ca8-b09e-2cabf162e3bb None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:36.669545 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3437c0c2-9d75-4ca8-b09e-2cabf162e3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:36.733715 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1437/2845] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:36.738872 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297b0e1-5cb9-4820-8149-d7d04a7857ad None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:36.739159 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297b0e1-5cb9-4820-8149-d7d04a7857ad None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:36.739437 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297b0e1-5cb9-4820-8149-d7d04a7857ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:36.758035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4297b0e1-5cb9-4820-8149-d7d04a7857ad None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:36.759234 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4297b0e1-5cb9-4820-8149-d7d04a7857ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:36.767119 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1409/2846] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:36.771332 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437c0c2-9d75-4ca8-b09e-2cabf162e3bb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:36.781677 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437c0c2-9d75-4ca8-b09e-2cabf162e3bb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:36.786727 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b7187-0818-454f-b32b-d5fda74d97c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:36.787378 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b7187-0818-454f-b32b-d5fda74d97c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:36.787658 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b7187-0818-454f-b32b-d5fda74d97c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:36.787934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b7187-0818-454f-b32b-d5fda74d97c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:36.788657 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b7187-0818-454f-b32b-d5fda74d97c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:25:36.788968 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b7187-0818-454f-b32b-d5fda74d97c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:36.790631 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b7187-0818-454f-b32b-d5fda74d97c0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:36.792112 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:36.804784 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1438/2847] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:25:36.808896 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297b0e1-5cb9-4820-8149-d7d04a7857ad None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:36.818090 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297b0e1-5cb9-4820-8149-d7d04a7857ad None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:36.822780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5d977-e18f-4292-8c82-dd8cf8e9255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:36.823417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5d977-e18f-4292-8c82-dd8cf8e9255d admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:36.823696 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5d977-e18f-4292-8c82-dd8cf8e9255d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:36.823971 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5d977-e18f-4292-8c82-dd8cf8e9255d admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:36.824648 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5d977-e18f-4292-8c82-dd8cf8e9255d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:36.826576 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5d977-e18f-4292-8c82-dd8cf8e9255d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:36.851157 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1410/2848] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:25:36 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:36.855148 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b7187-0818-454f-b32b-d5fda74d97c0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:36.865644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b7187-0818-454f-b32b-d5fda74d97c0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:36.920013 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e15bc1-f4d6-4e6e-8e20-603da6bfd95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:36.920674 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e15bc1-f4d6-4e6e-8e20-603da6bfd95b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:36.920958 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e15bc1-f4d6-4e6e-8e20-603da6bfd95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:36.921239 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e15bc1-f4d6-4e6e-8e20-603da6bfd95b admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:36.921965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e15bc1-f4d6-4e6e-8e20-603da6bfd95b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:36.923869 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e15bc1-f4d6-4e6e-8e20-603da6bfd95b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:36.943727 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1439/2849] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:25:36 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:36.947805 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5d977-e18f-4292-8c82-dd8cf8e9255d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:36.958029 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5d977-e18f-4292-8c82-dd8cf8e9255d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:36.962671 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4e586-8071-4717-b5f2-886af8e21f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:36.963321 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4e586-8071-4717-b5f2-886af8e21f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:36.963608 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4e586-8071-4717-b5f2-886af8e21f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:36.963889 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4e586-8071-4717-b5f2-886af8e21f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:36.964610 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4e586-8071-4717-b5f2-886af8e21f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:36.966239 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4e586-8071-4717-b5f2-886af8e21f04 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:36.976903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1411/2850] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:36.980622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e15bc1-f4d6-4e6e-8e20-603da6bfd95b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:36.991199 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e15bc1-f4d6-4e6e-8e20-603da6bfd95b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:36.995775 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1b2be-f13d-491f-be3d-53f679afd8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:36.996419 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1b2be-f13d-491f-be3d-53f679afd8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:36.996705 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1b2be-f13d-491f-be3d-53f679afd8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:36.996981 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1b2be-f13d-491f-be3d-53f679afd8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:36.997739 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1b2be-f13d-491f-be3d-53f679afd8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:36.999339 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1b2be-f13d-491f-be3d-53f679afd8e7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:37.009680 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1440/2851] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:25:37.013530 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4e586-8071-4717-b5f2-886af8e21f04 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:37.023545 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4e586-8071-4717-b5f2-886af8e21f04 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:37.028224 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955e569-812b-48e7-845b-0a5e5f8f854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:37.029096 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955e569-812b-48e7-845b-0a5e5f8f854d admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:37.029406 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955e569-812b-48e7-845b-0a5e5f8f854d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:37.029691 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955e569-812b-48e7-845b-0a5e5f8f854d admin admin] PATH_INFO: `/v3/projects/557fe27918fc41ae830c3bfc65eaa843/users/bbd70549930741e982fb8fafed274486/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:37.044680 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955e569-812b-48e7-845b-0a5e5f8f854d admin admin] RBAC: Authorizing `identity:create_grant(project_id=557fe27918fc41ae830c3bfc65eaa843, user_id=bbd70549930741e982fb8fafed274486, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:37.047469 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955e569-812b-48e7-845b-0a5e5f8f854d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:37.060853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1412/2852] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:37 2022] PUT /identity/v3/projects/557fe27918fc41ae830c3bfc65eaa843/users/bbd70549930741e982fb8fafed274486/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:25:37.072164 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657113a-bf17-48ef-8c68-f0122ee21c96 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:37.072635 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657113a-bf17-48ef-8c68-f0122ee21c96 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:37.072841 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657113a-bf17-48ef-8c68-f0122ee21c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:37.099861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9657113a-bf17-48ef-8c68-f0122ee21c96 None None] MFA Rules not processed for user `bbd70549930741e982fb8fafed274486`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:37.101050 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9657113a-bf17-48ef-8c68-f0122ee21c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:37.164550 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1441/2853] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:37.169318 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955e569-812b-48e7-845b-0a5e5f8f854d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:37.230352 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955e569-812b-48e7-845b-0a5e5f8f854d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:37.234957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d563c-c0a9-48a0-ab13-afd47a5d3b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:37.235603 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d563c-c0a9-48a0-ab13-afd47a5d3b51 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:37.235885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d563c-c0a9-48a0-ab13-afd47a5d3b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:37.236159 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d563c-c0a9-48a0-ab13-afd47a5d3b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:37.236836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d563c-c0a9-48a0-ab13-afd47a5d3b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:37.238850 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d563c-c0a9-48a0-ab13-afd47a5d3b51 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:37.248443 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:37.264888 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1413/2854] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:25:37 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:37.268926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657113a-bf17-48ef-8c68-f0122ee21c96 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:37.280419 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657113a-bf17-48ef-8c68-f0122ee21c96 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:37.336056 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197b823-70a7-4a00-b80f-2e2ff73080a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:37.336708 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b823-70a7-4a00-b80f-2e2ff73080a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:37.336993 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b823-70a7-4a00-b80f-2e2ff73080a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:37.337273 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b823-70a7-4a00-b80f-2e2ff73080a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:37.337984 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197b823-70a7-4a00-b80f-2e2ff73080a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:37.339890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197b823-70a7-4a00-b80f-2e2ff73080a1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:37.347469 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:37.360220 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1442/2855] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:25:37 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:37.364702 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d563c-c0a9-48a0-ab13-afd47a5d3b51 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:37.374815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d563c-c0a9-48a0-ab13-afd47a5d3b51 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:37.379958 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a8c32-1e68-4bbb-a963-80de2c7fe724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:37.380602 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a8c32-1e68-4bbb-a963-80de2c7fe724 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:37.380881 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a8c32-1e68-4bbb-a963-80de2c7fe724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:37.381156 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a8c32-1e68-4bbb-a963-80de2c7fe724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:37.381911 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a8c32-1e68-4bbb-a963-80de2c7fe724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:37.383478 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a8c32-1e68-4bbb-a963-80de2c7fe724 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:37.394029 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1414/2856] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:37.398110 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197b823-70a7-4a00-b80f-2e2ff73080a1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:37.407809 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197b823-70a7-4a00-b80f-2e2ff73080a1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:37.412446 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f2c23-be3a-4474-89a1-9aa3994b3bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:37.413307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f2c23-be3a-4474-89a1-9aa3994b3bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:37.413621 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f2c23-be3a-4474-89a1-9aa3994b3bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:37.413897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f2c23-be3a-4474-89a1-9aa3994b3bcd admin admin] PATH_INFO: `/v3/projects/3021e1e73e5d4f05b525cab5eb150431/users/518ceac3efb44fe9b20d35ee2b018f41/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:37.429182 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f2c23-be3a-4474-89a1-9aa3994b3bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3021e1e73e5d4f05b525cab5eb150431, user_id=518ceac3efb44fe9b20d35ee2b018f41, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:37.431961 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f2c23-be3a-4474-89a1-9aa3994b3bcd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:37.444622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1443/2857] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:37 2022] PUT /identity/v3/projects/3021e1e73e5d4f05b525cab5eb150431/users/518ceac3efb44fe9b20d35ee2b018f41/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:37.448389 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a8c32-1e68-4bbb-a963-80de2c7fe724 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:37.458293 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a8c32-1e68-4bbb-a963-80de2c7fe724 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:37.513294 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a8f60-113d-4469-9bcd-17bda9677814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:37.513913 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a8f60-113d-4469-9bcd-17bda9677814 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:37.514201 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a8f60-113d-4469-9bcd-17bda9677814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:37.514474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a8f60-113d-4469-9bcd-17bda9677814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:37.515185 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a8f60-113d-4469-9bcd-17bda9677814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:37.516764 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a8f60-113d-4469-9bcd-17bda9677814 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:37.526439 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1415/2858] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:37.530544 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f2c23-be3a-4474-89a1-9aa3994b3bcd admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:37.541456 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f2c23-be3a-4474-89a1-9aa3994b3bcd admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:37.545975 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cde8b-0478-4923-8b28-b360707fb217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:37.546841 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cde8b-0478-4923-8b28-b360707fb217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:37.547119 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cde8b-0478-4923-8b28-b360707fb217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:37.547390 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cde8b-0478-4923-8b28-b360707fb217 admin admin] PATH_INFO: `/v3/projects/3021e1e73e5d4f05b525cab5eb150431/users/518ceac3efb44fe9b20d35ee2b018f41/roles/d3c63fe700f54e1c8da7f17f7083fd26` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:37.549321 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54cde8b-0478-4923-8b28-b360707fb217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3021e1e73e5d4f05b525cab5eb150431, user_id=518ceac3efb44fe9b20d35ee2b018f41, role_id=d3c63fe700f54e1c8da7f17f7083fd26)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:37.552588 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54cde8b-0478-4923-8b28-b360707fb217 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:37.562644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1444/2859] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:37 2022] PUT /identity/v3/projects/3021e1e73e5d4f05b525cab5eb150431/users/518ceac3efb44fe9b20d35ee2b018f41/roles/d3c63fe700f54e1c8da7f17f7083fd26 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:37.572630 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e07d3a-28da-4445-aba6-7996973f79fa None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:37.572924 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e07d3a-28da-4445-aba6-7996973f79fa None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:37.573205 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e07d3a-28da-4445-aba6-7996973f79fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:37.599016 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d8e07d3a-28da-4445-aba6-7996973f79fa None None] MFA Rules not processed for user `518ceac3efb44fe9b20d35ee2b018f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:37.600199 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d8e07d3a-28da-4445-aba6-7996973f79fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:37.666715 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1416/2860] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:37.678107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cde8b-0478-4923-8b28-b360707fb217 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:37.679804 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a54cde8b-0478-4923-8b28-b360707fb217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:37.736000 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cde8b-0478-4923-8b28-b360707fb217 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:37.740442 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0171d-4aed-441a-9ec4-e66d240a67ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:37.741119 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0171d-4aed-441a-9ec4-e66d240a67ad service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:37.741433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0171d-4aed-441a-9ec4-e66d240a67ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:37.741715 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0171d-4aed-441a-9ec4-e66d240a67ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:37.751223 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0171d-4aed-441a-9ec4-e66d240a67ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:37.752645 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0171d-4aed-441a-9ec4-e66d240a67ad service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:37.762160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1445/2861] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:25:38.110288 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e07d3a-28da-4445-aba6-7996973f79fa None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:38.171726 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e07d3a-28da-4445-aba6-7996973f79fa None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:38.176399 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2096cf6-6df3-4026-aeac-eb12c3a8844a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:38.177286 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2096cf6-6df3-4026-aeac-eb12c3a8844a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:38.177590 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2096cf6-6df3-4026-aeac-eb12c3a8844a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:38.177859 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2096cf6-6df3-4026-aeac-eb12c3a8844a admin admin] PATH_INFO: `/v3/users/bbd70549930741e982fb8fafed274486` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:38.179070 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2096cf6-6df3-4026-aeac-eb12c3a8844a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd70549930741e982fb8fafed274486)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:38.180995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2096cf6-6df3-4026-aeac-eb12c3a8844a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:38.183356 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:38.228019 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f2096cf6-6df3-4026-aeac-eb12c3a8844a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd70549930741e982fb8fafed274486'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:38.239815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f2096cf6-6df3-4026-aeac-eb12c3a8844a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd70549930741e982fb8fafed274486'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:38.240503 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f2096cf6-6df3-4026-aeac-eb12c3a8844a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd70549930741e982fb8fafed274486'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:38.241115 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f2096cf6-6df3-4026-aeac-eb12c3a8844a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd70549930741e982fb8fafed274486'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:38.248224 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f2096cf6-6df3-4026-aeac-eb12c3a8844a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd70549930741e982fb8fafed274486'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:38.260735 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1417/2862] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:25:38 2022] DELETE /identity/v3/users/bbd70549930741e982fb8fafed274486 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:38.265302 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad8918-e38e-4927-9252-6ee78b2104bf None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:38.265829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad8918-e38e-4927-9252-6ee78b2104bf None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:38.265933 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad8918-e38e-4927-9252-6ee78b2104bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:38.283932 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3dad8918-e38e-4927-9252-6ee78b2104bf None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:38.285039 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3dad8918-e38e-4927-9252-6ee78b2104bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:38.345644 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1446/2863] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:38.353460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2096cf6-6df3-4026-aeac-eb12c3a8844a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:38.354868 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f2096cf6-6df3-4026-aeac-eb12c3a8844a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:38.411012 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2096cf6-6df3-4026-aeac-eb12c3a8844a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:38.414675 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2de8f-2acf-493b-b9f9-87bf0e0e0ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:38.415301 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2de8f-2acf-493b-b9f9-87bf0e0e0ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:38.415580 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2de8f-2acf-493b-b9f9-87bf0e0e0ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:38.415853 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2de8f-2acf-493b-b9f9-87bf0e0e0ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:38.424669 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2de8f-2acf-493b-b9f9-87bf0e0e0ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:38.426107 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2de8f-2acf-493b-b9f9-87bf0e0e0ba7 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:38.435274 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1418/2864] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:25:38.695949 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad8918-e38e-4927-9252-6ee78b2104bf None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:38.697425 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3dad8918-e38e-4927-9252-6ee78b2104bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:38.711878 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad8918-e38e-4927-9252-6ee78b2104bf None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:38.716542 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819519a3-233d-41e9-b89c-4c3abb72ddd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:38.717433 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819519a3-233d-41e9-b89c-4c3abb72ddd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:38.717828 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819519a3-233d-41e9-b89c-4c3abb72ddd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:38.718108 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819519a3-233d-41e9-b89c-4c3abb72ddd7 admin admin] PATH_INFO: `/v3/projects/557fe27918fc41ae830c3bfc65eaa843` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:38.719285 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819519a3-233d-41e9-b89c-4c3abb72ddd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=557fe27918fc41ae830c3bfc65eaa843)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:38.721270 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819519a3-233d-41e9-b89c-4c3abb72ddd7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:38.767791 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-819519a3-233d-41e9-b89c-4c3abb72ddd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557fe27918fc41ae830c3bfc65eaa843', 'request_id': 'req-819519a3-233d-41e9-b89c-4c3abb72ddd7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:38.770305 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:38.775304 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-819519a3-233d-41e9-b89c-4c3abb72ddd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557fe27918fc41ae830c3bfc65eaa843', 'request_id': 'req-819519a3-233d-41e9-b89c-4c3abb72ddd7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:38.782054 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-819519a3-233d-41e9-b89c-4c3abb72ddd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557fe27918fc41ae830c3bfc65eaa843', 'request_id': 'req-819519a3-233d-41e9-b89c-4c3abb72ddd7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:38.792937 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-819519a3-233d-41e9-b89c-4c3abb72ddd7 admin admin] The token cache is being invalidate because project 557fe27918fc41ae830c3bfc65eaa843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:25:38.793224 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-819519a3-233d-41e9-b89c-4c3abb72ddd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:38.793875 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-819519a3-233d-41e9-b89c-4c3abb72ddd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:38.795425 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1447/2865] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:25:38 2022] DELETE /identity/v3/projects/557fe27918fc41ae830c3bfc65eaa843 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:38.799654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2de8f-2acf-493b-b9f9-87bf0e0e0ba7 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:38.809818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2de8f-2acf-493b-b9f9-87bf0e0e0ba7 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:38.864883 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844a245-30ce-4413-a4e4-fe59d00216e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:38.865700 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844a245-30ce-4413-a4e4-fe59d00216e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:38.865979 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844a245-30ce-4413-a4e4-fe59d00216e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:38.866249 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844a245-30ce-4413-a4e4-fe59d00216e8 admin admin] PATH_INFO: `/v3/users/518ceac3efb44fe9b20d35ee2b018f41` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:38.867399 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844a245-30ce-4413-a4e4-fe59d00216e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=518ceac3efb44fe9b20d35ee2b018f41)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:38.869317 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844a245-30ce-4413-a4e4-fe59d00216e8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:38.896496 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:38.915556 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c844a245-30ce-4413-a4e4-fe59d00216e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '518ceac3efb44fe9b20d35ee2b018f41'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:38.927329 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c844a245-30ce-4413-a4e4-fe59d00216e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '518ceac3efb44fe9b20d35ee2b018f41'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:38.927975 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c844a245-30ce-4413-a4e4-fe59d00216e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '518ceac3efb44fe9b20d35ee2b018f41'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:38.928571 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c844a245-30ce-4413-a4e4-fe59d00216e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '518ceac3efb44fe9b20d35ee2b018f41'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:38.936979 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c844a245-30ce-4413-a4e4-fe59d00216e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '518ceac3efb44fe9b20d35ee2b018f41'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:38.950262 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1419/2866] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:25:38 2022] DELETE /identity/v3/users/518ceac3efb44fe9b20d35ee2b018f41 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:39.216750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819519a3-233d-41e9-b89c-4c3abb72ddd7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:39.218239 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-819519a3-233d-41e9-b89c-4c3abb72ddd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:39.235270 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819519a3-233d-41e9-b89c-4c3abb72ddd7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:39.293860 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1612012-893e-414e-b7f8-5d68c5fcc9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:39.294724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1612012-893e-414e-b7f8-5d68c5fcc9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:39.295033 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1612012-893e-414e-b7f8-5d68c5fcc9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:39.295312 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1612012-893e-414e-b7f8-5d68c5fcc9b1 admin admin] PATH_INFO: `/v3/projects/3021e1e73e5d4f05b525cab5eb150431` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:39.296482 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1612012-893e-414e-b7f8-5d68c5fcc9b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3021e1e73e5d4f05b525cab5eb150431)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:39.298420 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1612012-893e-414e-b7f8-5d68c5fcc9b1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:39.343490 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f1612012-893e-414e-b7f8-5d68c5fcc9b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3021e1e73e5d4f05b525cab5eb150431', 'request_id': 'req-f1612012-893e-414e-b7f8-5d68c5fcc9b1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:39.350901 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f1612012-893e-414e-b7f8-5d68c5fcc9b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3021e1e73e5d4f05b525cab5eb150431', 'request_id': 'req-f1612012-893e-414e-b7f8-5d68c5fcc9b1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:39.356468 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f1612012-893e-414e-b7f8-5d68c5fcc9b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3021e1e73e5d4f05b525cab5eb150431', 'request_id': 'req-f1612012-893e-414e-b7f8-5d68c5fcc9b1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:39.367941 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f1612012-893e-414e-b7f8-5d68c5fcc9b1 admin admin] The token cache is being invalidate because project 3021e1e73e5d4f05b525cab5eb150431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:25:39.368235 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f1612012-893e-414e-b7f8-5d68c5fcc9b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:39.368862 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f1612012-893e-414e-b7f8-5d68c5fcc9b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:39.370432 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1448/2867] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:25:39 2022] DELETE /identity/v3/projects/3021e1e73e5d4f05b525cab5eb150431 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:39.375309 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679d883-2e0b-402b-879b-ff72877f781f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:39.375790 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679d883-2e0b-402b-879b-ff72877f781f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:39.375901 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679d883-2e0b-402b-879b-ff72877f781f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:39.392982 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f679d883-2e0b-402b-879b-ff72877f781f None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:39.394710 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f679d883-2e0b-402b-879b-ff72877f781f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:39.454908 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1420/2868] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:25:39.464177 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc0f38-51d5-40f1-a99c-650a6a4b91b9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:39.464464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc0f38-51d5-40f1-a99c-650a6a4b91b9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:39.464740 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc0f38-51d5-40f1-a99c-650a6a4b91b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:39.482981 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3bbc0f38-51d5-40f1-a99c-650a6a4b91b9 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:39.484158 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3bbc0f38-51d5-40f1-a99c-650a6a4b91b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:39.491889 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1449/2869] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:25:39.495914 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679d883-2e0b-402b-879b-ff72877f781f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:39.505388 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679d883-2e0b-402b-879b-ff72877f781f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:39.509893 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97312e61-bc35-438c-8d1d-4409eb06a52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:39.510534 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97312e61-bc35-438c-8d1d-4409eb06a52e admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:39.510814 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97312e61-bc35-438c-8d1d-4409eb06a52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:39.511087 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97312e61-bc35-438c-8d1d-4409eb06a52e admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:39.511801 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97312e61-bc35-438c-8d1d-4409eb06a52e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:25:39.512105 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97312e61-bc35-438c-8d1d-4409eb06a52e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:39.513712 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97312e61-bc35-438c-8d1d-4409eb06a52e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:39.525593 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1421/2870] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:25:39.529585 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc0f38-51d5-40f1-a99c-650a6a4b91b9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:39.539229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc0f38-51d5-40f1-a99c-650a6a4b91b9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:39.543830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc5be6-9749-4246-9a65-0de93b1e6764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:39.544464 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc5be6-9749-4246-9a65-0de93b1e6764 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:39.544744 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc5be6-9749-4246-9a65-0de93b1e6764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:39.545017 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc5be6-9749-4246-9a65-0de93b1e6764 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:39.545724 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc5be6-9749-4246-9a65-0de93b1e6764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:39.547603 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc5be6-9749-4246-9a65-0de93b1e6764 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:39.572461 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1450/2871] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:25:39 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:39.576379 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97312e61-bc35-438c-8d1d-4409eb06a52e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:39.586740 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97312e61-bc35-438c-8d1d-4409eb06a52e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:39.641353 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5585b7-f04e-4383-ba05-11b2f394fee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:39.641980 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5585b7-f04e-4383-ba05-11b2f394fee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:39.642280 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5585b7-f04e-4383-ba05-11b2f394fee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:39.642567 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5585b7-f04e-4383-ba05-11b2f394fee6 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:39.643285 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5585b7-f04e-4383-ba05-11b2f394fee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:39.645644 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5585b7-f04e-4383-ba05-11b2f394fee6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:39.668370 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1422/2872] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:25:39 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 11:25:39.669600 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc5be6-9749-4246-9a65-0de93b1e6764 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:39.679768 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc5be6-9749-4246-9a65-0de93b1e6764 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:39.684533 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01581590-9427-4cc3-95e8-ba01d5064c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:39.685235 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01581590-9427-4cc3-95e8-ba01d5064c28 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:39.685559 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01581590-9427-4cc3-95e8-ba01d5064c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:39.685847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01581590-9427-4cc3-95e8-ba01d5064c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:39.686565 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01581590-9427-4cc3-95e8-ba01d5064c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:39.688186 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01581590-9427-4cc3-95e8-ba01d5064c28 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:39.698438 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1451/2873] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 11:25:39.702152 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5585b7-f04e-4383-ba05-11b2f394fee6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:39.712895 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5585b7-f04e-4383-ba05-11b2f394fee6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:39.717532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf2cd0-8f97-4979-b38f-0d411474e79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:39.718168 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf2cd0-8f97-4979-b38f-0d411474e79f admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:39.718474 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf2cd0-8f97-4979-b38f-0d411474e79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:39.718747 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf2cd0-8f97-4979-b38f-0d411474e79f admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:39.719453 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf2cd0-8f97-4979-b38f-0d411474e79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:39.721013 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf2cd0-8f97-4979-b38f-0d411474e79f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:39.731480 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1423/2874] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:39.735273 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01581590-9427-4cc3-95e8-ba01d5064c28 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:39.745107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01581590-9427-4cc3-95e8-ba01d5064c28 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:39.749776 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0515b8-9eb4-45b7-b94f-7f8ea751fe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:39.750637 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0515b8-9eb4-45b7-b94f-7f8ea751fe79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:39.750918 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0515b8-9eb4-45b7-b94f-7f8ea751fe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:39.751197 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0515b8-9eb4-45b7-b94f-7f8ea751fe79 admin admin] PATH_INFO: `/v3/projects/2c4322ed5b414330a853ed85d732ac10/users/aa73bb17fa32450c88b89409757f6928/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:39.766934 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0515b8-9eb4-45b7-b94f-7f8ea751fe79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4322ed5b414330a853ed85d732ac10, user_id=aa73bb17fa32450c88b89409757f6928, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:39.770236 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0515b8-9eb4-45b7-b94f-7f8ea751fe79 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:39.783389 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1452/2875] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:39 2022] PUT /identity/v3/projects/2c4322ed5b414330a853ed85d732ac10/users/aa73bb17fa32450c88b89409757f6928/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:39.793497 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955663a-04fe-4379-a7a1-e71ab0533033 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:39.793787 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955663a-04fe-4379-a7a1-e71ab0533033 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:39.794065 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955663a-04fe-4379-a7a1-e71ab0533033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:39.811784 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:39.822731 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5955663a-04fe-4379-a7a1-e71ab0533033 None None] MFA Rules not processed for user `aa73bb17fa32450c88b89409757f6928`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:39.823910 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5955663a-04fe-4379-a7a1-e71ab0533033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:39.886358 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1424/2876] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:39.898288 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0515b8-9eb4-45b7-b94f-7f8ea751fe79 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:39.899897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cb0515b8-9eb4-45b7-b94f-7f8ea751fe79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:39.909584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:39.959041 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0515b8-9eb4-45b7-b94f-7f8ea751fe79 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:39.962692 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee432c-7b7a-40aa-b5b8-2769b753a58b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:39.963337 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee432c-7b7a-40aa-b5b8-2769b753a58b service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:39.963622 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee432c-7b7a-40aa-b5b8-2769b753a58b service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:39.963902 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee432c-7b7a-40aa-b5b8-2769b753a58b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:39.972132 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee432c-7b7a-40aa-b5b8-2769b753a58b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:39.974110 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee432c-7b7a-40aa-b5b8-2769b753a58b service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:39.983103 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1453/2877] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:25:40.002586 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955663a-04fe-4379-a7a1-e71ab0533033 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:40.063419 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955663a-04fe-4379-a7a1-e71ab0533033 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:40.067995 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33c824-fa86-42bb-aaf1-927ee16c06d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:40.068845 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33c824-fa86-42bb-aaf1-927ee16c06d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:40.069119 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33c824-fa86-42bb-aaf1-927ee16c06d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:40.069413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33c824-fa86-42bb-aaf1-927ee16c06d5 admin admin] PATH_INFO: `/v3/users/aa73bb17fa32450c88b89409757f6928` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:40.070592 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33c824-fa86-42bb-aaf1-927ee16c06d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa73bb17fa32450c88b89409757f6928)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:40.072506 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33c824-fa86-42bb-aaf1-927ee16c06d5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:40.116116 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8a33c824-fa86-42bb-aaf1-927ee16c06d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa73bb17fa32450c88b89409757f6928'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:40.127391 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8a33c824-fa86-42bb-aaf1-927ee16c06d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa73bb17fa32450c88b89409757f6928'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:40.128051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8a33c824-fa86-42bb-aaf1-927ee16c06d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa73bb17fa32450c88b89409757f6928'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:40.128818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8a33c824-fa86-42bb-aaf1-927ee16c06d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa73bb17fa32450c88b89409757f6928'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:40.135269 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8a33c824-fa86-42bb-aaf1-927ee16c06d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa73bb17fa32450c88b89409757f6928'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:40.147678 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1425/2878] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:25:40 2022] DELETE /identity/v3/users/aa73bb17fa32450c88b89409757f6928 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:40.152597 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebcc58-0a72-4980-bbc5-e93ef63ea819 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:40.152829 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebcc58-0a72-4980-bbc5-e93ef63ea819 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:40.153107 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebcc58-0a72-4980-bbc5-e93ef63ea819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:40.170822 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-83ebcc58-0a72-4980-bbc5-e93ef63ea819 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:40.172024 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-83ebcc58-0a72-4980-bbc5-e93ef63ea819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:40.229720 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1454/2879] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:40.239142 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33c824-fa86-42bb-aaf1-927ee16c06d5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:40.240533 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8a33c824-fa86-42bb-aaf1-927ee16c06d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:40.260705 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:40.300339 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33c824-fa86-42bb-aaf1-927ee16c06d5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:40.303985 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d9486-ba29-4633-bad1-23b353aeb2fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:40.304622 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d9486-ba29-4633-bad1-23b353aeb2fc service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:40.304903 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d9486-ba29-4633-bad1-23b353aeb2fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:40.305175 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d9486-ba29-4633-bad1-23b353aeb2fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:40.314049 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d9486-ba29-4633-bad1-23b353aeb2fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:40.315739 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d9486-ba29-4633-bad1-23b353aeb2fc service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:40.325112 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1426/2880] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:25:40.587221 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebcc58-0a72-4980-bbc5-e93ef63ea819 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:40.588687 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-83ebcc58-0a72-4980-bbc5-e93ef63ea819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:40.601737 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebcc58-0a72-4980-bbc5-e93ef63ea819 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:40.606422 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe47d5f-59a0-4331-aa47-4086132f45a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:40.607278 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe47d5f-59a0-4331-aa47-4086132f45a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:40.607558 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe47d5f-59a0-4331-aa47-4086132f45a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:40.607830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe47d5f-59a0-4331-aa47-4086132f45a8 admin admin] PATH_INFO: `/v3/projects/2c4322ed5b414330a853ed85d732ac10` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:40.609026 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe47d5f-59a0-4331-aa47-4086132f45a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c4322ed5b414330a853ed85d732ac10)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:40.610997 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe47d5f-59a0-4331-aa47-4086132f45a8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:40.657495 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bfe47d5f-59a0-4331-aa47-4086132f45a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4322ed5b414330a853ed85d732ac10', 'request_id': 'req-bfe47d5f-59a0-4331-aa47-4086132f45a8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:40.665381 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bfe47d5f-59a0-4331-aa47-4086132f45a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4322ed5b414330a853ed85d732ac10', 'request_id': 'req-bfe47d5f-59a0-4331-aa47-4086132f45a8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:40.671077 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bfe47d5f-59a0-4331-aa47-4086132f45a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4322ed5b414330a853ed85d732ac10', 'request_id': 'req-bfe47d5f-59a0-4331-aa47-4086132f45a8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:40.681938 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bfe47d5f-59a0-4331-aa47-4086132f45a8 admin admin] The token cache is being invalidate because project 2c4322ed5b414330a853ed85d732ac10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:25:40.682226 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bfe47d5f-59a0-4331-aa47-4086132f45a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:40.682851 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bfe47d5f-59a0-4331-aa47-4086132f45a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:25:40.684391 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1455/2881] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:25:40 2022] DELETE /identity/v3/projects/2c4322ed5b414330a853ed85d732ac10 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:40.689245 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5dfe9-d533-465e-8470-4f5b87815a90 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:40.689746 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5dfe9-d533-465e-8470-4f5b87815a90 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:40.689857 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5dfe9-d533-465e-8470-4f5b87815a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:40.708164 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-95b5dfe9-d533-465e-8470-4f5b87815a90 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:40.709356 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-95b5dfe9-d533-465e-8470-4f5b87815a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:40.767597 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1427/2882] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:40.776094 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d38a3f-45ec-4b79-8217-700130583795 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:40.776385 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d38a3f-45ec-4b79-8217-700130583795 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:40.776691 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d38a3f-45ec-4b79-8217-700130583795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:40.794615 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-15d38a3f-45ec-4b79-8217-700130583795 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:40.795784 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-15d38a3f-45ec-4b79-8217-700130583795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:40.803583 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1456/2883] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:40.807590 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5dfe9-d533-465e-8470-4f5b87815a90 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:40.817445 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5dfe9-d533-465e-8470-4f5b87815a90 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:40.822014 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54240cd7-0b73-4781-bda2-c7589c9503ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:40.822668 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54240cd7-0b73-4781-bda2-c7589c9503ac admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:40.822950 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54240cd7-0b73-4781-bda2-c7589c9503ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:40.823226 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54240cd7-0b73-4781-bda2-c7589c9503ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:40.823947 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54240cd7-0b73-4781-bda2-c7589c9503ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 11:25:40.824251 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54240cd7-0b73-4781-bda2-c7589c9503ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:40.825912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54240cd7-0b73-4781-bda2-c7589c9503ac admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:40.837916 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1428/2884] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Jun 27 11:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 11:25:40.841890 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d38a3f-45ec-4b79-8217-700130583795 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:40.850941 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d38a3f-45ec-4b79-8217-700130583795 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:40.855565 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ef4c5-906a-4e95-9cd2-0adaca988f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:40.856193 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ef4c5-906a-4e95-9cd2-0adaca988f70 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:40.856474 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ef4c5-906a-4e95-9cd2-0adaca988f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:40.856750 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ef4c5-906a-4e95-9cd2-0adaca988f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:40.857470 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ef4c5-906a-4e95-9cd2-0adaca988f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:40.859363 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ef4c5-906a-4e95-9cd2-0adaca988f70 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:40.885291 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1457/2885] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Jun 27 11:25:40 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:40.890597 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54240cd7-0b73-4781-bda2-c7589c9503ac admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:40.900794 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54240cd7-0b73-4781-bda2-c7589c9503ac admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:40.955999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1067e-468f-4685-a8c8-9eda21688e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:40.956592 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1067e-468f-4685-a8c8-9eda21688e95 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:40.956900 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1067e-468f-4685-a8c8-9eda21688e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:40.957178 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1067e-468f-4685-a8c8-9eda21688e95 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:40.957885 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1067e-468f-4685-a8c8-9eda21688e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:40.959788 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1067e-468f-4685-a8c8-9eda21688e95 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:40.978704 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1429/2886] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Jun 27 11:25:40 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 11:25:40.982647 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ef4c5-906a-4e95-9cd2-0adaca988f70 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:40.989676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:40.993568 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ef4c5-906a-4e95-9cd2-0adaca988f70 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:40.999370 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b37a34-bfeb-4a8a-a729-ac36ccc5477f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:41.000185 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37a34-bfeb-4a8a-a729-ac36ccc5477f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:41.000682 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37a34-bfeb-4a8a-a729-ac36ccc5477f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:41.001009 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37a34-bfeb-4a8a-a729-ac36ccc5477f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:41.001885 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b37a34-bfeb-4a8a-a729-ac36ccc5477f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:41.004231 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b37a34-bfeb-4a8a-a729-ac36ccc5477f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:41.014449 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1458/2887] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:41.018223 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1067e-468f-4685-a8c8-9eda21688e95 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:41.028211 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1067e-468f-4685-a8c8-9eda21688e95 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:41.032815 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77586cea-ef17-49b3-b315-9c93c3b01c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:41.033486 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77586cea-ef17-49b3-b315-9c93c3b01c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:41.033978 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77586cea-ef17-49b3-b315-9c93c3b01c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:41.034273 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77586cea-ef17-49b3-b315-9c93c3b01c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:41.035041 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77586cea-ef17-49b3-b315-9c93c3b01c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:41.036609 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77586cea-ef17-49b3-b315-9c93c3b01c3c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:41.046302 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1430/2888] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Jun 27 11:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 11:25:41.050160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b37a34-bfeb-4a8a-a729-ac36ccc5477f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:41.060522 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b37a34-bfeb-4a8a-a729-ac36ccc5477f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:41.065099 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d3a38-72ae-4326-89b1-e70a8aff6ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:41.066019 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d3a38-72ae-4326-89b1-e70a8aff6ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:41.066867 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d3a38-72ae-4326-89b1-e70a8aff6ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:41.067147 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d3a38-72ae-4326-89b1-e70a8aff6ef4 admin admin] PATH_INFO: `/v3/projects/e3c1429947d54f6e84fcf9fbff36bc09/users/a9649071b0d144feac2e962d8993893a/roles/2c7768e02a39438fbe2c3551ff3b19a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:41.081282 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d3a38-72ae-4326-89b1-e70a8aff6ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c1429947d54f6e84fcf9fbff36bc09, user_id=a9649071b0d144feac2e962d8993893a, role_id=2c7768e02a39438fbe2c3551ff3b19a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:41.083966 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d3a38-72ae-4326-89b1-e70a8aff6ef4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:41.096587 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1459/2889] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Jun 27 11:25:41 2022] PUT /identity/v3/projects/e3c1429947d54f6e84fcf9fbff36bc09/users/a9649071b0d144feac2e962d8993893a/roles/2c7768e02a39438fbe2c3551ff3b19a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:25:41.101345 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2c20d-714a-49d0-9ce1-38a36039afb8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:41.101822 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2c20d-714a-49d0-9ce1-38a36039afb8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:41.102217 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2c20d-714a-49d0-9ce1-38a36039afb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:41.120529 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-bee2c20d-714a-49d0-9ce1-38a36039afb8 None None] MFA Rules not processed for user `97dbc9dd817544e5a3eb7457f8275b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:41.121759 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bee2c20d-714a-49d0-9ce1-38a36039afb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:41.142476 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:25:41.181089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1431/2890] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 11:25:41.190565 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d3a38-72ae-4326-89b1-e70a8aff6ef4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:41.192847 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5d2d3a38-72ae-4326-89b1-e70a8aff6ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:41.248167 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d3a38-72ae-4326-89b1-e70a8aff6ef4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:41.251676 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49916f-ed42-4e5c-b982-a825aad58c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:41.252307 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49916f-ed42-4e5c-b982-a825aad58c5b service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:41.252588 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49916f-ed42-4e5c-b982-a825aad58c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:41.252861 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49916f-ed42-4e5c-b982-a825aad58c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:41.261590 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49916f-ed42-4e5c-b982-a825aad58c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:41.263012 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49916f-ed42-4e5c-b982-a825aad58c5b service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:41.272191 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1460/2891] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:25:42.067623 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33281a29-11a0-43c4-9505-83d8887e8b43 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:42.068160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33281a29-11a0-43c4-9505-83d8887e8b43 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:42.068160 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33281a29-11a0-43c4-9505-83d8887e8b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:42.095956 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-33281a29-11a0-43c4-9505-83d8887e8b43 None None] MFA Rules not processed for user `a9649071b0d144feac2e962d8993893a`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:42.097161 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-33281a29-11a0-43c4-9505-83d8887e8b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:42.163236 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1432/2892] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:42.174201 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49916f-ed42-4e5c-b982-a825aad58c5b service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:42.175716 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ea49916f-ed42-4e5c-b982-a825aad58c5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:42.238815 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49916f-ed42-4e5c-b982-a825aad58c5b service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:42.242656 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e55b9d-2c27-4458-9212-94bb263d5c35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '521f3fcc63524d2d82b4a05a0dc062f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:42.243576 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e55b9d-2c27-4458-9212-94bb263d5c35 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:42.243863 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e55b9d-2c27-4458-9212-94bb263d5c35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:42.244142 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e55b9d-2c27-4458-9212-94bb263d5c35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:42.252872 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e55b9d-2c27-4458-9212-94bb263d5c35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:42.254863 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e55b9d-2c27-4458-9212-94bb263d5c35 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:42.264176 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1461/2893] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:25:43.603044 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1771bcc-f649-41e4-ae17-97d49726d8f4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:43.603538 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1771bcc-f649-41e4-ae17-97d49726d8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:43.603664 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1771bcc-f649-41e4-ae17-97d49726d8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:43.620737 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c1771bcc-f649-41e4-ae17-97d49726d8f4 None None] MFA Rules not processed for user `a9649071b0d144feac2e962d8993893a`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:25:43.621971 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c1771bcc-f649-41e4-ae17-97d49726d8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:43.629282 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1433/2894] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:25:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:25:50.852714 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e55b9d-2c27-4458-9212-94bb263d5c35 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:50.862359 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e55b9d-2c27-4458-9212-94bb263d5c35 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:50.866434 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe13c76-bebb-41f1-95fa-0180cba66163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:50.867063 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe13c76-bebb-41f1-95fa-0180cba66163 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:50.867350 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe13c76-bebb-41f1-95fa-0180cba66163 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:50.867628 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe13c76-bebb-41f1-95fa-0180cba66163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:50.869386 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-afe13c76-bebb-41f1-95fa-0180cba66163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:50.879309 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe13c76-bebb-41f1-95fa-0180cba66163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:50.880730 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe13c76-bebb-41f1-95fa-0180cba66163 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:50.888737 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1462/2895] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:25:51.478299 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1771bcc-f649-41e4-ae17-97d49726d8f4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:25:51.480741 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c1771bcc-f649-41e4-ae17-97d49726d8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:51.561469 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1771bcc-f649-41e4-ae17-97d49726d8f4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:25:51.566917 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4992b4d-43b3-4c53-ba15-c878529178b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed08c367a3d34207a51914ff77a93898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:25:51.567577 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4992b4d-43b3-4c53-ba15-c878529178b2 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:25:51.567837 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4992b4d-43b3-4c53-ba15-c878529178b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:25:51.568108 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4992b4d-43b3-4c53-ba15-c878529178b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:25:51.569896 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f4992b4d-43b3-4c53-ba15-c878529178b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:25:51.582907 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4992b4d-43b3-4c53-ba15-c878529178b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:25:51.584485 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4992b4d-43b3-4c53-ba15-c878529178b2 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:25:51.595188 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1434/2896] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:25:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:26:00.885160 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=71,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:26:01.590532 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=84 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:26:06.345748 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2d25e-e29d-44d5-ac6a-199d7436f743 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:26:06.346360 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2d25e-e29d-44d5-ac6a-199d7436f743 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:26:06.346360 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2d25e-e29d-44d5-ac6a-199d7436f743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:26:06.364821 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f9e2d25e-e29d-44d5-ac6a-199d7436f743 None None] MFA Rules not processed for user `a9649071b0d144feac2e962d8993893a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:26:06.366071 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f9e2d25e-e29d-44d5-ac6a-199d7436f743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:26:06.373461 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1463/2897] 10.222.0.18 () {58 vars in 957 bytes} [Mon Jun 27 11:26:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:26:10.724548 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4992b4d-43b3-4c53-ba15-c878529178b2 service nova] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:26:10.726091 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f4992b4d-43b3-4c53-ba15-c878529178b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:26:10.742972 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4992b4d-43b3-4c53-ba15-c878529178b2 service nova] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:26:10.747119 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e2e41-f423-42cd-989d-da52b97cdda3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:26:10.747359 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2e41-f423-42cd-989d-da52b97cdda3 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:26:10.747611 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2e41-f423-42cd-989d-da52b97cdda3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:26:10.747886 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2e41-f423-42cd-989d-da52b97cdda3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:26:10.749836 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-168e2e41-f423-42cd-989d-da52b97cdda3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:26:10.760006 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e2e41-f423-42cd-989d-da52b97cdda3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:26:10.761465 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e2e41-f423-42cd-989d-da52b97cdda3 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:26:10.770990 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1435/2898] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:26:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:26:10.863801 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2d25e-e29d-44d5-ac6a-199d7436f743 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:26:10.874234 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2d25e-e29d-44d5-ac6a-199d7436f743 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:26:10.877965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d2c29-73a9-4b71-9432-563e560471bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:26:10.879303 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d2c29-73a9-4b71-9432-563e560471bc service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:26:10.879584 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d2c29-73a9-4b71-9432-563e560471bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:26:10.879854 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d2c29-73a9-4b71-9432-563e560471bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:26:10.881654 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d18d2c29-73a9-4b71-9432-563e560471bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:26:10.895770 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d2c29-73a9-4b71-9432-563e560471bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:26:10.897234 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d2c29-73a9-4b71-9432-563e560471bc service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:26:10.909505 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1464/2899] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:26:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:26:20.766790 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=6 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:26:20.904015 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=9 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:26:29.755382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b525bd-0a8b-422c-9179-f50722acd2de None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:26:29.755852 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b525bd-0a8b-422c-9179-f50722acd2de None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:26:29.755987 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b525bd-0a8b-422c-9179-f50722acd2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:26:29.812459 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-90b525bd-0a8b-422c-9179-f50722acd2de None None] MFA Rules not processed for user `40c6739db5404d59a6799b2ace1c7982`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:26:29.813673 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-90b525bd-0a8b-422c-9179-f50722acd2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:26:29.875226 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1436/2900] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jun 27 11:26:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:26:29.920741 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d2c29-73a9-4b71-9432-563e560471bc service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:26:29.922212 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d18d2c29-73a9-4b71-9432-563e560471bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:26:30.011419 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d2c29-73a9-4b71-9432-563e560471bc service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:26:30.016640 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb084862-90eb-4a23-a786-3c1342e3feb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189af68908944b5e9a7cb35fde0e1bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:26:30.017352 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb084862-90eb-4a23-a786-3c1342e3feb7 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:26:30.017706 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb084862-90eb-4a23-a786-3c1342e3feb7 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:26:30.018014 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb084862-90eb-4a23-a786-3c1342e3feb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:26:30.026384 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb084862-90eb-4a23-a786-3c1342e3feb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:26:30.027965 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb084862-90eb-4a23-a786-3c1342e3feb7 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:26:30.036479 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1465/2901] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jun 27 11:26:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 11:26:39.872397 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=44 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:26:40.032813 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=41 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:26:45.145962 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd35d5a-bde7-41c2-8f7e-1aa2af2de32d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:26:45.146416 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd35d5a-bde7-41c2-8f7e-1aa2af2de32d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:26:45.146542 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd35d5a-bde7-41c2-8f7e-1aa2af2de32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:26:45.164336 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-fdd35d5a-bde7-41c2-8f7e-1aa2af2de32d None None] MFA Rules not processed for user `40c6739db5404d59a6799b2ace1c7982`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 11:26:45.165508 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fdd35d5a-bde7-41c2-8f7e-1aa2af2de32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:26:45.172418 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1437/2902] 10.222.0.18 () {58 vars in 967 bytes} [Mon Jun 27 11:26:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 11:26:45.184540 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb084862-90eb-4a23-a786-3c1342e3feb7 service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:26:45.194948 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb084862-90eb-4a23-a786-3c1342e3feb7 service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:26:45.199897 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b2dca-064f-4201-8f1f-b9988fc09d0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189af68908944b5e9a7cb35fde0e1bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:26:45.200526 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b2dca-064f-4201-8f1f-b9988fc09d0b service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:26:45.200805 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b2dca-064f-4201-8f1f-b9988fc09d0b service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:26:45.201080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b2dca-064f-4201-8f1f-b9988fc09d0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:26:45.209460 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b2dca-064f-4201-8f1f-b9988fc09d0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:26:45.210976 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b2dca-064f-4201-8f1f-b9988fc09d0b service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:26:45.218907 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1466/2903] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jun 27 11:26:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 11:26:47.022841 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd35d5a-bde7-41c2-8f7e-1aa2af2de32d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:26:47.024528 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fdd35d5a-bde7-41c2-8f7e-1aa2af2de32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:26:47.083140 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b2dca-064f-4201-8f1f-b9988fc09d0b service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:26:47.094511 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b2dca-064f-4201-8f1f-b9988fc09d0b service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:26:47.099142 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741da20-0bdf-441b-a22e-ce163f8324e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:26:47.100105 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741da20-0bdf-441b-a22e-ce163f8324e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:26:47.100219 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd35d5a-bde7-41c2-8f7e-1aa2af2de32d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:26:47.100314 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741da20-0bdf-441b-a22e-ce163f8324e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:26:47.100517 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741da20-0bdf-441b-a22e-ce163f8324e7 admin admin] PATH_INFO: `/v3/users/a9649071b0d144feac2e962d8993893a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:26:47.101726 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741da20-0bdf-441b-a22e-ce163f8324e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9649071b0d144feac2e962d8993893a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:26:47.103998 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741da20-0bdf-441b-a22e-ce163f8324e7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:26:47.109672 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de402c-2483-4416-a762-a2479ca6fa7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8673c91abf14c0b9a237f0499fdf20e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:26:47.110426 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de402c-2483-4416-a762-a2479ca6fa7d service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:26:47.110720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de402c-2483-4416-a762-a2479ca6fa7d service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:26:47.111054 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de402c-2483-4416-a762-a2479ca6fa7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:26:47.113702 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-01de402c-2483-4416-a762-a2479ca6fa7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:26:47.126413 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de402c-2483-4416-a762-a2479ca6fa7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:26:47.129990 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de402c-2483-4416-a762-a2479ca6fa7d service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:26:47.141263 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1438/2904] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:26:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:26:47.158156 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a741da20-0bdf-441b-a22e-ce163f8324e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9649071b0d144feac2e962d8993893a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:26:47.170705 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a741da20-0bdf-441b-a22e-ce163f8324e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9649071b0d144feac2e962d8993893a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:26:47.171553 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a741da20-0bdf-441b-a22e-ce163f8324e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9649071b0d144feac2e962d8993893a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:26:47.172159 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a741da20-0bdf-441b-a22e-ce163f8324e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9649071b0d144feac2e962d8993893a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:26:47.180289 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a741da20-0bdf-441b-a22e-ce163f8324e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9649071b0d144feac2e962d8993893a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:26:47.193229 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1467/2905] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:26:47 2022] DELETE /identity/v3/users/a9649071b0d144feac2e962d8993893a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 11:26:47.360734 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de402c-2483-4416-a762-a2479ca6fa7d service placement] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:26:47.372385 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de402c-2483-4416-a762-a2479ca6fa7d service placement] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:26:47.430771 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aefb9c-23af-44b3-96ca-f18cf60c168a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:26:47.431629 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aefb9c-23af-44b3-96ca-f18cf60c168a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:26:47.431912 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aefb9c-23af-44b3-96ca-f18cf60c168a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:26:47.432189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aefb9c-23af-44b3-96ca-f18cf60c168a admin admin] PATH_INFO: `/v3/projects/e3c1429947d54f6e84fcf9fbff36bc09` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:26:47.433382 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aefb9c-23af-44b3-96ca-f18cf60c168a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3c1429947d54f6e84fcf9fbff36bc09)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:26:47.435291 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aefb9c-23af-44b3-96ca-f18cf60c168a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:26:47.479432 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-65aefb9c-23af-44b3-96ca-f18cf60c168a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3c1429947d54f6e84fcf9fbff36bc09', 'request_id': 'req-65aefb9c-23af-44b3-96ca-f18cf60c168a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:26:47.485356 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-65aefb9c-23af-44b3-96ca-f18cf60c168a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3c1429947d54f6e84fcf9fbff36bc09', 'request_id': 'req-65aefb9c-23af-44b3-96ca-f18cf60c168a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:26:47.491417 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-65aefb9c-23af-44b3-96ca-f18cf60c168a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3c1429947d54f6e84fcf9fbff36bc09', 'request_id': 'req-65aefb9c-23af-44b3-96ca-f18cf60c168a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:26:47.503232 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-65aefb9c-23af-44b3-96ca-f18cf60c168a admin admin] The token cache is being invalidate because project e3c1429947d54f6e84fcf9fbff36bc09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:26:47.503521 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-65aefb9c-23af-44b3-96ca-f18cf60c168a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:26:47.504150 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-65aefb9c-23af-44b3-96ca-f18cf60c168a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:26:47.505711 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1439/2906] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:26:47 2022] DELETE /identity/v3/projects/e3c1429947d54f6e84fcf9fbff36bc09 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:26:57.188985 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:26:57.500319 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:27:31.055319 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741da20-0bdf-441b-a22e-ce163f8324e7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:27:31.056731 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a741da20-0bdf-441b-a22e-ce163f8324e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:27:31.125171 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741da20-0bdf-441b-a22e-ce163f8324e7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:27:31.182823 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dd4df-8aa3-4c0d-999e-ae79d5423b8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8673c91abf14c0b9a237f0499fdf20e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:27:31.183471 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dd4df-8aa3-4c0d-999e-ae79d5423b8d service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:27:31.183752 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dd4df-8aa3-4c0d-999e-ae79d5423b8d service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:27:31.184032 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dd4df-8aa3-4c0d-999e-ae79d5423b8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:27:31.185830 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-109dd4df-8aa3-4c0d-999e-ae79d5423b8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:27:31.196998 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dd4df-8aa3-4c0d-999e-ae79d5423b8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:27:31.198614 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dd4df-8aa3-4c0d-999e-ae79d5423b8d service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:27:31.209038 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1468/2907] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:27:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:27:41.204210 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=58 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:28:02.209780 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aefb9c-23af-44b3-96ca-f18cf60c168a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:28:02.211214 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-65aefb9c-23af-44b3-96ca-f18cf60c168a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:28:02.266030 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aefb9c-23af-44b3-96ca-f18cf60c168a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:28:02.269635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f855157-63cb-4e4e-a39d-f8ec8b56f5f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:28:02.270265 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f855157-63cb-4e4e-a39d-f8ec8b56f5f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:28:02.270544 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f855157-63cb-4e4e-a39d-f8ec8b56f5f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:28:02.270818 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f855157-63cb-4e4e-a39d-f8ec8b56f5f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:28:02.272536 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8f855157-63cb-4e4e-a39d-f8ec8b56f5f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:28:02.329756 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f855157-63cb-4e4e-a39d-f8ec8b56f5f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:28:02.331209 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f855157-63cb-4e4e-a39d-f8ec8b56f5f8 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:28:02.339999 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1440/2908] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:28:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:28:07.004728 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dd4df-8aa3-4c0d-999e-ae79d5423b8d service placement] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:28:07.014366 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dd4df-8aa3-4c0d-999e-ae79d5423b8d service placement] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:28:07.018570 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f348dfd-a86a-4e07-95e5-52b9e8d54a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2d4050a05f4517ab165c74f9e6cae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:28:07.019206 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f348dfd-a86a-4e07-95e5-52b9e8d54a47 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:28:07.019488 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f348dfd-a86a-4e07-95e5-52b9e8d54a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:28:07.019766 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f348dfd-a86a-4e07-95e5-52b9e8d54a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:28:07.021603 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3f348dfd-a86a-4e07-95e5-52b9e8d54a47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:28:07.083827 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f348dfd-a86a-4e07-95e5-52b9e8d54a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:28:07.085248 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f348dfd-a86a-4e07-95e5-52b9e8d54a47 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:28:07.094765 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1469/2909] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:28:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:28:12.335957 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=48 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:28:13.163954 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f855157-63cb-4e4e-a39d-f8ec8b56f5f8 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:28:13.165654 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8f855157-63cb-4e4e-a39d-f8ec8b56f5f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:28:13.185052 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f855157-63cb-4e4e-a39d-f8ec8b56f5f8 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:28:13.190528 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdabf63-83e7-4d51-a4e1-33eeaf0e501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:28:13.191400 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdabf63-83e7-4d51-a4e1-33eeaf0e501a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:28:13.191677 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdabf63-83e7-4d51-a4e1-33eeaf0e501a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:28:13.191947 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdabf63-83e7-4d51-a4e1-33eeaf0e501a admin admin] PATH_INFO: `/v3/users/4db906a7c80340fa93d5657155b96490` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:28:13.193113 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdabf63-83e7-4d51-a4e1-33eeaf0e501a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4db906a7c80340fa93d5657155b96490)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:28:13.195089 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdabf63-83e7-4d51-a4e1-33eeaf0e501a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:28:13.245927 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4cdabf63-83e7-4d51-a4e1-33eeaf0e501a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4db906a7c80340fa93d5657155b96490'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:13.258671 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4cdabf63-83e7-4d51-a4e1-33eeaf0e501a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4db906a7c80340fa93d5657155b96490'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:13.259460 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4cdabf63-83e7-4d51-a4e1-33eeaf0e501a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4db906a7c80340fa93d5657155b96490'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:13.260051 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4cdabf63-83e7-4d51-a4e1-33eeaf0e501a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4db906a7c80340fa93d5657155b96490'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:13.268210 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4cdabf63-83e7-4d51-a4e1-33eeaf0e501a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4db906a7c80340fa93d5657155b96490'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:13.284035 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1441/2910] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:28:13 2022] DELETE /identity/v3/users/4db906a7c80340fa93d5657155b96490 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:28:13.464070 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f348dfd-a86a-4e07-95e5-52b9e8d54a47 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:28:13.475831 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f348dfd-a86a-4e07-95e5-52b9e8d54a47 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:28:13.534508 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6ed02-e50f-4cab-be30-56dfe06242a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:28:13.535376 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6ed02-e50f-4cab-be30-56dfe06242a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:28:13.535657 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6ed02-e50f-4cab-be30-56dfe06242a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:28:13.535929 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6ed02-e50f-4cab-be30-56dfe06242a5 admin admin] PATH_INFO: `/v3/projects/35c6cf9fd7c841a29a12adccfc9b2c60` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:28:13.537093 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6ed02-e50f-4cab-be30-56dfe06242a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35c6cf9fd7c841a29a12adccfc9b2c60)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:28:13.539022 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6ed02-e50f-4cab-be30-56dfe06242a5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:28:13.583880 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-11b6ed02-e50f-4cab-be30-56dfe06242a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35c6cf9fd7c841a29a12adccfc9b2c60', 'request_id': 'req-11b6ed02-e50f-4cab-be30-56dfe06242a5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:13.590444 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-11b6ed02-e50f-4cab-be30-56dfe06242a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35c6cf9fd7c841a29a12adccfc9b2c60', 'request_id': 'req-11b6ed02-e50f-4cab-be30-56dfe06242a5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:13.596033 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-11b6ed02-e50f-4cab-be30-56dfe06242a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35c6cf9fd7c841a29a12adccfc9b2c60', 'request_id': 'req-11b6ed02-e50f-4cab-be30-56dfe06242a5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:13.606668 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-11b6ed02-e50f-4cab-be30-56dfe06242a5 admin admin] The token cache is being invalidate because project 35c6cf9fd7c841a29a12adccfc9b2c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:28:13.606956 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-11b6ed02-e50f-4cab-be30-56dfe06242a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:13.607604 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-11b6ed02-e50f-4cab-be30-56dfe06242a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:13.609137 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1470/2911] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:28:13 2022] DELETE /identity/v3/projects/35c6cf9fd7c841a29a12adccfc9b2c60 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:28:13.613087 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdabf63-83e7-4d51-a4e1-33eeaf0e501a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:28:13.614627 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4cdabf63-83e7-4d51-a4e1-33eeaf0e501a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:28:13.628080 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdabf63-83e7-4d51-a4e1-33eeaf0e501a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:28:13.682635 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5920d-102f-48e0-823d-58900faafdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:28:13.683560 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5920d-102f-48e0-823d-58900faafdc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:28:13.683740 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5920d-102f-48e0-823d-58900faafdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:28:13.684007 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5920d-102f-48e0-823d-58900faafdc5 admin admin] PATH_INFO: `/v3/users/f5f184f25d794c4d95e7eb7993d86e8e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:28:13.685189 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5920d-102f-48e0-823d-58900faafdc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f184f25d794c4d95e7eb7993d86e8e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:28:13.687151 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5920d-102f-48e0-823d-58900faafdc5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:28:13.731538 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c7b5920d-102f-48e0-823d-58900faafdc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f184f25d794c4d95e7eb7993d86e8e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:13.743207 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c7b5920d-102f-48e0-823d-58900faafdc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f184f25d794c4d95e7eb7993d86e8e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:13.743865 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c7b5920d-102f-48e0-823d-58900faafdc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f184f25d794c4d95e7eb7993d86e8e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:13.744475 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c7b5920d-102f-48e0-823d-58900faafdc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f184f25d794c4d95e7eb7993d86e8e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:13.752675 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c7b5920d-102f-48e0-823d-58900faafdc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f184f25d794c4d95e7eb7993d86e8e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:13.754730 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:28:13.766699 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1442/2912] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Jun 27 11:28:13 2022] DELETE /identity/v3/users/f5f184f25d794c4d95e7eb7993d86e8e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:28:13.932381 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6ed02-e50f-4cab-be30-56dfe06242a5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:28:13.933926 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-11b6ed02-e50f-4cab-be30-56dfe06242a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:28:13.948217 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6ed02-e50f-4cab-be30-56dfe06242a5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:28:13.971080 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:28:14.009920 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662e5e6-dc34-4bd2-b4f2-376e44e95ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97dbc9dd817544e5a3eb7457f8275b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ccd8cb3bebf4369b70aa2f145132951', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:28:14.010779 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662e5e6-dc34-4bd2-b4f2-376e44e95ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:28:14.011062 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662e5e6-dc34-4bd2-b4f2-376e44e95ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:28:14.011340 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662e5e6-dc34-4bd2-b4f2-376e44e95ae9 admin admin] PATH_INFO: `/v3/projects/02876f4401704bd1ab982f527821de6f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:28:14.012503 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662e5e6-dc34-4bd2-b4f2-376e44e95ae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02876f4401704bd1ab982f527821de6f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:28:14.014441 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662e5e6-dc34-4bd2-b4f2-376e44e95ae9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:28:14.058472 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b662e5e6-dc34-4bd2-b4f2-376e44e95ae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02876f4401704bd1ab982f527821de6f', 'request_id': 'req-b662e5e6-dc34-4bd2-b4f2-376e44e95ae9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:14.065722 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b662e5e6-dc34-4bd2-b4f2-376e44e95ae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02876f4401704bd1ab982f527821de6f', 'request_id': 'req-b662e5e6-dc34-4bd2-b4f2-376e44e95ae9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:14.071244 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b662e5e6-dc34-4bd2-b4f2-376e44e95ae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02876f4401704bd1ab982f527821de6f', 'request_id': 'req-b662e5e6-dc34-4bd2-b4f2-376e44e95ae9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:14.081944 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b662e5e6-dc34-4bd2-b4f2-376e44e95ae9 admin admin] The token cache is being invalidate because project 02876f4401704bd1ab982f527821de6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 11:28:14.082233 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b662e5e6-dc34-4bd2-b4f2-376e44e95ae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:14.082856 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b662e5e6-dc34-4bd2-b4f2-376e44e95ae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 11:28:14.084597 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1471/2913] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Jun 27 11:28:13 2022] DELETE /identity/v3/projects/02876f4401704bd1ab982f527821de6f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 11:28:23.764655 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:28:24.078885 dv-cinder-797608-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 11:32:35.031412 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5920d-102f-48e0-823d-58900faafdc5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 11:32:35.033467 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c7b5920d-102f-48e0-823d-58900faafdc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:32:35.168786 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5920d-102f-48e0-823d-58900faafdc5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 11:32:35.226720 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b498c3-b779-49ea-917e-3e000c09ce42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8673c91abf14c0b9a237f0499fdf20e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6543a66af8ba48c391ce686f6d82276b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 11:32:35.227373 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b498c3-b779-49ea-917e-3e000c09ce42 service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 11:32:35.227660 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b498c3-b779-49ea-917e-3e000c09ce42 service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 11:32:35.227940 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b498c3-b779-49ea-917e-3e000c09ce42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 11:32:35.229751 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-64b498c3-b779-49ea-917e-3e000c09ce42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 11:32:35.240740 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b498c3-b779-49ea-917e-3e000c09ce42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 11:32:35.242362 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b498c3-b779-49ea-917e-3e000c09ce42 service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 11:32:35.252828 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1443/2914] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jun 27 11:32:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 11:32:45.247932 dv-cinder-797608-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}